Thinking Machines Lab Releases Inkling-Small: A 276B Total, 12B Active Open Weights Multimodal MoE Model

Thinking Machines Lab released Inkling-Small, an open weights Mixture-of-Experts model with 276B total and 12B active parameters, about a quarter the size of its 975B-parameter Inkling model. The model, trained on NVIDIA GB300 NVL72 systems, reasons natively over text, images, and audio, supports a 1M-token context window, and is available under Apache 2.0 on Hugging Face. It outperforms Inkling on several benchmarks, including SWE-bench Verified (80.2% vs. 77.6%) and Humanity's Last Exam (31.6% vs. 29.7%), while requiring as little as 180 GB VRAM with the NVFP4 quantized checkpoint.

Thinking Machines Lab https://thinkingmachines.ai/ has released Inkling-Small https://thinkingmachines.ai/news/inkling-small/ , an open weights Mixture-of-Experts model with 276B total parameters and 12B active . That is about a quarter the size of Inkling https://thinkingmachines.ai/news/introducing-inkling/ , which carries 975B total and 41B active parameters. The model was trained on NVIDIA GB300 NVL72 systems. It reasons natively over text, images and audio. The context window reaches 1M tokens, and thinking effort https://thinkingmachines.ai/news/introducing-inkling/ controllable-thinking-effort is adjustable. Weights ship under Apache 2.0 on Hugging Face https://huggingface.co/thinkingmachines/Inkling-Small . Is it deployable Yes, and the quantized checkpoint is why. Per the model card https://thinkingmachines.ai/model-card/inkling-small/ , the BF16 checkpoint needs at least 600 GB of aggregated VRAM . That is met by 4x NVIDIA B300 or 8x NVIDIA H200. The NVFP4 checkpoint https://huggingface.co/thinkingmachines/Inkling-Small-NVFP4 drops that floor to 180 GB . It runs W4A4 on a single B300, which requires SM100+, or W4A16 on two H200s. Supported runtimes are SGLang, vLLM, TokenSpeed, Unsloth and Hugging Face. That single-GPU path moves a 276B model out of frontier-lab territory. Startups can self-host on one rented B300 instance. Mid-size enterprises with existing H200 capacity can serve it without new hardware. Regulated sectors gain a private-weights option: financial services, healthcare operations, insurance, telecom and public sector. Applicable workloads include coding agents, terminal automation, and document and chart understanding. Audio widens that to call-center analytics, voice interfaces and meeting summarization. Architecture Inkling-Small is a 42-layer decoder-only transformer with a sparse MoE feed-forward backbone. Each token routes to 6 of 256 experts , plus 2 shared experts active on every token. Attention is a hybrid of local and global layers. The model is encoder-free and natively multimodal. Images are divided into 40×40-pixel patches and transformed using a four-layer hMLP. Audio is represented as dMel spectrograms. Both pass through a lightweight embedding layer and are processed jointly with text tokens. Numerics support covers BF16, MXFP8 and NVFP4. Audio input is WAV at 16 kHz, ideally under two minutes. Output is text only. Inkling-Small began training after its larger counterpart. That let the research team revise the pre-training data mix and the machine learning recipe. The research team post-trained an earlier checkpoint, Inkling-Small preview , in part using on-policy distillation with Inkling as the teacher. From that checkpoint, it continued scaling agentic coding RL for two weeks. Benchmark results The smaller model surpasses its teacher on reasoning and agentic coding. On Humanity’s Last Exam text only Inkling-Small scores 31.6% , ahead of Inkling’s 29.7%. SWE-bench Verified is 80.2% versus 77.6%, using a bash-only harness. Terminal-Bench 2.1 reaches 64.7% at best harness. Toolathlon Verified is 54.4% , against Inkling’s 45.5%. GPQA Diamond is 89.5%, AIME 2026 is 95.5%, and IFBench is 82.2%. ARC-AGI-2 rises to 40.1% from Inkling’s 36.5%. SimpleQA Verified falls to 20.6% from Inkling’s 43.9%, and the AA Omniscience index drops to -9.0 from 2.1. Tau 3 Banking is 15.5% versus Inkling’s 23.7%. All evaluations ran at effort 0.99 and temperature 1.0, with a 256K max-token trajectory limit on coding evals. External scores are sourced from Artificial Analysis https://artificialanalysis.ai/evaluations/ , Scale AI https://scale.com/leaderboard and ARC Prize https://arcprize.org/ . Multimodality, epistemics and safety Multimodal scores stay close to Inkling at lower cost. MMMU Pro is 74.0%. CharXiv RQ is 77.4%, rising to 81.3% when the model uses Python to crop, zoom and inspect charts programmatically. Audio MC is 54.9%, MMAU is 77.0%, and VoiceBench is 90.1%. On epistemics, calibration was trained with RL against proper scoring rules on a large corpus of real-world forecasting questions. ForecastBench without search gives a Brier Index of 61.3 ± 0.46, ahead of Inkling’s 60.1 ± 0.54. On safety, StrongREJECT is 98.4%, FORTRESS adversarial is 71.6%, and FORTRESS benign is 96.9%. Thinking Machines Lab concluded the model presents no material uplift beyond the existing open-weight ecosystem. It recommends layering downstream moderation such as Llama Guard on consumer-facing deployments. Both models are available on Tinker with a limited-time discount. Text, image and audio chat run on Tinker Playground https://tinker.thinkingmachines.ai/playground . Interactive explainer The embed below breaks the release into four interactive parts. Tab one animates how sparse routing activates 8 of 258 experts per layer. Tab two ranks Inkling-Small against comparable open weights models on ten benchmarks. Tab three traces how the three input modalities converge into one decoder. Tab four sizes the hardware each checkpoint format requires. Key Takeaways - Inkling-Small is a 276B total, 12B active MoE model under Apache 2.0. - It beats the 975B Inkling on HLE, SWE-bench Verified, Terminal-Bench 2.1 and ARC-AGI-2. - The NVFP4 checkpoint runs on a single B300 at 180 GB aggregated VRAM. - Factual recall regressed: SimpleQA Verified 20.6% versus Inkling’s 43.9%. - Native text, image and audio input with a 1M token context window. Check out the Technical details and Also, feel free to follow us on Model weight https://huggingface.co/thinkingmachines/Inkling-Small . and don’t forget to join our Twitter https://x.com/intent/follow?screen name=marktechpost and Subscribe to 150k+ML SubReddit https://www.reddit.com/r/machinelearningnews/ . Wait are you on telegram? our Newsletter https://www.aidevsignals.com/ now you can join us on telegram as well. https://t.me/machinelearningresearchnews Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us https://forms.gle/wbash1wF6efRj8G58 Asif Razzaq is the CEO of Marktechpost Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.