Thinking Machines Opens Inkling 2 Small Weights on Hugging Face Under Apache 2.0: 594B-Total / 17B-Active MoE, Native NVFP4 Runs on Two B300s, Day-0 Support from SGLang, vLLM, Cloudflare and More
On November 12, Thinking Machines Lab made the Inkling 2 Small weights downloadable on Hugging Face under the Apache 2.0 license, keeping the promise it made at the November 5 closed launch to open the weights after safety testing. The model is a 594B-total, 17B-active multimodal MoE that takes text and image input with a 1M-token context. The main checkpoint is native NVFP4, the precision it was trained in, and needs at least 500GB of aggregated VRAM (two B300s or four H200s); an MXFP8 checkpoint is also published. SGLang, vLLM and Unsloth ship local recipes, and Cloudflare Workers AI, OpenRouter, Together, Nebius and others went live on day 0 at $0.30 per million input tokens and $1.00 per million output tokens.

- •License and repos: Hugging Face
thinkingmachines/Inkling-2-Small(main NVFP4 weights) andInkling-2-Small-MXFP8, Apache 2.0, usable commercially, for fine-tuning and in third-party products - •Specs (model card): 48-layer decoder, each token routed to 8 of 384 experts, hybrid local and global attention; 594B total / 17B active; text and image in, text out, up to 1M tokens of context
- •Hardware: NVFP4 needs at least 500GB aggregated VRAM (2x B300 or 4x H200); MXFP8 needs at least 800GB (4x B300 or 8x H200), and the lab says MXFP8 scores only 1-2 points higher, so it recommends NVFP4
- •Scores (vendor-reported, model card): AA Index v5.0 30.6, DeepSWE v1.1 72.1%, FrontierCode v2.0 25.4%, BrowseComp 90.2%; DeepSeek-V4.1-Flash still scores higher on AA Index (32.6) and DeepSWE (77.0%)
- •Day-0 ecosystem: local inference via SGLang, vLLM, TokenSpeed and Unsloth; post-training via Miles, SkyRL and Snowflake Cortex; Cloudflare Workers AI and OpenRouter both charge $0.30 in / $1.00 out per million tokens, and OpenRouter also lists a free variant










