AI Coding Live News

Ricursive Intelligence released its first model, Ripple-65B Preview, on November 4 (18:24 UTC), open-sourcing the instruction-tuned model (BF16 and NVFP4) and a base model on Hugging Face under Apache 2.0. The official model card describes a 65B dense Transformer pretrained on 12T tokens with up to 1M context, and self-reports TerminalBench 2.1 80.5, SWE-bench Pro v2.0 Hard 79.1 and DeepSWE 1.1 44.3, ahead of much larger US open-weight models on agentic coding. It fits on local hardware such as the DGX Spark. CEO Anna Goldie says it cost about a tenth of the prior comparable state of the art.

Zoom

On Oct 29 Mistral released an improved Mistral Large 4 (Le Chonk) with open weights on Hugging Face (plus an NVFP4 quantized checkpoint), served on its API as mistral-large-4. After about three more weeks of reinforcement learning since the early-October preview, Mistral reports 19.7% on FrontierCode 2.0, Terminal-Bench 4.0 up from 28% to 41%, and new low/medium/high reasoning modes. The license is a modified MIT that allows commercial use, but running a model-as-a-service business needs a separate commercial license.

Zoom

On Oct 20, the FastVideo team at UCSD's Hao AI Lab open-sourced FastH3 Omni, a distilled version of MiniMax H3's reference-to-video-and-audio (Ref2VA) model that generates video with synchronized stereo audio from text plus up to nine images, video clips and voice references. Sampling drops from 50 steps to eight transformer evaluations, cutting end-to-end latency 5.6-11.9x on eight GB200s by the team's measurements. Training code is open, with NVFP4 weights for DGX Spark and RTX 5090 and ComfyUI support.

Zoom

vLLM shipped v0.32.0 on Oct 18 with 814 commits from 363 contributors (121 new). Highlights: a default-served POST /v1/systemone structured-decision endpoint and a generic hf tool/reasoning parser; NVFP4 KV cache on SM8x/SM90/SM12x and FP8 KV by default for GLM-5.x on SM100; Model Runner V2 gains a GPU n-gram speculator and Elastic EP and becomes the ROCm default; three security advisories are fixed, default CORS is restricted, and Python 3.10 is dropped.

Zoom

NVIDIA published Nemotron-Labs Dory1.0-4B on Hugging Face on Oct 16: a 20-layer shared block runs 1, 2 or 4 times at inference so one checkpoint serves several compute budgets. NVIDIA reports 61.8 on SWE-bench Verified at 4 loops, close to Qwen3.5-9B. BF16/MXFP8/NVFP4/GGUF under OpenMDW-1.1.

Zoom

On 2026-10-15 Meta released Muse Spark Open open weights: an 816B-total / 42B-active MoE with a Perception Encoder, natively multimodal (text/image/video/audio in → text out), 1M context, aimed at coding and long-horizon agents. Weights are on Hugging Face (BF16/NVFP4), SageMaker, Model Garden and Foundry; APIs include OpenRouter, Together, Fireworks and Groq. Meta calls it the most capable US open-weight model to date and, with Apple, optimized it to run locally across two M5 Ultra Mac Studios via MLX.

Zoom

On 2026-10-15 Black Forest Labs released FLUX 3 Image Klein, a 5.6B open-weights image model for text-to-image, editing and multi-reference generation with up to 10 references, inheriting FLUX 3's native 4K output, pixel-perfect edits and bounding-box control. It ships as a fine-tunable base and a step-distilled model, plus FP8/INT8/NVFP4 builds made with NVIDIA; the INT8 build runs on RTX GPUs with 8GB VRAM. Weights use the FLUX Kommunity License (free commercial use under $5M annual revenue), and it is live on the BFL API.

Zoom

On 2026-10-15 StepFun released open weights for Step 5 Preview as promised: a 600B-total / 27B-active sparse MoE with up to 1M-token context and vision input, aimed at agentic software engineering and knowledge work. Checkpoints are on Hugging Face (FP8, BF16, NVFP4) and ModelScope. Official scores include StepCodeBench 49.0%, FrontierFinance 66.4%, and Artificial Analysis Intelligence Index 44. September coverage was API/index only; this is the first public weight drop.

Zoom

On 2026-10-16 Hugging Face and Reflection confirmed Beam weights are downloadable: ~501B-total / ~23B-active sparse MoE, 1M context, Apache 2.0. BF16/FP8/NVFP4 checkpoints ship with day-0 transformers≥5.20.1, vLLM and SGLang. Model-card figures (vendor): SWE-bench Verified 81.6% (BF16), Terminal-Bench 2.1 80.1%, MCP Atlas 80.8%. This closes the Oct 5 promise to release weights later that month.

Zoom

Large language model serving exhibits bifurcated hardware constraints: prefill is compute-bound, benefiting from high-throughput low-precision tensor operations (e.g., NVFP4), while decode is memory-bandwidth-bound, requiring ultra-compact weight storage (e.g., 2-3 bit weight-only) to minimize token-generation memory traffic. Uniform quantization forces suboptimal compromises across both phases. Researchers from IST Austria introduce Disaggregated Quantization (DQ, arXiv:2609.26333), decoupling computation formats, quantization precision, and physical memory placement across prefill and decode. Paired with Offloaded Disaggregated Prefill (ODP) to stream NVFP4 prefill weights asynchronously from NVMe SSDs, DQ delivers a 1.78x time-to-first-token (TTFT) speedup on Qwen3.8-27B at 8K prompt length within llama.cpp, while supporting disaggregated serving in vLLM on architectures up to 2.8T parameters.

Zoom

Addressing the fundamental tension where prefill is compute-bound while decode is memory-bandwidth-bound, researchers from ISTA and Neural Magic introduced Disaggregated Quantization (DQ). By assigning compute-native NVFP4 weights to prefill and compact 2-3 bit weights to decode, paired with Offloaded Disaggregated Prefill (ODP) that streams prefill weights from SSD, DQ cuts Time-To-First-Token (TTFT) by 1.78x at 8K context and lifts 1-bit decode accuracy by 32.5 points on MMLU-Pro.

Zoom