AI Coding Live News

Google Cloud officially open-sourced TorchTPU, enabling native, zero-compilation-barrier PyTorch execution directly on Google Cloud TPU hardware (TPU v5p and TPU v6e). Overcoming the legacy friction of PyTorch/XLA's rigid graph compilation and dynamic-shape stalls, TorchTPU supports native PyTorch eager execution and custom Triton/C++ kernels. Leading high-throughput serving engines vLLM and SGLang announced immediate Day-0 support. Concurrently, Google Cloud introduced OpenAI models and Codex into its Vertex Model Garden, becoming the first hyperscaler to offer all three top frontier closed models.

Zoom

Hours after DeepSeek open-sourced DeepInfer, the vLLM project team released official benchmark parity data serving DeepSeek-V4.1-Flash. Utilizing DeepSeek's identical decoding setup (131K context window, nextn=3 speculative decoding), vLLM closed its throughput performance delta to within 6% of DeepInfer across batch sizes 8 through 256 on NVIDIA GB200 systems. On GB300 hardware, vLLM attained up to 1,000,000 tokens/second per GPU and 826 tokens/second per user, generating $38.96 in hourly GPU revenue at DeepSeek off-peak rates. vLLM simultaneously shipped day-0 runtime support for FastH3-Omni and Spark-X2.6-4B.

Zoom

On October 19 Ant Ling (inclusionAI) open-sourced five Ming-3.0 models under MIT, spanning speech synthesis (tts-0.5B; tts-tiny, 7.9B total/1.3B active), audio understanding (audio-flash, 126B/6.5B active; audio-tiny, 9.3B/2.7B active) and speech recognition (asr-tiny, 8.6B/2B active). Per the vendor, tts-0.5B ranks #1 among open-weight models on Artificial Analysis Controlled Voice at 1069 Elo and ties #1 overall on pronunciation robustness at 93.2%; asr-tiny averages 4.41% error across four ASR categories. Weights are on Hugging Face and ModelScope, with day-0 SGLang and vLLM support.

Zoom

MiniMax confirmed that Space Bunny, the anonymous model that led usage rankings on OpenRouter and elsewhere, was an early version of M3.1 Flash, and launched it on its API on October 19. Pay-as-you-go pricing is $0.15 input, $0.60 output and $0.015 cache read per million tokens, with a 1M context, text, image and video input, and an effort setting for thinking depth. Per MiniMax, it costs one third of M3 and runs 3x faster, scoring 73.7% on DeepSWE and 62.2% on Automation-Bench; the weights went live on Hugging Face on schedule on October 23 (MiniMax Community license, MXFP8), with day-0 support from Together, Inferact (vLLM) and LightSeek TokenSpeed.

Zoom

Following the release of DeepSeek-V4.1-Flash-1017, vLLM announced Day-0 serving optimization delivering 1.3B tokens per dollar TCO and 830K tok/s per GPU at 100 tok/s/user on SemiAnalysis AgentX (5x agentic throughput gain since Day 0), while OpenRouter launched live multi-provider routing starting at $0.10/M input and $0.50/M output tokens.

Zoom

On 2026-10-15, MBZUAI’s Institute of Foundation Models (IFM) and Inception42 released Jais 3—the first language adaptation of the open K2 Horizon fleet. Six open-weight sizes run from a 0.9B dense phone model to a 375B-A23B sparse MoE (≈23B active), plus Jais Speech for Arabic ASR. Models share one training recipe and agent stack, with up to 512K context (128K on 0.9B), Apache-2.0 weights and stage checkpoints on Hugging Face, and day-0 vLLM support.

Zoom

On 2026-10-16 Hugging Face and Reflection confirmed Beam weights are downloadable: ~501B-total / ~23B-active sparse MoE, 1M context, Apache 2.0. BF16/FP8/NVFP4 checkpoints ship with day-0 transformers≥5.20.1, vLLM and SGLang. Model-card figures (vendor): SWE-bench Verified 81.6% (BF16), Terminal-Bench 2.1 80.1%, MCP Atlas 80.8%. This closes the Oct 5 promise to release weights later that month.

Zoom

On 2026-10-02 ggml-org announced llama.cpp server support for Decision Models via /v1/systemone (PR #29818, merged 2026-10-02T09:56Z). Send a state plus typed questions; get option probabilities in one forward pass. Day-0 models: Julia-1, Laya, Kev-4B, lev, OpenJev (vision). Cloudflare Clef is planned next.

Zoom