AI Coding Live News

On October 31, Google DeepMind said PlanAssist, a Gemini-built planning tool developed with the UK government, Google Cloud and Faculty, will be made available to 12 more local planning authorities in England, bringing the total to 15 for a 12-month Beta on live applications. In early pilots at Barnet, Camden and Dorset, DeepMind says the average officer time on householder assessment tasks fell by 58%, and more than 70% of the drafted reports were approved with no edits. Planning officers keep the final decision.

Zoom

Published in arXiv:2610.25834, FrontierRefactor establishes the industry's first evaluation benchmark targeting autonomous coding agents on multi-scale, performance-oriented codebase refactoring. Unlike traditional benchmarks like SWE-bench that measure only functional pass rates, FrontierRefactor spans seven programming languages and 60 Amdahl-qualified tasks ranging from kernels to full repositories (10^1 to 10^4+ LOC). Initial evaluations reveal that over 41% of agent patches pass functional equivalence suites yet yield zero verified speedup—with 19.3% triggering severe runtime performance regressions, highlighting the vital need for multi-turn profiling feedback.

Zoom

The vLLM team announced two major milestones: shipping precompiled Python bytecode via uv in v0.32.0 release images cuts cold-start container launch by 14–18% (~18s on NVIDIA H100) with zero runtime recompiles. Additionally, vLLM integrated the Decision 3.0 (D3) structured reasoning family (0.6B to 27B) into the /v1/systemone endpoint, ranking #1 on the Jev Decision Index and delivering 1.8x req/s on a single AMD MI325X under 64 concurrent clients.

Zoom

The SGLang team released v0.5.22 featuring 950 PRs from 245 contributors: DeepSeek-V4.1 delivers up to 2.3x more throughput per GPU on NVIDIA H200 and 1.9x on AMD MI350X/MI355X via DSpark. The new InstantTensor loader cuts model loading time by 10x. B200 decodes Qwen3.8-Flash-Next 12% faster, while B300 speeds up GLM-5.3-Flash by 10% and yields 1.85x decode throughput for MiMo-V2.6-Pro. SGLang also adds native Apple Silicon PyTorch support and ComfyUI integration.

Zoom

SemiAnalysis revealed the first Google TPUv7 benchmark submission for the 2.8T Kimi K3 MoE model, led end-to-end by Inferact (the creators of vLLM) and Google using the TorchTPU vLLM stack. At a hardware rental cost of just $1.21/chip-hour (vs $2.31 for GB300 and $1.86 for GB200), TPUv7 delivers ~2.2M tokens per $1 TCO in the ultra-high interactivity regime (~390 tok/s/user), outpacing NVIDIA GB200 NVL72, B300, and AMD MI355X on cost-performance.

Zoom

On Oct 11 the vLLM Semantic Router (vllm-sr) team released the Decision 3.0 family (d3, d3-flash, d3-mini, d3-nano, d3-lite, d3-edge) on Hugging Face under Apache-2.0. Built on Qwen3.5/3.8, the models take text, images and video and return probabilities for choice, yes/no and score questions in one call without generating text. Vendor-reported: the 27B d3 scores 64.7 on Jev Decision Index 0.3.1, ahead of Perplexity Decider v1.1 (62.8) and Decision 2.0 (55.9), with a 55 ms median text latency on one AMD MI325X.

Zoom

SGLang, a leading open-source high-throughput inference engine for large models, officially releases milestone version v0.5.21, merging 779 PRs across 227 contributors. The release introduces dynamic on-the-fly role switching between Prefill and Decode (PD) instances without restarting, an upgraded high-performance Rust core for the default prefix cache, and 22% faster first-token generation for DeepSeek-V4.1 on long prompts. It also debuts the /v1/decisions and /v1/score APIs, alongside complete support for next-gen models including MiMo-V2.6, DiffusionGemma, and GLM-5.3-Flash on AMD MI355X.

Zoom