Infrastructure6d ago
vLLM and OpenRouter Launch Day-0 Serving for DeepSeek-V4.1-Flash-1017: 830K tok/s per GPU and 1.3B Tokens/$ TCO on SemiAnalysis AgentX
Following the release of DeepSeek-V4.1-Flash-1017, vLLM announced Day-0 serving optimization delivering 1.3B tokens per dollar TCO and 830K tok/s per GPU at 100 tok/s/user on SemiAnalysis AgentX (5x agentic throughput gain since Day 0), while OpenRouter launched live multi-provider routing starting at $0.10/M input and $0.50/M output tokens.
Models3d ago
OpenAI Solves Legacy Software Migration: MultiLangBench Lifts COBOL Pass Rate to 97.9%, Modernizing Enterprise Stacks
OpenAI officially announced breakthroughs in building and migrating software written in low-resource and legacy languages (COBOL, Fortran, Visual Basic, OCaml), introducing the MultiLangBench evaluation suite. Tackling the trillions of dollars in critical banking and enterprise mainframe infrastructure, the benchmark challenges models to synthesize a SQLite-compatible database engine across 20 distinct languages. GPT-6 Astra boosted average test pass rates from 26.8% to 87.4%, with COBOL soaring from 10.9% to 72.1%. In enterprise COBOL migration tasks, GPT-6.1 Sol achieved a 97.9% success rate while cutting inference costs by 39%.
Benchmark20d ago
OpenRouter ships Model Router Benchmarks: 7 routers vs 6 suites on quality, speed, and cost
On 2 Oct 2026 OpenRouter shipped Model Router Benchmarks: seven model routers (Auto, Jev, NVIDIA Switchyard, Unbiased Pareto, Sakana Fugu, and variants) compared on GPQA Diamond, Tau3 Banking, MMMU Pro Vision, SWE Atlas QA, Deep SWE, and Terminal Bench 2.1. The Router Index defaults to quality 60% / time 20% / cost 20%. openrouter/pareto-code and Fusion are not on this board.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.