AI Coding Live News

On Nov 2, semiconductor and AI research firm SemiAnalysis released GDPx, a benchmark of agentic capability across 11 domains: chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment and software engineering. Its 206 tasks were built by 14 specialist data partners, with SemiAnalysis doing final QA. On the official leaderboard Claude Opus 5.5 leads at 12.0%, followed by Gemini 4 Carbon at 10.9% and GPT-6 Astra at 9.6%; nearly every model scores 0 on finance and legal. SemiAnalysis says safety classifiers drag down Opus 5.5 and GPT-6 Astra, and plans a new version every 3–6 months. All scores are as reported by SemiAnalysis.

Zoom

Kaggle announced ScarfBench with IBM Research, a 204-task benchmark that tests whether coding agents can migrate enterprise Java apps between Jakarta EE, Quarkus and Spring without changing behavior. IBM's October 27 technical note shows Gemini 4 Argon with Antigravity first on the smoke score at 75.2%, Claude Opus 5.5 with Claude Code highest on all-tests-pass at 72.1%, and GPT-6.1 Sol with Codex cheapest at $1.25 per solved task.

Zoom

Cognition, the company behind Devin, posted on X at 01:45 UTC on Oct 30 that Google's new Gemini 4 Carbon scores 40% on its FrontierCode 2.0 coding benchmark at $4.04 per task, near the top and behind only Claude Opus 5.5, GPT-6 Astra and Claude Sonnet 5.5. The earlier Gemini 4 Argon scores 26.3% at a higher $6.41 per task. The results are Cognition's own runs, and the leaderboard on its site has been updated.

Zoom

NVIDIA AI announced Nemotron 3.5 Transcribe on Oct 28, with weights on Hugging Face and ModelScope. It is an offline, instruction-driven speech model whose single checkpoint covers transcription in 40 languages, translation between 31 languages and English, speaker attribution in 13 languages, and audio question answering, on recordings up to an hour long with up to eight labeled speakers. NVIDIA says it ranks first among open-weight models on the Hugging Face Open ASR English leaderboard at 5.33% average WER, and Artificial Analysis measured a 2.8% AA-WER, tied for first among open models with Voxtral Small, which uses 24B active parameters. The weights, the Granary v2 training data and fine-tuning recipes are all released.

Zoom

Microsoft AI announced on Oct 27 that MAI-Image-2.6 and MAI-Image-2.6-Flash are generally available in Microsoft Foundry, with multi-reference editing from up to five images, Bing web grounding, output up to 1.5K and published per-token pricing. The same day its next image editing model, MAI-Image-2.7-Preview, reached #3 overall in Arena's Image Edit leaderboard at 1470 points, 45 points above 2.6; for now it is available only for editing in MAI Playground.

Zoom

Cursor announced on Oct 26 (UTC) that DeepSeek V4.1 Flash is now available in Cursor and can be turned on under Cursor Settings > Models. Cursor says every effort level sits on the CursorBench cost frontier, from $0.60 to $0.98 per task, with no model scoring higher at those prices. The official CursorBench 4.0 leaderboard lists DeepSeek V4.1 Flash 1017 at 47.7% on Max ($0.98 per task), 46.3% on Medium ($0.80), 45.6% on High ($0.77) and 44.9% on Low ($0.60). The top score on the board, Opus 5.5 Max, is 57.8% but costs $13.43 per task.

Zoom

On Oct 22 Canva released Canva Craft, the first image-generation foundation model trained from scratch by its in-house lab, Canva Research. It works in two stages: a planning model writes out the composition (elements, spatial relationships, hierarchy and any text), then a rendering model produces the image at up to 2K across more than 30 aspect ratios. Training leaned heavily on millions of human-made templates from Canva's library, such as posters, social posts, slides and infographics. Canva says it debuted 4th overall on the crowdsourced DesignArena leaderboard and 1st in the People & Portraits and Landscapes & Nature categories. It is available now to all Canva users in Dream Lab and to developers through the Connect API as craft_v1_2k, with Canva MCP access coming soon.

Zoom

On Oct 20, Krea said Krea 3, the image-editing model it released on Oct 15, has entered several third-party leaderboards. On Arena's Multi-Image Edit board, Krea 3 Ultra ranks #4 at 1435±11 (preliminary, 2,991 votes), behind three OpenAI models; it is #8 on single-image editing. On Artificial Analysis, Ultra scores 1151 Elo (#5) and Fast scores 1125 (#11). Krea 3 edits at native 2K, returns most edits in under 8 seconds and costs $0.06 per image.

Zoom

Independent AI evaluation authority Artificial Analysis launched the HealthBench and HealthBench Professional clinical reasoning and medical conversation leaderboards. Addressing the critical flaw where models artificially inflate medical scores through exhaustive, padded responses, the Professional benchmark implements rigorous length penalties. GPT-6 Astra (max effort) leads the world at 66.0%, with GPT-6.1 Sol at 65.1% and Claude Sonnet 5.5 at 63.0%. Claude Opus 5.5, despite holding a 71.4% raw score, collapses to 59.9% (#6) due to averaging ~5,900 characters per reply.

Zoom

On October 19 independent evaluator Artificial Analysis launched two health-conversation leaderboards built on OpenAI's HealthBench (5,000 realistic health conversations) and HealthBench Professional (525 clinician conversations), graded against physician-written rubrics and reported as both raw and OpenAI-style length-adjusted scores. On Professional, GPT-6 Astra (max) leads at 66.0% length-adjusted, ahead of GPT-6.1 Sol (65.1%) and Claude Sonnet 5.5 (63.0%); Claude Opus 5.5 has the top raw score (71.4%) but drops to sixth (59.9%) because its ~5,900-character answers are penalized. On HealthBench, Claude Sonnet 5.5 leads at 62.1%, with DeepSeek V4.1 Flash close behind at 60.9% for about 1/16 of the cost per task.

Zoom

MiniMax officially announced M3.1 Flash, its next-generation lightweight frontier model (previously dominating leaderboards as the secret model Space Bunny across 200T+ tokens). Featuring a native 1M context window, flat-rate API pricing of $0.15 / $0.60 per 1M input/output tokens ($0.015 cache reads), and 3x faster inference at 1/3 the cost of M3. It surged +106 points to 1588 on LMSYS Code Arena: WebDev (#12 among open models), with full weights set for open release on October 23.

Zoom

Google Labs launched Playground on 2026-10-07: describe a game in chat, test it, and share it or publish it to the Explore gallery, with multiplayer and leaderboards in select genres. It runs on Gemini, Nano Banana, and Lyria with a custom harness. US 18+ first; weekly creation tokens with higher limits on Google AI plans; Unity Spark integration coming.

Zoom

GitHub's blog post ReviewBench (Oct 5, 2026) launches an offline AI code-review benchmark as a research preview. It has 219 PRs from 187 open-source repos in 19 languages, sampled to match the distribution of 103.9M GitHub PRs. The golden set combines human reviewers, several frontier LLMs and static analysis. Claude Sonnet 5 is the judge, and senior engineers agreed with its labels 96.6% of the time. On the leaderboard, grounded recall is 26.0% for Copilot Code Review (Balanced), 23.8% for Devin, 22.1% for Qodo and 9.6% for Cursor. The dataset, judge prompt and runner are MIT-licensed on GitHub.

Zoom

stablyai/orca positions itself as an Agent Development Environment (ADE): parallel CLI coding agents (Claude Code, Codex, OpenCode, Pi, …) each in an isolated git worktree, with desktop, mobile companion, and remote hosts. Verified now: ★84,136 / 5,424 forks; MIT; desktop v1.4.219 (2026-10-02); Android mobile-android-v0.0.52 (2026-10-03). Site onOrca.dev. No official SWE leaderboard—no invented scores.

Zoom