Benchmark7d ago
Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%
Cognition, the maker of Devin, released FrontierCode 2.0 on Oct 27. It keeps the method of maintainer-written tasks graded on whether the code is actually mergeable, but draws tasks from more repositories, adds security patches and performance work, uses deliberately underspecified prompts and adds many thoroughness criteria. In Cognition's results Claude Opus 5.5 leads at 45.5%, GPT-6 Astra follows at 42.8%, and Grok 4.7 and Gemini 4 Argon drop into the 20s, leaving the benchmark far from saturated.
Benchmark15d ago
Devin Fusion with an Opus 5.5 lead and GPT-6 Luna sidekick tops the Artificial Analysis Coding Agent Index at 68.1, at what Cognition says is 31% lower cost per task than Claude Code with Opus 5.5
Cognition said on October 19 that Devin Fusion, pairing Claude Opus 5.5 as the lead with GPT-6 Luna as the sidekick, scored 68.1 on the Artificial Analysis Coding Agent Index v1.5. Artificial Analysis's current data puts it first, but only 0.1 ahead of Muse Code with Muse Wonder Full at 68.0, effectively a tie; Antigravity CLI with Gemini 4 Argon is third at 63.8. Cognition says the pairing costs 31% less per task than Claude Code with Opus 5.5 (vendor-reported). Fusion ships in Devin CLI and Desktop.
Tooling6d ago
Android Studio Rabbit 2 goes stable with Bring Your Own Agent: 40+ coding agents including Claude Agent, Codex and Antigravity via the open ACP
On Oct 28, the day of Android Dev Summit, Google shipped Android Studio Rabbit 2 (2026.2.2) to the stable channel. The headline change is that Bring Your Own Agent (BYOA) moves from its September Canary preview to a stable feature: developers can plug any Agent Client Protocol (ACP) compatible coding agent into the IDE agent window. Google says more than 40 are available, including Anthropic Claude Agent, OpenAI Codex, JetBrains Junie and Google Antigravity, and users can sign in with personal or enterprise plans. The release also adds an agent skills manager, AI Change Review and agent-assisted LeakCanary fixes.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.