Benchmark6d ago
Cognition scores Gemini 4 Carbon at 40% on FrontierCode 2.0 for $4.04 a task, near the top, while Gemini 4 Argon gets 26.3% at $6.41
Cognition, the company behind Devin, posted on X at 01:45 UTC on Oct 30 that Google's new Gemini 4 Carbon scores 40% on its FrontierCode 2.0 coding benchmark at $4.04 per task, near the top and behind only Claude Opus 5.5, GPT-6 Astra and Claude Sonnet 5.5. The earlier Gemini 4 Argon scores 26.3% at a higher $6.41 per task. The results are Cognition's own runs, and the leaderboard on its site has been updated.
Tooling2d ago
Gemini API Deprecates Gemini 2.5 Pro and 2.5 Flash: From December 1, Requests Auto-Route to 3.8 Flash and 3.5 Flash-Lite at the New Models' Rates
In its November 2 Gemini API changelog, Google deprecated gemini-2.5-pro and gemini-2.5-flash and removed both from the Google AI Studio model picker. From December 1, 2026, requests to gemini-2.5-pro will automatically route to gemini-3.8-flash and requests to gemini-2.5-flash to gemini-3.5-flash-lite, billed at the new models' rates. Google flags breaking API changes: stricter function calling and thought_signature validation, thinking_level replacing thinking_budget, and removal of sampling parameters such as temperature and of prefilled model turns. The model string stays valid but behavior can change, so developers should switch model strings and rerun tests before December 1.
Tooling8d ago
Apple Creator Studio adds AI assistants built on Apple models and OpenAI to Logic Pro, Keynote, Pages and Numbers, plus MCP support so external agents can edit iWork documents
On October 27 Apple announced a major Apple Creator Studio update: Logic Pro for Mac plus Keynote, Pages and Numbers gain beta intelligent assistants that Apple says are powered by a combination of Apple-built models and OpenAI and understand document context. Keynote, Pages and Numbers also add Model Context Protocol (MCP) support, letting external AI agents read content, make edits and run automated actions inside the apps. Pixelmator Pro adds natural-language Generate Fill, and Keynote introduces the open JSON-based .keyx format. The update ships free to existing subscribers on the App Store in November; pricing stays $12.99 per month or $129 per year.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.