Benchmark1d ago
Einsia and Tsinghua Release WorkflowArena, a Multi-Agent Orchestration Benchmark: 145 Long-Horizon Tasks, 25 Claude Code and Codex Configurations, and Even Top-Ranked Opus 5.5 Fully Resolves Only 36.95%
On November 10, Einsia AI, with Tsinghua University and others, released WorkflowArena, a benchmark that tests whether a model can split a task, dispatch worker agents, write the workflow, and integrate the results on its own. It has 145 long-horizon tasks across 8 professional domains, scored by hidden verifiers, with every delegation recorded. The paper tests 25 configurations of 9 models in Claude Code and Codex: the best, Claude Opus 5.5 at max effort, fully resolves only 36.95% of tasks on average, the best SWE rate is 29.41%, and law never exceeds 9.09%. Claude models delegate rarely but in large groups, GPT models often and in small units, and workflows written by Opus raise weaker executors by 6.41 points on average. Code and paper are public.
Pricing17h ago
Anthropic Gives Claude Pro, Max, Ultra, and Team Users One Free Full Reset Across All Models and Limits, Usable Before December 10 at 2:00 p.m. PT
On November 10, Anthropic's official developer account ClaudeDevs said all Pro, Max, Ultra, and Team users are getting one free full reset, across all models and limits, usable anytime before December 10 at 2:00 p.m. PT (6:00 a.m. Singapore time on December 11). The company said it recently fixed a few small issues that used more limits than intended, and that the earlier Fable resets for the Fable 5.2 launch did not do much for people who had already hit their weekly limits for all models. The issues did not affect everyone, but Anthropic said it wanted to make up for the trouble. The reset is in Settings > Usage, or at clau.de/reset.
Pricing1d ago
X Discussion: Theo Analyzed 1.1 Million Requests and Says the $200 Claude Ultra Plan Buys About $15,000 of Opus 5.5 a Month but Only About $3,000 of Fable 5.2, Arguing Work Done per Week Is the Number That Matters
On November 10, T3 Code CEO Theo posted that, based on more than 1.1 million real requests sent through his Ultra subscription, the $200 Claude Ultra plan covers about $15,000 of Opus 5.5 at API prices per month, versus about $3,000 of Fable 5.2. The post drew more than 3,900 likes and 1,000 bookmarks. He also noted Fable more often finishes a task in one prompt, so the gap shrinks when measured as work done per week. These are personal figures, not official data; what Anthropic confirms is the $8/$40 Fable 5.2 price and the launch-week Fable usage rules.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.