AI Coding Live News

Artificial Analysis Makes Time per Task Its Headline Performance Metric: GPT-6 Astra Finishes a Max-Effort Task in About 17 Minutes, Ahead of Opus 5.5 and Gemini 4 Carbon

Independent benchmarker Artificial Analysis announced on X on November 4 (17:34 UTC) a new version of its API performance benchmarking: the headline metric moves from output speed to Time per Task, the time to finish one Intelligence Index task (output tokens per task divided by end-to-end output speed). It covers about 1,000 serverless endpoints, measures speed from sending the request to the final token, and adds multi-turn agentic coding and knowledge-work workloads. Per its data, GPT-6 Astra at max effort runs at 51 tokens/s yet finishes a task in about 17 minutes, against about 26 for Claude Opus 5.5 (max) and about 29 for Gemini 4 Carbon (high).

Key Takeaways

  • Time per Task equals output tokens per Intelligence Index task divided by end-to-end output speed, so a model that is fast per token but verbose can finish later than a slower model that uses fewer tokens.
  • End-to-end output speed runs from sending the request to the final token, including the wait before the first token (prefill and hidden reasoning); output tokens now come from each provider's API-reported counts instead of the o200k_base tokenizer.
  • GPT-6 Astra (max) runs at 51 tokens/s with about 50k output tokens per task and takes about 17 minutes; Claude Opus 5.5 (max, 111 tokens/s) takes about 26 minutes and Gemini 4 Carbon (high, 71 tokens/s) about 29, using roughly 120k to 170k tokens per task.
  • At each lab's API default effort (medium for all three), GPT-6 Astra, GPT-6.1 Sol and Opus 5.5 cut Time per Task by about 3 to 5x and Cost per Task by about 2 to 4x, scoring about 5 to 11 points lower; Opus 5.5 drops from about 26 minutes and $10.04 to about 6.8 minutes and $2.45.
  • The official methodology page lists this as version 3.0.0 (October 30), with runs now every 6 hours and a new endpoint error rate metric.
Read full story

Axiom Formalizes the Entire Stacks Project in Lean With AI Agent Swarms: About 16 Million Lines, Billed as the Largest Reusable Formal Math Library Yet

Axiom released a Lean formalization of the entire Stacks Project on November 4 (official X post at 17:13 UTC, with over 2 million views). The roughly 7,500-page open-source algebraic geometry reference, started by Johan de Jong in 2005, becomes about 16 million lines of code, which Axiom calls the largest integrated, reusable formal math library ever built. Hierarchically coordinated AI agent swarms did the work and surfaced dozens of statements in the original that needed local fixes, with counterexamples. The library is open source and browsable side by side with the original text at stacks.axiommath.ai.

Axiom Formalizes the Entire Stacks Project in Lean With AI Agent Swarms: About 16 Million Lines, Billed as the Largest Reusable Formal Math Library Yet

Key Takeaways

  • Scale: about 7,500 pages of source text and roughly 16 million lines of Lean, which Axiom calls the largest integrated reusable formal math library (vendor claim).
  • Method: hierarchical AI agent swarms translate statements, search Mathlib for existing abstractions and build proofs in parallel, with multi-agent auditing and semantic cross-checks against the source to keep statements faithful.
  • Findings: the system surfaced dozens of statements needing local refinement, including missing hypotheses and edge cases in positive characteristic, and built explicit counterexamples where claims failed.
  • The permanent Stacks tag structure is preserved so every Lean declaration links back to the original text; stacks.axiommath.ai offers side-by-side reading and a dependency graph.
  • This follows Axiom's October 27 formalization of the Classification of Finite Simple Groups (CFSG); per de Jong's request, corrections are kept in Axiom's own repository rather than sent upstream.
Read full story
Linked Models & Agents:

X discussion: Flask creator Armin Ronacher says an Opus 5.5 agent could re-implement all of CPython in about two weeks with no human input, sparking a debate over whether the value is in the test suite

Flask creator Armin Ronacher (@mitsuhiko) posted on November 1 that he is convinced an Opus 5.5 agent could now re-implement all of CPython in about two weeks against just the tests, with no human input, possibly with ABI compatibility, no GIL, a JIT, and better numbers on every measurable metric. The post had about 1,637 likes, 98K views and 162 replies. He later added that a rewrite does not strictly need an existing test suite, and that having the agent build its own tests is often better for porting. antirez agreed, while Mario Zechner and Meta engineer Kevin Newton pushed back. This is a personal prediction; no such rewrite has been done.

Key Takeaways

  • Original post: @mitsuhiko, Nov 1, 11:52 UTC, about 1,637 likes, 269 bookmarks, 162 replies and 98K views at fetch time
  • His core claim: given just the tests and no human input, an agent could rewrite CPython in about two weeks, "probably" with full compatibility including ABI, no GIL and a JIT, which he called "completely crazy"; it is a prediction, not an experiment
  • Follow-up post (14:07 UTC, about 212 likes): an existing test suite is not required, and many pre-existing tests are bad for hill climbing; he says an agent he ran a few weeks ago re-implemented the Excel formula engine and built its own test suite from scratch
  • antirez (creator of Redis) agreed that you can ask an agent to build a large test suite before starting a port; Mario Zechner disagreed, saying his problem with agents is trust and pre-existing test and conformance suites increase it
  • Meta engineer Kevin Newton pushed back that very few Python JITs have succeeded because of complexity and compatibility, and that a good one without human input is unrealistic; others noted that under PEP 703 the free-threaded build is not ABI-compatible with the standard one
Read full story
Linked Models & Agents:

Symantec finds a grey-market relay that installs the real Codex and Claude Code CLIs, then turns off sandboxing and routes every request through its own servers

On Oct 29 Symantec's Threat Hunter Team disclosed an unauthorized AI relay seen at about a dozen organizations since early 2026, mostly in mainland China. Users install the genuine Codex or Claude Code CLI via npm, then run a one-line script from the reseller that rewrites ~/.codex/config.toml or ~/.claude/settings.json, points base_url at relay domains, swaps in relay-issued keys, sets the sandbox to danger-full-access and disables telemetry. Symantec says this is not a CLI vulnerability and it has seen no abuse so far.

Symantec finds a grey-market relay that installs the real Codex and Claude Code CLIs, then turns off sandboxing and routes every request through its own servers

Key Takeaways

  • About a dozen affected organizations, mostly in mainland China, plus Chinese or home-market units of South Korean, Taiwanese and Malaysian firms in semiconductors, electronics, pharma, shipping and petrochemicals
  • A one-line iwr | iex or curl | bash command fetches a fileless script from lookalike domains such as vibe.aiok[.]me, installs the genuine CLI, then rewrites its config, so it looks like a normal setup step
  • The Codex sandbox is set to danger-full-access with network access on, and DISABLE_TELEMETRY=1 and DISABLE_ERROR_REPORTING=1 are set
  • Relay-issued Claude Code keys use the sk-ant-oat01- prefix of subscription OAuth tokens, which Symantec says is consistent with, but not proof of, pooled subscription resale
  • Symantec says this is not a vulnerability in Codex or Claude Code and it has no evidence the operator has abused its access; the risks are potential
Read full story
ADSponsored

FrontierCS 2 benchmark: agents must rebuild a paper's deleted contribution in its own repo and beat the authors' code; Claude Opus 5.5 leads at 58%, 16 tasks unsolved

Teams from UC Berkeley, Princeton and others released FrontierCS 2 (arXiv 2610.29932): 48 tasks across 13 CS domains, each built by deleting a paper's contribution from the authors' released code. An agent has 5 hours to write it back and passes only if it beats the original on every metric and every hidden workload. Of 12 agents, Claude Opus 5.5 in Claude Code leads with a 58% pass rate, every other agent passes fewer than half, and 16 tasks have no passing run. On Oct 26 maintainer Wenhao Chai said a trace audit showed the Pi harness ends runs on refusals; rerun in Antigravity, Gemini 4 Argon now beats GPT-6 Astra and sits right behind Opus 5.5.

Key Takeaways

  • 48 tasks, 13 domains, 12 agents, one run per agent per task (paper)
  • Strict pass rule: the final submission must beat the authors' code on every metric and every hidden workload; a higher total score can still fail
  • Claude Opus 5.5 in Claude Code leads with a 58% pass rate; 16 tasks have no passing run
  • Under the Pi harness, 10 of Gemini 4 Argon's 48 runs ended on provider refusals; rerun in Antigravity it beats GPT-6 Astra (Wenhao Chai's post)
  • Tasks and evaluators are open source on GitHub; the authors estimate a full 48-task run with Opus 5.5 at about $1,000 in API fees, $300 GPU and $100 CPU
Read full story

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Artificial Analysis released an independent evaluation of Cognition's new coding agent, Devin Fusion. Moving beyond single-model execution, Devin Fusion employs an asymmetric multi-agent architecture pairing Claude Opus 5.5 (max) as the lead reasoning orchestrator alongside GPT-6 Luna (high) as a high-speed parallel worker. In the standardized Coding Agent Index, Devin Fusion achieved an elite score of 68.1 (matching Muse Code at 68.0 and rivaling Claude Code Sonnet 5.5 at 68.4). Crucially, the hybrid architecture slashes average task expense from $13.04 down to $9.01 (a 31% cost reduction) while shortening execution runtime from 65 to 55 minutes.

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Key Takeaways

  • Artificial Analysis independently benchmarked Devin Fusion, scoring 68.1 on the standardized Coding Agent Index
  • Pioneers asymmetric model collaboration: Claude Opus 5.5 orchestrates architecture while GPT-6 Luna executes parallel sub-tasks
  • Cuts per-task execution costs from $13.04 to $9.01 (a 31% savings) and trims average completion time from 65 to 55 minutes
  • Outperforms Claude Code with Opus 5.5 on DeepSWE v1.1 (72.6% vs 68.4%) and SWE-Atlas-QnA (69.6% vs 66.4%)
Read full story

ChatGPT Officially Rolls Out Locked Chats: Biometric Authentication and Complete Memory Isolation Across All Tiers

OpenAI officially rolled out 'Locked Chats' across all ChatGPT subscription tiers, including Free, Plus, Team, Enterprise, and Edu. Users can now safeguard sensitive individual conversation threads behind a device PIN, Face ID, or Touch ID biometric lock. Crucially, locked chats feature strict memory isolation: interactions inside locked sessions are physically barred from updating ChatGPT's persistent user memory bank. Confidential corporate discussions, sensitive health queries, or proprietary code audits remain strictly ephemeral to the local lockbox without contaminating future general chat contexts.

ChatGPT Officially Rolls Out Locked Chats: Biometric Authentication and Complete Memory Isolation Across All Tiers

Key Takeaways

  • OpenAI officially released Locked Chats, rolling out globally across Free, Plus, Team, Enterprise, and Edu subscriptions
  • Enables hardware-level protection via device PIN, Face ID, and Touch ID, shielding sensitive threads from physical shoulder surfing
  • Guarantees complete memory isolation: queries, uploaded documents, and confidential context are strictly prohibited from updating user memory
  • Eliminates context contamination risks when conducting proprietary code reviews, compliance audits, or medical inquiries
Read full story
Linked Models & Agents:

ActionRoPE: Action as Coordinates for Spatially Consistent Control in Planar-Camera Game World Models

Researchers introduced ActionRoPE and Coordinate-Conditioned Noise Scheduling (CNS) in arXiv:2610.25861, solving spatial inconsistency in planar-camera game world models. In top-down and isometric gaming environments, naive feature-conditioned action mechanisms cause severe hallucination and revisit drift when players return to previously observed scenes. ActionRoPE directly converts action-induced camera displacements into world-coordinate rotary position embeddings (RoPE), ensuring identical physical world coordinates retain persistent token addresses across time. Benchmarks reveal that ActionRoPE cuts revisit drift by 66% over the strongest baseline while transferring across 1.3B to 33B parameter video backbones.

ActionRoPE: Action as Coordinates for Spatially Consistent Control in Planar-Camera Game World Models

Key Takeaways

  • ActionRoPE and Coordinate-Conditioned Noise Scheduling (CNS) introduced in arXiv:2610.25861, addressing spatial drift in planar game world models
  • Parameter-free action interface translates camera displacements into world-coordinate rotary embeddings, pinning physical regions to stable token addresses
  • Coordinate-Conditioned Noise Scheduling (CNS) stabilizes explored terrain early, slashing visual revisit drift by 66% over strong baselines
  • Demonstrates exceptional transferability across 1.3B to 33B parameter video diffusion backbones and out-of-distribution environments
Read full story
Linked Models & Agents:

BlenderWorld Benchmark Launches for Autonomous 3D Creation: GPT-6 Astra Leads with 79.9 Score on 223 Industrial Tasks

Researchers introduced BlenderWorld (arXiv:2610.23986), the first comprehensive benchmark evaluating visual agents creating and editing 3D models from real-world references in Blender. Spanning 223 tasks across procedural geometry, Python scripting, material shaders, spatial layouts, and lighting, GPT-6 Astra leads the benchmark with a composite Score of 79.9 (and a 42.2% Perfect completion rate), followed by Opus-5 at 73.0. Open-weight flagship DeepSeek-V4.1-Flash claims 65.7, matching proprietary models while relying on active execution-and-inspection tool loops.

BlenderWorld Benchmark Launches for Autonomous 3D Creation: GPT-6 Astra Leads with 79.9 Score on 223 Industrial Tasks

Key Takeaways

  • Researchers introduced BlenderWorld (arXiv:2610.23986), a 223-task benchmark evaluating autonomous visual agents creating 3D content in Blender
  • GPT-6-Astra leads the world with a 79.9 composite Score and 42.2% Perfect completion rate, followed by Opus-5 at 73.0
  • DeepSeek-V4.1-Flash ranks #1 among open models with 65.7, matching proprietary GPT-5.6-Sol on multimodal 3D synthesis (65.5)
  • Unmasks distinct engineering styles: GPT emphasizes upfront planning (39.9K tokens), while DeepSeek uses iterative inspection loops (168 tool calls/task)
Read full story
Linked Models & Agents:
A
Anthropicgithub.com·
👀66
🔥82

Claude Code 2.1.304 adds guided /auto-mode-setup and warns Pro/Max users before resuming an inactive conversation would eat into the 5-hour usage limit

Claude Code v2.1.304 (Oct 19 UTC) adds /auto-mode-setup, a guided setup that reads your project and recent sessions to teach auto mode about your environment, now also on Bedrock, Vertex, Foundry, Claude apps gateway and telemetry-disabled sessions. It adds a read-only /claude-api managed-agents-secure check against Anthropic's security guide, warns Pro/Max users when resuming an inactive conversation would use a noticeable share of the 5-hour limit, and fixes 40+ issues including claude --worktree deleting a worktree and branch without asking, which could lose commits.

Key Takeaways

  • New /auto-mode-setup reads your project and recent sessions to teach auto mode your environment, now on Bedrock, Vertex, Foundry, Claude apps gateway and telemetry-disabled sessions
  • New read-only /claude-api managed-agents-secure compares a Managed Agents agent's settings with Anthropic's published security guide
  • Pro/Max plans get a warning when resuming an inactive conversation would use a noticeable share of the 5-hour usage limit
  • Mods gain decider: "person" and e.isReadOnly in tool.check, so only a human permission dialog can approve certain calls
  • 40+ fixes, incl. claude --worktree removing the worktree and branch without asking (could lose commits) and CLAUDE_CODE_AUTO_COMPACT_WINDOW=200k silently becoming 100K
Read full story
ADSponsored

Tongji University & Tencent Introduce GeoState: View-Decoupled 3D World Modeling Prevents Camera Scale Drift Across Waymo and KITTI Rollouts

Modern 3D world models typically use view-dependent features from geometry foundation models (GFMs) as predictive states, entangling camera-induced variations with physical scene dynamics. Tongji University and Tencent introduced GeoState (arXiv:2610.22343). By aggregating multi-view GFM features into a view-decoupled 3D scene state, GeoState models physical scene evolution independently of camera viewpoints, maintaining a single context-derived scale throughout rollouts without per-frame scale realignment.

Tongji University & Tencent Introduce GeoState: View-Decoupled 3D World Modeling Prevents Camera Scale Drift Across Waymo and KITTI Rollouts

Key Takeaways

  • Tongji University and Tencent introduced GeoState (arXiv:2610.22343) for view-decoupled 3D world modeling
  • Separates physical scene evolution from camera-dependent observations via a dedicated scene tokenizer and ray-based geometry decoder
  • Maintains a single context-derived scale throughout multi-second rollouts on Waymo without per-frame scale alignment, outperforming VGGT-World and FR3D
  • Demonstrates robust zero-shot cross-sensor generalization across KITTI and nuScenes datasets
Read full story
Linked Models & Agents:

Anthropic gives a six-person METR team employee-like access and no veto over publishing its risk assessments

On Oct 15 Anthropic said it has onboarded six METR employees with company hardware, office space and access to internal tools and systems roughly on par with its own risk assessment teams. METR will publish its analysis of Anthropic's risk levels, incidents and practices; Anthropic cannot veto publication and may only require redactions in predefined categories. Anthropic also outlined a three-tier access model for evaluators and updates on SecureBio, Accenture and Faculty.

Anthropic gives a six-person METR team employee-like access and no veto over publishing its risk assessments

Key Takeaways

  • Six METR staff get company hardware, office space and internal access roughly on par with Anthropic's risk assessment teams (per Anthropic)
  • Anthropic cannot veto METR publications; it may only require redactions in predefined categories such as customer data, privileged legal material and model architecture
  • Evaluator access has three tiers: tier 1 publishes with approval, tier 2 publishes without approval, tier 3 (METR) adds employee-like access
  • SecureBio is reviewing the chem/bio chapter of the August Risk Report; partnerships with Accenture and Faculty cover red-teaming and alignment assessments, with early talks including Hugging Face
  • The announcement post drew about 537K views and 3.8K likes within roughly three days
Read full story

ZJU's InfiniSplat v2 Cuts Feed-Forward 3DGS Perceptual Error by 32.9% (118 HF Upvotes), While Technion's H-DDCM Enables Single-GPU Streaming Generative Video Compression

Two new 3D vision and generative compression frameworks solve long-standing efficiency and quality bottlenecks: Zhejiang University's InfiniSplat v2 (arXiv:2610.20341, 118 upvotes on HF) decouples geometry and Gaussian attribute prediction with a frozen geometry branch and large-angle supervision, slashing mean LPIPS by 25.8% and DISTS by 32.9% across six 3D datasets. Meanwhile, Technion's H-DDCM (arXiv:2610.18125) replaces dense Gaussian codebooks in training-free diffusion compression with implicit Walsh-Hadamard dictionaries—requiring O(d log d) compute and O(d) memory—to enable near-real-time streaming video compression on a single GPU.

ZJU's InfiniSplat v2 Cuts Feed-Forward 3DGS Perceptual Error by 32.9% (118 HF Upvotes), While Technion's H-DDCM Enables Single-GPU Streaming Generative Video Compression

Key Takeaways

  • Zhejiang University's InfiniSplat v2 (118 HF upvotes) freezes the geometry branch and applies large-angle supervision to cut pose-conditioned mean LPIPS by 25.8% (0.2472) and DISTS by 32.9% (0.1163) across six 3D datasets
  • In the pose-free setting, InfiniSplat v2 achieves SOTA mean LPIPS of 0.3026 and DISTS of 0.1341, outperforming WorldMirror 2.0 (0.3757 / 0.1935) and AnySplat
  • Technion's H-DDCM replaces dense Gaussian codebooks with implicit Walsh-Hadamard dictionaries (O(d log d) compute, O(d) memory) and periodic KV-cache prefix re-encoding for single-GPU streaming video compression
Read full story
Linked Models & Agents:

Anthropic publishes internal employment report: junior share of technical hires fell from 27% to 9% as agent hours reached 6x employee hours by August

On Oct 16 Anthropic economists published "How employment is changing at Anthropic," drawing on internal HR, agent telemetry, commits, calendars and hiring records. The junior share of technical hires fell from 27% to 9%; by August employee-directed interactive agent hours were 6x employee hours; commits per engineer are 5x their pace six months ago; and Claude sessions spend about 80% of their time waiting on humans, making human attention the bottleneck.

Anthropic publishes internal employment report: junior share of technical hires fell from 27% to 9% as agent hours reached 6x employee hours by August

Key Takeaways

  • Junior share of technical hires fell from 27% to 9%; junior share of technical headcount fell from 21% to 14% since early 2025 (Anthropic data)
  • Total agent hours passed human hours in March 2026; by August employee-directed interactive agent hours alone were 6x employee hours
  • Commits per engineer are 5x their pace six months ago; comparing 192 adopters with 74 non-adopters, agent-written code showed no difference in later deletion or revert rates
  • Interactive Claude sessions spend about 80% of their time waiting for humans; meta-work rose from 10% to 22% of sessions
  • Staff expect AI to do 75% of their work by 2030 vs 28% for other Americans; Anthropic responds with an early-warning system and internal redeployment
Read full story
Linked Models & Agents:

Tencent Hunyuan open-sources Hy Memory 2.0: ~3B-active memory writer averages 55.49 across four harnesses (vendor-reported, edging Opus 5), plus MemHub local memory for Claude Code, Cursor and Codex

On Oct 16 Tencent Hunyuan open-sourced Hy Memory 2.0 in three layers: the Apache-2.0 memory-writer model Hy-Memory-30B-A3B (~3B active, HF weights plus arXiv report), a Python SDK covering Chat, Working and Coding scenes (PyPI hy-memory 2.0.x), and local-first MemHub (CLI + macOS, preview). Per Tencent, swapping it in as the writer across Mem0, MemOS, Hy-Memory and held-out EverMemOS yields a 55.49 average vs 54.62 for Claude Opus 5, measured on fixed 20% subsamples; it still trails Opus 5 on several individual metrics.

Tencent Hunyuan open-sources Hy Memory 2.0: ~3B-active memory writer averages 55.49 across four harnesses (vendor-reported, edging Opus 5), plus MemHub local memory for Claude Code, Cursor and Codex

Key Takeaways

  • Vendor-reported: 55.49 four-harness average vs 54.62 for Claude Opus 5 and 53.64 for DeepSeek V4.1 Flash
  • Held-out EverMemOS: 56.89 vs Opus 5 at 54.04; still trails on Mem0 LoCoMo (59.54 vs 69.47)
  • ~3B active, Apache-2.0, tested on vLLM v0.31.0 with an OpenAI-compatible API
  • SDK installs via pip install hy-memory with automatic Chat/Working/Coding routing
  • MemHub runs on Linux and macOS (preview); Windows unsupported
Read full story