AI Coding Live News

T
Tsinghua University & Z.AI (HarnessPro, arXiv 2610.26770)arxiv.org·
👀11
🔥80

Tsinghua and Z.AI open-source HarnessPro: agents rewrite their own harness, reaching 80.8% on Terminal-Bench 2 at 34% lower cost per task

HarnessPro (arXiv 2610.26770, submitted Oct 19 and revised Oct 20), from Tsinghua University, Z.AI (Zhipu) and collaborators, is a label-free way to improve an agent harness: specialized agents diagnose execution traces, rewrite instructions and runtime policies, score candidates with LLM-generated tests, and keep Lite, Medium and Heavy harnesses along the performance-cost frontier. Per the paper, with GPT-5.5 and Codex the Heavy mode reaches 80.8% on Terminal-Bench 2, 4.5 points above the prior RHO method, while cost per task drops from $1.09 to $0.72. The code is MIT-licensed and drew wider media coverage this week, including from Pandaily.

Tsinghua and Z.AI open-source HarnessPro: agents rewrite their own harness, reaching 80.8% on Terminal-Bench 2 at 34% lower cost per task

Key Takeaways

  • Terminal-Bench 2 (GPT-5.5 with Codex, mean of 3 runs): Heavy reaches 80.8% at $0.72 per task, versus RHO at 76.3% and $1.09, a 33.9% cost cut (paper figures, arXiv)
  • Averaged over three benchmarks: +2.0 points pass rate and -26.1% cost per task versus RHO, across Terminal-Bench 2, SWE-Bench Pro and ProgramBench
  • Holds across models: with GLM-5.2 and Claude Code on Terminal-Bench 2, Heavy hits 81.4% at $0.62, versus vanilla at 74.6% and $0.92 and RHO at 78.0% and $1.00
  • Budget modes: Medium matches RHO at 76.3% on Terminal-Bench 2 for only $0.56 per task; Lite gets 72.9% at $0.43
  • Cheap to train: only 10 training tasks per benchmark and 3 to 4 evolution epochs, tested on 59, 100 and 100 held-out tasks; the three harness tiers are MIT-licensed on GitHub
Read full story

OpenAI rolls out GPT-6 Rosalind Research, a GPT-6 generation life sciences model for approved research orgs in Work, Codex and the API at $15/$75 per million tokens

In its October 30 ChatGPT Business release notes, OpenAI said GPT-6 Rosalind Research is rolling out to a limited set of customers with Research approval. It shows up in the model picker in ChatGPT Work and Codex, not in the Chat tab, and separately approved organizations can call it through the API as gpt-6-rosalind. OpenAI's token-based Enterprise rate card lists it at $15 per million input tokens, $1.50 cached input and $75 output, three times the price of GPT-5.5 Rosalind Research.

Key Takeaways

  • Approved orgs only: both the organization and the user need Rosalind Research approval, and Discovery approval does not include it
  • Where to use it: the model picker in ChatGPT Work and Codex, not the Chat tab; in Codex it pairs with the Life Sciences Research plugin
  • API model name gpt-6-rosalind needs separate approval and is limited to internal research tools, not customer-facing products
  • Priced at $15 input, $1.50 cached input and $75 output per million tokens, versus $5/$0.50/$25 for GPT-5.5 Rosalind Research
  • Enterprise workspaces start with a two-week Admin Preview that is off by default until an admin enables it for approved users
Read full story
Linked Models & Agents:
⚡ GPT-6 Rosalind Research⚡ GPT-5.5 Rosalind Research⚡ GPT-6 Astra🤖 Codex🤖 ChatGPT Work🌐 OpenAI

Cartesia launches Managed Agents voice agent platform: #1 of 30 on Speech Agent Arena, $0.03 per minute at launch

Voice model company Cartesia launched Managed Agents on Oct 29, an end-to-end voice agent platform for enterprise phone calls that tunes its own speech-to-text and text-to-speech models together with the agent harness, and bundles telephony, knowledge bases, tool calls and outbound batches. Cartesia says it ranks #1 on Artificial Analysis's Speech Agent Arena with a 1115 Elo and scores 87.4% accuracy and 90.7% experience on ServiceNow's EVA-Bench (vendor-reported, with GPT-5.5 as the reasoning model). Launch pricing is 50% off at $0.03 per minute.

Cartesia launches Managed Agents voice agent platform: #1 of 30 on Speech Agent Arena, $0.03 per minute at launch

Key Takeaways

  • On Artificial Analysis's Speech Agent Arena blind preference test, Managed Agents ranks #1 of 30 agents with a 1115 Elo, ahead of Gemini 3.1 Flash Live Minimal (1099), Grok Voice 3.0 (1064) and GPT-Live-1 (1041) (Cartesia blog, as cited by the vendor)
  • First-attempt results on ServiceNow EVA-Bench across 200+ customer service, IT service and HR scenarios: 87.4% accuracy and 90.7% experience, versus 73.7%/71.2% for Grok Voice 3.0 and 59.0%/61.6% for GPT Realtime 2.1 (EVA-Bench)
  • All these benchmark runs use GPT-5.5 as the reasoning model; Cartesia's internal evaluation says 85% of calls had no turn-taking issues, versus 67% for other agents
  • Launch pricing is 50% off at $0.03 per minute; Cartesia says the platform has already handled tens of millions of conversations in finance, retail, hospitality and healthcare
  • It supports 44 languages; English, Spanish, Hindi, French and Japanese can switch mid-call today, with the rest coming soon
Read full story

Judge-Free Test-Time Scaling Tops WebArena Infinity at 74.6%: Salesforce Introduces CLIFT, Alongside MMSearch-OPD and SCOPED-8B Beating 32B VLMs

Three new frameworks advance web and multimodal agent post-training: Salesforce AI Research's CLIFT (arXiv:2610.06829) certifies URL-conditional self-verification questions for dense RL rewards and judge-free Conformal Trajectory Selection (CTS), propelling Gemma-4 31B to a 74.6% SOTA on WebArena Infinity (beating Gemini 3 Flash at 70.1%) and lifting GPT-5.5 to 53.7% on VisualWebArena. Meanwhile, MMSearch-OPD (arXiv:2610.22240) boosts 9B multimodal deep search by +15.3 points to 60.2%, and Northeastern University's SCOPED-8B (arXiv:2610.22217) uses skill-decoupled on-policy expert distillation to reach 73.13% across 8 benchmarks—surpassing Qwen3-VL-32B (72.01%) and Claude Opus 4.6 (72.86%).

Judge-Free Test-Time Scaling Tops WebArena Infinity at 74.6%: Salesforce Introduces CLIFT, Alongside MMSearch-OPD and SCOPED-8B Beating 32B VLMs

Key Takeaways

  • Salesforce's CLIFT conformal self-verification propels Gemma-4 31B to 74.6% on WebArena Infinity (+12.8 pts over base, beating Gemini 3 Flash at 70.1%) with judge-free test-time trajectory selection
  • Transferring the open-trained CLIFT question bank to GPT-5.5 sets a 53.7% SOTA on VisualWebArena, while MMSearch-OPD boosts 9B multimodal deep search accuracy by +15.3 points to 60.2%
  • Northeastern University's SCOPED-8B reaches 73.13% average accuracy across 8 VLM benchmarks via skill-decoupled on-policy expert distillation, beating Qwen3-VL-32B (72.01%) and Claude-Opus-4.6 (72.86%)
Read full story
Linked Models & Agents:
ADSponsored

GPT-5.5 retires from ChatGPT, ChatGPT Work and Codex today: ChatGPT sign-in users must move to gpt-6-sol or gpt-6-luna, the API is unaffected

Per OpenAI's model docs, GPT-5.5 retires from ChatGPT, ChatGPT Work and Codex on all plans on 2026-10-14; the OpenAI API is not affected. Codex users on ChatGPT sign-in should pick gpt-6-sol (Plus, Pro, Business, Enterprise, Edu) or gpt-6-luna in the desktop app (Free, Go), with gpt-6.1-sol recommended for complex coding. Any config.toml, custom agent, scheduled task or script pinned to gpt-5.5 needs updating now.

Key Takeaways

  • Effective 2026-10-14: GPT-5.5 leaves ChatGPT, ChatGPT Work and Codex on every plan; the OpenAI API is unaffected
  • Replacements: gpt-6-sol for Plus/Pro/Business/Enterprise/Edu, gpt-6-luna in the desktop app for Free/Go (both 'when available')
  • For complex coding OpenAI recommends gpt-6.1-sol, near-Astra at 1/5 of Astra's standard price per OpenAI
  • Check 4 places: model in config.toml, codex exec -m, custom agents, scheduled tasks and scripts
  • Enterprise/Edu admins must enable newer models first; GPT-5.6 Sol/Terra/Luna remain available during the rollout
Read full story

ChemDiffAgent Debuts: Masked Diffusion Language Agent Breaks Autoregressive Bottlenecks in Chemistry Reasoning

Researchers from the Institute of Computing Technology (CAS ICT) have introduced ChemDiffAgent, the first masked diffusion language agent for tool-integrated chemical reasoning. By replacing standard left-to-right autoregressive generation with iterative trajectory denoising, ChemDiffAgent enables bidirectional molecule comprehension and arbitrary-order tool planning, surpassing conventional models by ~20%.

Key Takeaways

  • Paradigm breakthrough: replaces unilateral causal attention with an iterative denoising process over interleaved reasoning and tool trajectories
  • Two-stage post-training: couples agentic supervised fine-tuning with variance-reduced preference optimization for holistic trajectory valuation
  • 8B model matches frontier LLMs: outperforms autoregressive baselines by ~20% across 6 chemistry tasks, matching or exceeding GPT-5.5 and Claude Opus 4.7
Read full story
Linked Models & Agents:

CONTRA Released: Selective Clarification Framework for Coding Agents Lifts F1 by 13.88% with Open-Source Claude Code Plugin

When software engineers interact with LLM coding agents, natural language requirements are frequently ambiguous, underspecified, or missing critical boundary rules. Existing coding agents face a difficult trade-off: silently hallucinating assumptions to produce syntactically valid but functionally flawed code, or incessantly asking trivial clarifying questions that disrupt developer focus and cause cognitive fatigue. Researchers from Peking University and Wuhan University introduce CONTRA (arXiv:2610.01769, repo: github.com/fangz-cs/Contra), a training-free framework for selective clarification in LLM code generation. CONTRA employs a three-tier pipeline: broad question discovery, semantic- and execution-based question qualification, and history-aware adaptive stopping. By executing candidate code variants in isolated environments conditioned on alternative answers, it verifies whether a question triggers stable, behavior-changing differences before prompting the user. On ClarifyCodeBench, CONTRA achieves macro-average question F1 of 41.20% and TKQR of 38.32%, outperforming leading baselines by 13.88 and 12.33 percentage points respectively. On GPT-5.5, it lifts recall from 15.12% to 36.72% while maintaining high precision. CONTRA is released as an open-source extension for Claude Code.

Key Takeaways

  • CONTRA framework published, leveraging execution-based behavior differential testing to stop agent hallucinations and fatigue
  • Achieves 41.20% macro-average F1 on ClarifyCodeBench, outperforming leading clarification baselines by 13.88 points
  • More than doubles key question recall on GPT-5.5 from 15.12% to 36.72%, with open-source plugin released for Claude Code
Read full story

GitSwarm Unveils Decentralized Compounding Inference: Multi-Agent Collaboration via Git Branching and Atomic Commits

Tackling long-horizon problem solving and scientific discovery requires computation to compound across successive attempts. While humans build upon partial proofs, failed experiments, and prior hypotheses, current test-time compute paradigms (e.g., MCTS and Best-of-N) isolate search trajectories into independent silos, discarding intermediate reasoning artifacts upon branch failure. Researchers introduce compounding inference and its open-source instantiation GitSwarm (arXiv:2610.04862). GitSwarm establishes an asynchronous multi-agent coordination architecture where homogeneous LLM agents collaborate through structured persistent memory hosted in a shared, branchable Git repository. Intermediate artifacts are preserved as atomic commits, while explicit semantic dependencies link cross-branch contributions, enabling agents to inspect, branch, verify, and synthesize past discoveries. Evaluated on rigorous long-horizon benchmarks, GitSwarm paired with GPT-5.5 solves all 30 problems on IMOProofBench-Advanced in a single execution run, and scores 79.4% on ProgramBench compared to 65.1% for the strongest reported baseline under identical budgets.

Key Takeaways

  • Introduces Compounding Inference and GitSwarm, converting transient test-time compute into persistent knowledge assets
  • Employs Git repositories as multi-agent memory, tracking atomic commits, semantic dependencies, and cross-branch merges
  • Solves 100% of IMOProofBench-Advanced problems with GPT-5.5 in a single run and achieves 79.4% on ProgramBench
Read full story
Linked Models & Agents:

Codex Day 7: GPT-6.1 Sol default context rises from 272K to 500K, no long-context fees on subscription usage

OpenAI's Codex lead Tibo says GPT-6.1 Sol's default context in Codex and ChatGPT Work goes from 272K to 500K (~80% more) to cut compactions on long tasks, with no long-context fees when usage comes from a ChatGPT subscription. Separately, the official Codex changelog says GPT-5.5 retires from ChatGPT and Codex on all plans on October 14 (the API keeps it).

Key Takeaways

  • Default context 272K → 500K (~+80%) for GPT-6.1 Sol in Codex and ChatGPT Work; OpenAI says it will go higher later
  • No long-context fees on subscription usage; on the API, prompts over 272K input tokens bill at 2x input and 1.5x output
  • API GPT-6.1 Sol: 1,050,000-token context window, 128,000 max output, $2 / $10 per 1M tokens standard
  • Override with model_context_window and model_auto_compact_token_limit in ~/.codex/config.toml
  • GPT-5.5 retires from ChatGPT and Codex on all plans on Oct 14; the API keeps it
Read full story

OpenAI: GPT-5.5 leaves ChatGPT, Work, and Codex plans on Oct 14; switch to GPT-5.6 Sol or GPT-6 Astra

ChatGPT announced that on October 14, 2026, GPT-5.5 will leave ChatGPT, ChatGPT Work, and Codex across all plans; Codex users should switch to GPT-5.6 Sol or GPT-6 Astra. OpenAI Developers clarified that GPT-5.5 remains available via the OpenAI API Platform and in Codex sessions authenticated with an API key.

Key Takeaways

  • Oct 14: GPT-5.5 exits ChatGPT, ChatGPT Work, and Codex across all plans.
  • Codex plan users should move to GPT-5.6 Sol or GPT-6 Astra.
  • GPT-5.5 stays on the API Platform and in API-key-authenticated Codex sessions.
Read full story
ADSponsored

Fireworks: LangChain fine-tunes Qwen judges at up to 100x lower cost

Fireworks said partner LangChain generates billions of agent-trace tokens a day, making frontier closed judges too costly. Fine-tuning a Qwen base on Fireworks matched GPT-5.5 / Opus-level judging at up to about 100x lower cost, and Fireworks is pushing its Training API for similar workflows.

Key Takeaways

  • LangChain produces billions of agent-trace tokens daily; frontier closed judges are too expensive.
  • Qwen fine-tuned on Fireworks matched GPT-5.5 / Opus-level judging at up to ~100x lower cost.
  • Training API is positioned for builders to train similar low-cost judge/agent models.
Read full story
Linked Models & Agents:

Factory fine-tunes open Qwen on Fireworks, catching ~20% more secrets than GPT-5.5

Fireworks spotlighted Factory's Droid Shield as a Training API customer story. Factory's droids write and commit code faster than human reviewers can keep up, so secret detection has to catch real leaks without flooding the team with false alarms. Using the Fireworks Training API, Factory fine-tuned an open Qwen model that caught almost 20 percent more real secrets than GPT-5.5, at lower cost and latency. The result is a specialized scanner sitting in the commit path rather than a generic frontier chat model asked to grep for keys. For coding-agent vendors, it is a concrete example that a domain-fine-tuned open-weight model can beat a larger closed model on a verifiable production task, then ship at a cost that matches high-frequency agent traffic. It also shows why training and inference on one platform matters: the specialized weights have to stay cheap enough to run on every commit.

Key Takeaways

  • Factory fine-tuned an open Qwen model on Fireworks that caught about 20% more real secrets than GPT-5.5.
  • Droid Shield is built for high-frequency droid commits, prioritizing true positives and low-friction review.
  • A specialized open-weight scanner can beat a general frontier model on a verifiable security task at lower cost.
Read full story

Pinecone Nexus Reaches GA: Enterprise Knowledge Compiled for Agents with 80% Cost Reduction

Pinecone announced the General Availability of Nexus, a compiled knowledge layer for AI agents that demonstrated a 12% accuracy gain and 80% cost reduction on the Sierra τ-Knowledge benchmark with GPT-5.2.

Key Takeaways

  • Redefines RAG as a compiled enterprise knowledge layer rather than ad-hoc runtime retrieval glue;
  • Provides citation-backed structured responses and dedicated query-trace endpoints for granular prompt debugging;
  • Demonstrates that routing high-precision context yields superior ROI compared to upgrading to larger frontier models.
Read full story
Linked Models & Agents:
⚡ OpenAI GPT-5 Codex