AI Coding Live News

OpenAI Agents API ships Auto Review, async compaction, experimental time awareness and mid-session tool updates

The OpenAI Developers account shared a post by Steve (@stevendcoffey), who works on the API at OpenAI, listing five Agents API updates this week: Codex-style Auto Review of commands before execution, compaction that runs in the background, an experimental time-awareness feature, updating a session's tools at any time, and automatic caching of system prompts across all sessions. As of writing, the official API changelog does not list these items yet.

Key Takeaways

  • Five updates: Auto Review, async compaction, time awareness (experimental), updating session tools at any time, and automatic cross-session system prompt caching
  • Auto Review mirrors the Codex mechanism and evaluates commands for potential bad behavior before they run
  • Time awareness lets the model act on time-boxed instructions such as "timebox CI fixes to 10 minutes"
  • The Agents API entered public beta on September 10, and this is another round of features within 7 weeks (after computer use on Sep 29, sandbox prewarming on Oct 9 and Ultrafast mode on Oct 16)
  • OpenAI has published no latency or cost-saving numbers, and the changelog has not listed these items yet
Read full story
A
Anthropic@AICoder·
👀98
🔥80

Claude Code 2.1.314 adds a block on writes outside working directories, IdP group routing for the apps gateway, and idle compaction in VS Code and Desktop

Anthropic published Claude Code v2.1.314 on GitHub at 01:06 UTC on Oct 30. The official CHANGELOG lists 119 entries, more than half of them fixes. The new features lean enterprise: permissions.blockWritesOutsideWorkingDirectories makes Write, Edit and NotebookEdit refuse paths outside the working directories in every permission mode; Claude apps gateway upstreams can be limited to IdP groups, and Bedrock upstreams can log which guardrail fired; idle compaction now also runs in VS Code and the Code tab of Claude Desktop. It also fixes sessions failing repeatedly when an admin caps effort, and claude -p exiting 0 with no output when startup failed.

Key Takeaways

  • Size: the official v2.1.314 CHANGELOG has 119 entries, more than half of them fixes; released at 01:06 UTC on Oct 30
  • Safety: the new permissions.blockWritesOutsideWorkingDirectories setting stops Write, Edit and NotebookEdit from writing outside the working directories in every permission mode
  • Enterprise gateway: upstreams take an optional groups list so only developers in those IdP groups are routed there, failover included; Bedrock upstreams gain guardrail_trace
  • Experience: idle compaction now runs in VS Code and the Claude Desktop Code tab, summarizing idle conversations above 200K tokens
  • Fixes: when an admin caps effort, Claude Code lowers it and retries; a failed claude -p startup now prints the error and exits 1
Read full story
Linked Models & Agents:

Mosaic: Multi-Session Agentic Reinforcement Learning for Context Compaction and Subagent Forking

Standard agentic reinforcement learning assumes single-session trajectories with continuously accumulated context, clashing with production agent techniques like context compaction and subagent forking. Researchers introduce Mosaic (arXiv:2610.22174), a critic-free hierarchical optimization framework for Multi-Session Agentic RL. By incorporating session-usage signals at the trajectory level and shaping per-session advantages by marginal contribution, Mosaic outperforms trajectory-level broadcasting on BrowseComp across both compaction and subagent scenarios while using fewer sessions.

Mosaic: Multi-Session Agentic Reinforcement Learning for Context Compaction and Subagent Forking

Key Takeaways

  • Bridges single-session RL and multi-session inference: formalizes Multi-Session Agentic RL for context compaction and subagent forking workflows
  • Critic-free hierarchical advantage shaping: combines trajectory-level session-usage signals with session-level marginal contribution estimation
  • Higher accuracy with fewer sessions: outperforms trajectory-level broadcasting on BrowseComp across both compaction and subagent scenarios
Read full story

Claude Code 2.1.299 adds idle compaction for 200K+ token sessions before cache expiry and fixes sandboxed writes into --plugin-dir

Anthropic released Claude Code 2.1.299 on Oct 14. A new default compacts a 200K+ token terminal conversation after about 54 idle minutes, before its one-hour prompt cache expires, so the next message doesn't reprocess everything; tune it with CLAUDE_CODE_IDLE_COMPACT_MIN_TOKENS or turn it off with "idleCompaction": false. The release also fixes sandboxed shell commands being able to write into a --plugin-dir folder whose code Claude Code reloads outside the sandbox, and adds --disallow-tools to claude plugin eval.

Claude Code 2.1.299 adds idle compaction for 200K+ token sessions before cache expiry and fixes sandboxed writes into --plugin-dir

Key Takeaways

  • Idle compaction: triggers at 200K+ tokens after ~54 idle minutes, before the one-hour prompt cache expires
  • Configurable: CLAUDE_CODE_IDLE_COMPACT_MIN_TOKENS changes the 200K floor; "idleCompaction": false in settings.json disables it
  • Security fix: sandboxed commands could write into a --plugin-dir folder whose code is reloaded and run outside the sandbox
  • Custom ANTHROPIC_BASE_URL streams now wait 300 s instead of 180 s with no data; gateway-specific model names no longer fail compaction near 200K tokens
  • claude plugin eval gains --disallow-tools and a disallowed_tools case field to keep built-ins such as Agent out of eval runs
Read full story
Linked Models & Agents:
ADSponsored

Codex Day 7: GPT-6.1 Sol default context rises from 272K to 500K, no long-context fees on subscription usage

OpenAI's Codex lead Tibo says GPT-6.1 Sol's default context in Codex and ChatGPT Work goes from 272K to 500K (~80% more) to cut compactions on long tasks, with no long-context fees when usage comes from a ChatGPT subscription. Separately, the official Codex changelog says GPT-5.5 retires from ChatGPT and Codex on all plans on October 14 (the API keeps it).

Key Takeaways

  • Default context 272K → 500K (~+80%) for GPT-6.1 Sol in Codex and ChatGPT Work; OpenAI says it will go higher later
  • No long-context fees on subscription usage; on the API, prompts over 272K input tokens bill at 2x input and 1.5x output
  • API GPT-6.1 Sol: 1,050,000-token context window, 128,000 max output, $2 / $10 per 1M tokens standard
  • Override with model_context_window and model_auto_compact_token_limit in ~/.codex/config.toml
  • GPT-5.5 retires from ChatGPT and Codex on all plans on Oct 14; the API keeps it
Read full story

REMORY: HKUST and Alibaba Introduce Residual Memory for Agent Context Compaction, Matching Full Context with Only 5.2% Token Overhead

As autonomous agents execute complex multi-step workflows across terminal consoles and web browsers, context window expansion and escalating token costs impose severe operational bottlenecks. Conventional compaction methods rely on text summarization or token pruning, both of which discard crucial state variables and induce semantic drift over extended sessions. Researchers from HKUST and Alibaba present REMORY (arXiv:2610.11287), introducing a residual memory paradigm designed for sequence-level context compaction. REMORY combines lossy natural language summaries with bounded sets of learned soft memory tokens, effectively forming a residual connection in the sequence dimension. While text summaries convey high-level narrative continuity, the soft memory tokens reconstruct lost fine-grained execution artifacts, API arguments, and intermediate environment states. On challenging benchmarks including BrowseComp and Terminal-Bench 2.1, REMORY retains 97% of full-context task performance while occupying only 5.2% of the original input token footprint, slashing redundant tool retries and loops by more than 40%.

Key Takeaways

  • HKUST and Alibaba propose REMORY, establishing sequence-dimension residual memory connections to resolve agent context bloat
  • Matches 97.2% of full-context capability using only 5.2% of token positions, slashing repetitive tool errors by 41.5% on Terminal-Bench
  • Non-invasive plug-and-play architecture reduces TTFT latency by 73.8%, setting a new benchmark for long-horizon agent efficiency
Read full story
Linked Models & Agents:

Anthropic launches Claude Haiku 5.5: $0.10/M input, 72.4% on OSWorld 2.1, about 75% cheaper than Haiku 4.5 on average

On Oct 7 Anthropic shipped Claude Haiku 5.5 (claude-haiku-5-5), completing the Claude 5.5 family. It targets high-volume, cost-sensitive work such as summaries, compaction, classification and coding subagents, and Anthropic calls it its fastest model at standard speed. Prompts up to 100K cost $0.10 input / $0.50 output per million tokens, and it is the first Haiku with effort levels. It scores 72.4% on the OSWorld 2.1 offline subset (Haiku 4.5: 15.7%) and 39.2% on Terminal-Bench 4.0. Sonnet 5.5 cache reads were cut 50% the same day, and Max/Team plans get monthly API credits.

Anthropic launches Claude Haiku 5.5: $0.10/M input, 72.4% on OSWorld 2.1, about 75% cheaper than Haiku 4.5 on average

Key Takeaways

  • Pricing: prompts up to 100K cost $0.10 input / $0.50 output / $0.01 cache reads per million tokens ($0.50 / $2.50 above 100K) vs $1 / $5 for Haiku 4.5; Anthropic says about 75% cheaper on average (announcement)
  • OSWorld 2.1 offline subset: 72.4% vs 15.7% (Haiku 4.5), 48.9% (GPT-6 Luna), 83.9% (Sonnet 5.5)
  • Terminal-Bench 4.0: 39.2% (Haiku 4.5 0.0%, GPT-6 Luna 16.4%); FrontierCode 1.1 Main: 46.4% (Sonnet 5.5 xhigh 52.1%)
  • First Haiku with low/medium/high/xhigh/max effort; Claude Code v2.1.293 makes it the default Haiku on the API with 1M context (release notes)
  • Same day: Sonnet 5.5 cache reads cut from $0.20 to $0.10/M; Max 5x / 20x get $100 / $200 monthly API credits, Team $20 (Standard) / $100 (Premium) per seat pooled up to $500; not valid for interactive Claude Code, no rollover
Read full story

Anthropic Python SDK 1.8.0: Claude Opus 5.5, inline tool definitions, MCP tool-list pinning (beta)

Anthropic shipped the official Python SDK v1.8.0 on 2026-09-22 (PyPI anthropic 1.8.0). Versus 1.7.0 it adds claude-opus-5-5, inline tool definitions, and MCP tool-list pinning (beta) into client types/runners; fixes a shared evaluated_permission enum across Managed Agents events, a Python 3.13 crash when a stream is left open at exit, immediate add_tools() effect, and stripping reply-only params from the tool runner compaction request. For stacks already on Opus 5.5 and MCP-managed tools, this is the typed client surface that matches the server features.

Anthropic Python SDK 1.8.0: Claude Opus 5.5, inline tool definitions, MCP tool-list pinning (beta)

Key Takeaways

  • Shipped: v1.8.0 / PyPI anthropic 1.8.0
  • Model id: claude-opus-5-5 on the typed client surface
  • Tools/MCP: inline tool definitions + MCP tool-list pinning (beta)
  • Stability: add_tools() applies immediately; Py3.13 open-stream exit fix; compaction omits reply-only params
  • Install: pip install anthropic==1.8.0; see Client SDKs docs
Read full story

LiteLLM 1.102.1: Claude Code safeguards on stable + TypeSafe Jev router/guardrails backported

BerriAI shipped LiteLLM v1.102.1 on 2026-09-23 (PyPI litellm 1.102.1). Versus 1.102.0 it backports Anthropic/Bedrock/Vertex safeguards→safeguard_results passthrough so Claude Code Auto mode through a LiteLLM gateway can show Auto mode server: Enabled, and cherry-picks seven TypeSafe Jev changes (passthrough, complexity router, relevance compaction guardrail, auto-router classifier, OpenRouter jev-1.13 pricing, etc.) from the 1.103 RC onto stable/1.102.x. Docker images keep cosign verify instructions.

LiteLLM 1.102.1: Claude Code safeguards on stable + TypeSafe Jev router/guardrails backported

Key Takeaways

  • Shipped: v1.102.1 / PyPI 1.102.1
  • Claude Code: gateway forwards safeguards and returns safeguard_results (#42538) so Auto mode server can stay Enabled
  • TypeSafe Jev: seven PRs backported to stable/1.102.x (#42595)
  • Deploy: pip install litellm==1.102.1; cosign-verify ghcr.io/berriai/litellm:v1.102.1
  • Docs: Proxy Quick Start + Anthropic provider pages
Read full story
Linked Models & Agents:
⚡ Claude⚡ TypeSafe Jev⚡ jev-1.13🤖 Claude Code🌐 berriai🌐 Anthropic🌐 openrouter

Haystack 3.2.0: SummarizationCompactor for long Agent context, TokenBudgetHook and stop_run clean exits

Haystack v3.2.0 (2026-09-24, PyPI haystack-ai 3.2.0) adds experimental SummarizationCompactor for CompactionHook (four-tier progressive summarization toward a token budget; sample context_window=400_000, compact_at=0.7, compact_to=0.4), TokenBudgetHook with exit_reason=token_budget_exceeded, a general stop_run control flag, and fluent Pipeline.add_components/connect_many. Includes security hardening and breaking serialization/toolset changes.

Haystack 3.2.0: SummarizationCompactor for long Agent context, TokenBudgetHook and stop_run clean exits

Key Takeaways

  • Shipped: GitHub v3.2.0 = PyPI haystack-ai 3.2.0
  • Context: experimental SummarizationCompactor + CompactionHook; four-tier progressive summaries; sample 400k window, compact_at 0.7 → compact_to 0.4
  • Budget: TokenBudgetHook (e.g. max_total_tokens=100_000) exits with token_budget_exceeded
  • Control: any hook can set stop_run for a custom clean exit_reason
  • DX/security: fluent add_components/connect_many; Jinja custom_filters require unsafe=True on load; Toolset + operator removed
Read full story
Linked Models & Agents:
ADSponsored

TypeSafe co-founder shares coding-agent design notes: routing, compaction, subagents, skills, and MCP

@CompleteSkeptic (Diogo Almeida, TypeSafe; RLHF background) published public design notes on TypeSafe × coding agents (Google Doc), covering routing, context compaction, subagents, skills, and MCP tradeoffs, and invited the community to experiment. The post drew ~930 likes / ~56k views the same day.

Key Takeaways

  • Public Google Doc on coding-agent routing, compaction, subagents, skills, and MCP.
  • Authored by a TypeSafe principal; explicitly invites community experimentation.
  • Same-day high engagement (~930 likes / ~56k views) as a design reference.
Read full story
Linked Models & Agents:

fast-jev-compaction swaps Claude Code summarization for Jev decision-based compaction

@aiRobertDaily highlighted fast-jev-compaction, a Claude Code plugin that replaces traditional LLM summarization with Jev-driven, decision-based context compaction. It quickly filters tool calls and results, drops or truncates stale content, and keeps only the necessary parts of valuable text; a related Codex-facing Jev context server was also noted. The aim is lower token cost and faster delivery.

Key Takeaways

  • A Claude Code plugin replaces classic summarization with Jev decision-based compaction.
  • Filters tool-call results, drops or truncates stale context, and keeps necessary signal.
  • Targets lower token cost and faster delivery; a Codex-facing Jev path is also noted.
Read full story
Linked Models & Agents:

LM Studio: Bionic agent gains session introspection and @ mentions across sessions

LM Studio (@lmstudio) introduced Introspection and Session References for its Bionic agent: the agent can search its own session history to stay useful after many compactions, and the composer lets you @-mention other sessions to continue work across chats.

Key Takeaways

  • Bionic agent can search its own session history after many compactions.
  • Composer @-mentions let you reference other sessions directly.
  • A local LM Studio agent-workflow upgrade, not a new model drop.
Read full story

Grok Build v1.0.33: Structured MCP JSON, /memory Deletes, Long-Session Checkpoints Kept

Grok Build shipped v1.0.33 with stronger MCP, memory, and long-session reliability: MCP tool results can include structured JSON, cancel/timeout notifies the server to stop work, /memory supports two-press delete for real notes, and compaction checkpoints survive the 30-day cleanup so long agent workflows keep context. Elon Musk amplified the update.

Key Takeaways

  • MCP tool results can include structured JSON; cancel/timeout notifies the server to stop background work
  • /memory modal supports two-press x to delete real notes (not generated indexes), with clearer disabled/empty states
  • Long-session compaction checkpoints and prompt offloads survive the 30-day cleanup; also fixes macOS image paste, Windows clone, /rewind, and minimal-mode session bugs
Read full story
Linked Models & Agents:

Sourcegraph Cody introduces semantic context compaction preserving AST call chains across 200k token windows

Sourcegraph introduced a semantic context compaction engine for Cody. Designed for deep call-stack comprehension, the algorithm prunes boilerplate while strictly retaining function signatures, type contracts, and critical execution paths. This compresses token usage by 60% and increases multi-package code synthesis accuracy by 34%.

Key Takeaways

  • Prunes boilerplate while strictly preserving type contracts and critical AST paths.
  • Improves cross-package code completion and refactoring accuracy by 34%.
  • Rolled out across Cody VS Code, JetBrains IDE plugins, and Sourcegraph Enterprise.
Read full story