AI Coding Live News — Real-Time 𝕏/Twitter Updates & Breakthroughs

👀3

🔥86

Anthropic Launches Message Threads in Public Beta on the Messages API: Server-Side Conversations Cut Claude Code TTFT About 35% on 500K-1M Token Requests

On November 2 (US time) Anthropic put message threads into public beta on the Messages API (beta header message-threads-2026-08-12). The API keeps the conversation on the server: the first request sends the full conversation and creates a thread, and each later request sends only new messages plus the previous response id. Anthropic says threads are on by default for most Claude Code users, cutting median time to first token by about 35% on 500K-1M token requests, while the median long-conversation request shrank from about 800 KB to 1.8 KB. Threads expire after 5 idle minutes; pricing and rate limits are unchanged.

Key Takeaways

Per Anthropic, median time to first token on 500K-1M token Claude Code requests is about 35% lower.
The median long-conversation request fell from about 800 KB to about 1.8 KB, since each turn uploads only new messages plus previous_message_id.
A thread expires 5 minutes after its last request and is deleted within 1 hour; an expired thread returns 404 thread_not_found and must be replayed in full.
Pricing and rate limits are unchanged; Message Batches, token counting and on-demand compaction are unsupported, and threads are not ZDR or HIPAA eligible.
Available on the Claude API, Claude Platform on AWS, Google Cloud (Anthropic managed) and Microsoft Foundry, with a thread helper in the SDKs.

Read full story

Linked Models & Agents:

🤖 Claude Code 🌐 Anthropic

#Anthropic#Claude API#Messages API#message threads#Claude Code#Latency#Agents

Somisomi_ai·Collected 3d ago

👀39

🔥82

View on 𝕏 ↗

X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%

Katelyn Lesse, Anthropic's head of platform engineering, said on the Latent Space podcast (published Oct 27) that a Rust version of the Messages API fully rolled out the previous week. The old system was a CPU-hungry Python monolith, the team started with "not a single Rust developer", humans designed and verified the system, Claude wrote the implementation, and shadow traffic compared outputs between the old and new versions. Her ballpark figures are roughly 40-50% less CPU and 10-20% better time to first token. A clip posted by Somi (@somi_ai) drew 1,000+ likes and about 140K views on X and was quoted by swyx and others, with the debate centered on whether "never do the big rewrite" is now outdated advice. These are X discussion views and spoken estimates; Anthropic has not published a written engineering report.

Key Takeaways

The first-hand source is Katelyn Lesse speaking on the Latent Space episode "How Anthropic ships Claude with Claude", in the "56:05 Rebuilding the Messages API in Rust" segment
Lesse said the move was driven by CPU becoming a bottleneck as usage surged; CPU now has to be capacity-planned in advance, and research sandboxes, product sandboxes and CI all draw from the same pool inside Anthropic
The team forked the entire API in Rust in one go, ran shadow traffic to confirm the Python and Rust outputs matched, then turned it on gradually, deliberately adding no new features during the port
Her ballpark is about 40-50% CPU savings and 10-20% better time to first token, with larger gains on longer-running workloads; these are spoken estimates from the podcast, not a formal benchmark
On X, Somi called "never do the big rewrite" dead advice and swyx said Anthropic "vibecoded their entire backend to Rust"; the latter is an exaggeration, since Lesse only discussed the Messages API

Read full story

Linked Models & Agents:

⚡ Claude🤖 Claude 🌐 Anthropic 🌐 Latent Space

#X discussion#Anthropic#Messages API#Rust#code migration#AI coding#Infrastructure

Claude Devs@ClaudeDevs·Collected 19d ago

👀87

🔥88

View on 𝕏 ↗

Claude Platform opens OpenTelemetry tracing beta: Messages API, Managed Agents and SDK spans flow to your own observability stack

On 2026-10-14 Anthropic put OpenTelemetry tracing for Claude Platform into public beta. Admins add a telemetry destination in the Claude Console and the API exports spans for Messages API requests and Managed Agents sessions server-side with no code changes, while the Claude SDKs export client-side spans for requests and tool-runner tools. Spans follow the OpenTelemetry gen_ai conventions and default to metadata (duration, status, token counts, model, tool names), with an optional full-content mode.

Key Takeaways

Two paths: a server-side destination via Console/Admin API (Messages API + Managed Agents, no code changes) or client-side spans from the Claude SDK (overview)
Destinations need OTLP/HTTP with protobuf over HTTPS on port 443; the Admin API uses the anthropic-beta: telemetry-destinations-2026-08-11 header (API guide)
SDK tracing covers Python, TypeScript, Go and Java (anthropic-java 2.72.0+), and runs on Claude API, AWS, Bedrock, Google Cloud and Microsoft Foundry, all in beta (SDK guide)
Metadata-only or full-content modes; ZDR customers can still export full content for Messages API requests (held in memory until delivered); Managed Agents is not ZDR-eligible
Anthropic warns span names and SDK options may change during the beta, so pin SDK versions

Read full story

Linked Models & Agents:

🤖 claude-managed-agents 🤖 claude-agent-sdk 🌐 Anthropic 🌐 datadog 🌐 grafana 🌐 honeycomb 🌐 langfuse

#Anthropic#Claude Platform#OpenTelemetry#Managed Agents#Claude SDK

ClaudeDevs@ClaudeDevs·Collected 61d ago

👀64

🔥94

View on 𝕏 ↗

Anthropic open-sources Claude Commerce Agents blueprint with Claude Code plugin

ClaudeDevs (@ClaudeDevs) is open-sourcing Claude Commerce Agents: a shopping-and-merchant blueprint with reference implementations across retail, travel, telecom, and entertainment. The Apache 2.0 repo github.com/anthropics/commerce-agents includes Messages API, Claude Agent SDK, and Managed Agents runtimes plus a Claude Code plugin to wire it to your catalog; Anthropic labels it a forkable reference, not a supported product with an SLA.

Key Takeaways

Open-source shopping and merchant agent blueprint with retail, travel, telecom, and entertainment references.
Runs on the Messages API, Claude Agent SDK, or Managed Agents, with a Claude Code plugin in-repo.
Labeled a forkable Apache 2.0 reference implementation, not a supported product with an SLA.

Read full story

Linked Models & Agents:

⚡ Claude Sonnet 5 ⚡ Claude Opus 5 🤖 Claude Code (Anthropic)🌐 Anthropic

#Claude Commerce Agents#Anthropic#Claude Code#Agent SDK#open source#shopping agents

Claude Developers@ClaudeDevs·Collected 62d ago

👀55

🔥88

View on 𝕏 ↗

Anthropic tightens Messages API: no pre-thinking edits on new Fable 5.1 accounts

ClaudeDevs said the Messages API will block editing Claude's context before thinking blocks in multi-turn chats, to harden against distillation that extracts chain-of-thought. The change applies first only to new accounts on Fable 5.1 (distillation often spins up many fake accounts), with plans to extend it to all users on future releases while looking for longer-term fixes.

Key Takeaways

The Messages API disallows edits to context before thinking blocks.
It starts on new Fable 5.1 accounts and is planned for all users on later models.
Aimed at distillation attacks that scrape chain-of-thought; integrators should audit multi-turn context edits.

Read full story

Linked Models & Agents:

⚡ Claude 3.7 Sonnet (Hybrid Reasoning)🤖 Claude Code (Anthropic)🌐 Anthropic

#Messages API#Claude Fable 5.1#thinking blocks#Distillation#API#Anthropic