Tooling4d ago
X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%
Katelyn Lesse, Anthropic's head of platform engineering, said on the Latent Space podcast (published Oct 27) that a Rust version of the Messages API fully rolled out the previous week. The old system was a CPU-hungry Python monolith, the team started with "not a single Rust developer", humans designed and verified the system, Claude wrote the implementation, and shadow traffic compared outputs between the old and new versions. Her ballpark figures are roughly 40-50% less CPU and 10-20% better time to first token. A clip posted by Somi (@somi_ai) drew 1,000+ likes and about 140K views on X and was quoted by swyx and others, with the debate centered on whether "never do the big rewrite" is now outdated advice. These are X discussion views and spoken estimates; Anthropic has not published a written engineering report.
Release64d ago
Together AI and HUMAIN sign 250MW open-source data center deal, $5B+ annualized
Together AI said it signed one of the largest AI infrastructure deals for open source: a 250MW data center with HUMAIN in Saudi Arabia, carrying more than $5 billion in annualized revenue. The company framed the pact as open-source compute catching up with closed models that have long been bankrolled by hyperscalers, and argued power—not chips alone—is the binding constraint. For teams that fine-tune and serve open weights, the deal points to a step-change in dedicated capacity without each lab raising its own multi-billion-dollar balance sheet.
Release21d ago
AMD introduces Helion agentic AI rack blueprint: OCP-based design, up to 32,768 CPU cores for hyperscale, MI350P all-in-one for enterprise, partner configs due November 2026
On 2026-10-12 AMD introduced Helion, an OCP-based open rack blueprint for agentic AI infrastructure building on Helios. Hyperscale CPU-only racks with 6th Gen EPYC can reach up to 32,768 cores for agent execution tied to separate inference; enterprise all-in-one racks combine EPYC, Instinct MI350P and general-purpose compute. Open hardware/software plus an integrated token router for frontier and open-source model calls; AMD plans to contribute the spec to OCP, with partner configurations targeted for November 2026.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.