Tooling4d ago
X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%
Katelyn Lesse, Anthropic's head of platform engineering, said on the Latent Space podcast (published Oct 27) that a Rust version of the Messages API fully rolled out the previous week. The old system was a CPU-hungry Python monolith, the team started with "not a single Rust developer", humans designed and verified the system, Claude wrote the implementation, and shadow traffic compared outputs between the old and new versions. Her ballpark figures are roughly 40-50% less CPU and 10-20% better time to first token. A clip posted by Somi (@somi_ai) drew 1,000+ likes and about 140K views on X and was quoted by swyx and others, with the debate centered on whether "never do the big rewrite" is now outdated advice. These are X discussion views and spoken estimates; Anthropic has not published a written engineering report.
Research21d ago
Anthropic details Claude anti-distillation stack: two-stage classifiers and preserved thinking cut harvested reasoning tokens ~10–100×
On 2026-10-12 Anthropic published a research post claiming substantially stronger defenses against illicit distillation of Claude: early evidence of ~90–99% less data harvested by distillers, and ~10–100× fewer reasoning tokens extractable on-platform after new safeguards. Methods include preserved thinking (harder context rewriting for newer API accounts), org-scoped reasoning transcripts, a two-stage classifier against chain-of-thought extraction (<0.1% claimed false-positive rate), bans/limits, and resumed charging for blocked low-FPR requests. The post cites cyber-capability distillation into models such as GLM-5.3 and urges other frontier labs and platforms to share the load.
Release4d ago
Pika releases open-weight video model Pika H3 Flex: post-trained on MiniMax H3, six-step sampling, five audio stems, API from $0.01 per second
On October 29 Pika released Pika H3 Flex, a joint audio-video generator post-trained on MiniMax H3, with weights on Hugging Face, code on GitHub, and ComfyUI and Diffusers support. Pika says it distilled sampling from 50 denoising steps to six, averages about 1.8x faster DiT denoising than Fal H3 Max at 768p, and can produce a 15-second clip with soundtrack in as little as about 7 seconds; the hosted API adds 1080p to 4K upscaling and five exportable audio stems (dialogue, score, SFX, foley, ambience). All speed and quality figures are vendor-reported.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.