AI Coding Live News — Real-Time 𝕏/Twitter Updates & Breakthroughs

Fireworks@FireworksAI_HQ·Collected 12h ago

👀9

🔥82

Fireworks Forge Launches: Ultra-fast Inference Preview Hits 1,500 Tokens/s, Half-Price Background Mode, Nexus Desktop for Codex and Claude Desktop, Sovereign Private Preview

At its first Forge conference on November 3, open-model inference platform Fireworks launched a batch of products. Ultra-fast, powered by NVIDIA Blackwell, is in public preview at up to 1,500 tokens per second on DeepSeek V4.1 Flash, cutting a 30-turn agent task from 1 minute to 8 seconds. Background Mode runs deferrable work at half price, alongside multi-day prompt caching and higher rate limits. Nexus Desktop brings open-model routing into the Codex app, Claude Desktop and OpenCode, with Pro plans from $8 per month. Fireworks also announced No Eval, serverless LoRA inference, the Fireworks Sovereign private preview and a 60+ partner Frontier Ecosystem.

Key Takeaways

Ultra-fast public preview: on NVIDIA Blackwell, up to 1,500 tokens per second on DeepSeek V4.1 Flash; in Fireworks' benchmark a 30-turn agent task fell from 1 minute to 8 seconds (Fireworks blog)
Cost options: Background Mode runs deferrable work at half price; multi-day prompt caching cuts the cost of resuming long context; higher serverless rate limits and Elastic Burst are generally available
Nexus Desktop launches: personalized routing across open and closed models inside the Codex app, Claude Desktop and OpenCode; Pro from $8 per month, Teams from $10 per seat per month
Training: No Eval (private preview) turns production traces into task evals; serverless LoRA inference (public preview) starts with GLM 5.3 Flash at per-token pricing with no idle charge; free training on Muse Glimmer 30B through November 30
Enterprise: Fireworks Sovereign (private preview) runs the inference engine in a customer's own cloud or data center; Fireworks says it already manages over 25,000 GPUs in customer environments; plus a 60+ partner Frontier Ecosystem

Read full story

Linked Models & Agents:

⚡ DeepSeek-V4.1-Flash ⚡ GLM-5.3-Flash⚡ Muse Glimmer 30B⚡ Ember-1🤖 Codex 🤖 Claude Desktop 🤖 OpenCode 🌐 Fireworks 🌐 NVIDIA

#Fireworks#Forge#Inference#Ultra-fast#Background Mode#prompt caching#Nexus#Sovereign#open models#LoRA

ClaudeDevs@ClaudeDevs·Collected 1d ago

👀27

🔥86

View on 𝕏 ↗

Anthropic Launches Message Threads in Public Beta on the Messages API: Server-Side Conversations Cut Claude Code TTFT About 35% on 500K-1M Token Requests

On November 2 (US time) Anthropic put message threads into public beta on the Messages API (beta header message-threads-2026-08-12). The API keeps the conversation on the server: the first request sends the full conversation and creates a thread, and each later request sends only new messages plus the previous response id. Anthropic says threads are on by default for most Claude Code users, cutting median time to first token by about 35% on 500K-1M token requests, while the median long-conversation request shrank from about 800 KB to 1.8 KB. Threads expire after 5 idle minutes; pricing and rate limits are unchanged.

Key Takeaways

Per Anthropic, median time to first token on 500K-1M token Claude Code requests is about 35% lower.
The median long-conversation request fell from about 800 KB to about 1.8 KB, since each turn uploads only new messages plus previous_message_id.
A thread expires 5 minutes after its last request and is deleted within 1 hour; an expired thread returns 404 thread_not_found and must be replayed in full.
Pricing and rate limits are unchanged; Message Batches, token counting and on-demand compaction are unsupported, and threads are not ZDR or HIPAA eligible.
Available on the Claude API, Claude Platform on AWS, Google Cloud (Anthropic managed) and Microsoft Foundry, with a thread helper in the SDKs.

Read full story

Linked Models & Agents:

🤖 Claude Code 🌐 Anthropic

#Anthropic#Claude API#Messages API#message threads#Claude Code#Latency#Agents

Kimi.ai@Kimi_Moonshot·Collected 10d ago

👀172

🔥82

View on 𝕏 ↗

Kimi apologizes for K3.1 Pro plan rate limits and wasted quota, gives every subscriber a one-time 25% monthly quota reset and trims subagent calls and output length

At 20:14 UTC on 2026-10-25, Moonshot AI's official account @Kimi_Moonshot (post) acknowledged rate limits and unnecessary quota consumption on the K3.1 Pro subscription plan, saying "these were our issues, and we should have fixed them sooner." Every subscriber on every plan gets a one-time usage reset that restores 25% of their monthly quota (usage below 25% resets to zero), equal to about one week of usage; usage bars update by end of day PST. Kimi also adjusted the plan's parameters and is cutting unnecessary subagent calls and output length so quota lasts longer.

Key Takeaways

Compensation: a one-time 25% monthly quota restore, about 1 week of usage (official post)
Users below 25% usage are reset to zero; applies to every subscription plan
Timing: usage bars update by end of day PST on Oct 25 (about 15:00 SGT on Oct 26)
Fix direction: fewer unnecessary subagent calls, shorter outputs and adjusted plan parameters
Context: K3.1 Pro launched Oct 23 with API pricing of $2/$10 per million tokens (vendor figures)

Read full story

Linked Models & Agents:

⚡ Kimi K3.1 Pro 🤖 Kimi Code 🌐 Moonshot AI

#Kimi#K3.1 Pro#Kimi Code#Quota#rate limits#Subscription

ClaudeDevs@ClaudeDevs·Collected 19d ago

👀94

🔥91

View on 𝕏 ↗

Claude Opus 5.5 fast mode leaves research preview and drops the waitlist: same model, up to 2.5x output speed at $8/$40 per MTok

On 2026-10-15 Anthropic moved Claude Opus 5.5 fast mode out of research preview and removed the waitlist: no access request and no fast-mode-2026-02-01 beta header needed, just speed: "fast". Same weights, up to 2.5x output tokens/sec per Anthropic, at 2x standard price ($8/$40 per MTok). Start/Build/Scale tiers get a default fast rate limit; it is live on Microsoft Foundry (Azure-hosted) with Google Cloud coming soon. Opus 5 and Opus 4.8 fast mode remain in research preview.

Key Takeaways

Pricing: Opus 5.5 fast is $8/$40 per MTok, 2x the $4/$20 standard; Opus 5/4.8 fast stay in preview at $10/$50 (docs)
Speed: up to 2.5x output tokens/sec per Anthropic; gains are OTPS, not TTFT; same weights
Access: no request and no beta header; default dedicated fast limits on Start/Build/Scale tiers (release notes)
Platforms: Claude API (incl. Managed Agents) and Microsoft Foundry Azure-hosted; Google Cloud coming soon; not on Batch API, Priority Tier, or Claude Platform on AWS
Gotchas: switching speeds invalidates the prompt cache; 429 on limit; check usage.speed

Read full story

Linked Models & Agents:

⚡ Claude Opus 5.5 ⚡ Claude Opus 5 ⚡ Claude Opus 4.8 🤖 Claude Managed Agents 🌐 Anthropic 🌐 Microsoft

#Anthropic#Claude Opus 5.5#fast mode#API#Pricing#Microsoft Foundry

Factory@FactoryAI·Collected 41d ago

👀76

🔥86

View on 𝕏 ↗

Factory launches Teams self-serve: $60/mo per team + $40/mo per seat (up to 10), centralized billing for Droids

On 2026-09-23 Factory announced Teams: multi-user self-serve with centralized billing so Droids take bugfixes/tests/migrations. Price: $60/mo per team + $40/mo per seat, max 10 seats, each user keeping Pro rate limits. Teams page offers a selective $500 voucher.

Key Takeaways

$60/mo team + $40/mo seat, max 10 (Pricing)
Per-user Pro rate limits preserved
Delegate fixes/tests/migrations to Droids (Teams)
Selective $500 voucher via Teams application
Keep Private/VPC for air-gap/compliance needs

Read full story

Linked Models & Agents:

🤖 Factory Droid 🌐 Factory

#Factory#Teams#Pricing#Droid

CISA@CISAgov·Collected 46d ago

👀88

🔥93

NSA, CISA, and FBI Issue Joint Security Advisory on Industrial-Scale AI Model Distillation

In response to campaigns aimed at extracting proprietary capabilities from frontier models, the NSA, CISA, and FBI published a joint cybersecurity advisory. It mandates real-time semantic fingerprint watermarking, synthetic prompt topology filtering, and anti-distillation rate limiting on enterprise API gateways.

Key Takeaways

First multi-agency advisory addressing industrial-scale capability theft via API distillation
Recommends dynamic imperceptible watermarking and query entropy anomaly detection
Elevates model weight protection and synthetic data exfiltration to national cybersecurity priority

Read full story

Linked Models & Agents:

🌐 NSA 🌐 CISA 🌐 FBI

#CISA#NSA#AI Security#Knowledge Distillation#Cybersecurity#IP Protection

OpenRouter@openrouterai·Collected 65d ago

👀37

🔥87

OpenRouter introduces Smart Fallbacks for coding models, switching endpoints in milliseconds during rate limits

OpenRouter launched Smart Fallbacks tailored for coding agents. Developers can configure ordered fallback lists (e.g., Claude 3.7 Sonnet → GPT-5.6 Sol → DeepSeek-V3) under a single endpoint. If upstream rate limits or timeouts occur, the router transparently switches providers in under 50ms to keep long-running agent tasks running uninterrupted.

Key Takeaways

Configurable multi-provider fallback chains under a single unified API endpoint.
Transparent 50ms failover during upstream rate limits ensures uninterrupted agent sessions.
Customizable routing rules based on latency, price, and throughput constraints.

Read full story

Linked Models & Agents:

⚡ Claude 3.7 Sonnet (Hybrid Reasoning)⚡ DeepSeek-V3 🌐 openrouter

#Openrouter#Smart fallback#API routing#High availability#Pricing