News · Leaderboard

Latest news, beside the leaderboard

Read what just changed, and see who is ahead. Those are the two doors on this page.

A
Artificial Analysis@ArtificialAnlys·Just collected
📊 Benchmark

Artificial Analysis Coding Agent Index v2.1 Moves to FrontierCode 2.0 and Terminal-Bench 4.1: Claude Fable 5.2 and Claude Opus 5.5 Tie for First at 58, Scores Drop 5 Points on Average

On November 14 Artificial Analysis released Coding Agent Index v2.1, swapping FrontierCode 1.1 for its implementation of Cognition's FrontierCode 2.0 (132 real-world tasks graded on whether a maintainer would merge the change), upgrading Terminal-Bench from 4.0 to 4.1 and keeping SWE-Atlas-QnA-AA. Claude Fable 5.2 (xhigh and high, in Claude Code) and Claude Opus 5.5 (max) share the lead at 58. Because FrontierCode 2.0 is harder, scores fall 5 points on average; only Codex with GPT-6.1 Terra (max) held within 1 point of its prior score.

Artificial Analysis Coding Agent Index v2.1 Moves to FrontierCode 2.0 and Terminal-Bench 4.1: Claude Fable 5.2 and Claude Opus 5.5 Tie for First at 58, Scores Drop 5 Points on Average
⚡ Key Takeaways
  • •v2.1 is made of FrontierCode-AA 2.0 (132 real-world coding tasks graded on whether a maintainer would merge the change), Terminal-Bench 4.1 (the same 66 tasks with updated verifiers for reliability and resistance to reward hacking) and SWE-Atlas-QnA-AA
  • •Tied for first at 58: Claude Code with Claude Fable 5.2 (58 at both xhigh and high), Claude Code with Claude Opus 5.5 (max), and Devin Fusion CLI (Opus 5.5 max + GPT-6 Luna High); next come Claude Sonnet 5.5 (max) at 56 and Antigravity CLI with Gemini 4 Carbon (high) at 55
  • •All 23 configurations tested on both versions score lower on FrontierCode-AA 2.0 than on v1.1, with the mean falling from 45% to 29%; Claude Code with Fable 5.2 leads at 49%. On Terminal-Bench 4.1 every score moves less than 3 points, and Kimi Code CLI with Kimi K3.1 Pro leads at 68%
  • •Cost varies about 30x: among configurations scoring 48+, Codex with GPT-6.1 Sol (max, 52) costs $1.51 per task and Claude Code with Fable 5.2 (max, 56) costs $44.22; Fable 5.2 costs $2.89, $7.51 and $15.47 at medium, high and xhigh
  • •Claude Code and Devin Fusion CLI fall back to another model after a safety refusal: a fallback model completed about 9% of attempts for Devin Fusion CLI and Opus 5.5 (max), 6% for Fable 5.2 (xhigh) and 5% for Sonnet 5.5
Read details→
A
Artificial Analysis@ArtificialAnlys·Collected 59 min agoFresh · 6h
📊 Benchmark

Artificial Analysis Controlled Voice Arena: Speechify Simba 3.5 Takes #1 at 1192 Elo, Statistically Level With HeyGen Voice at About a Fifth of the Price ($6.58 per 1M Characters)

On November 13 Artificial Analysis said Speechify's Simba 3.5 text to speech model is #1 in its Controlled Voice Arena, statistically level with HeyGen Voice. Every model on this board reads with the same 8 cloned voices (4 US, 4 UK) and users vote blind, so it compares models rather than showcase voices. The leaderboard lists Simba 3.5 at 1192±17 Elo from 1,783 samples, HeyGen Voice at 1190±13 and Qwen-Audio-3.1-TTS-Plus third at 1176; Simba 3.5 costs $6.58 per 1M characters on the API versus $30.00 for HeyGen Voice.

Artificial Analysis Controlled Voice Arena: Speechify Simba 3.5 Takes #1 at 1192 Elo, Statistically Level With HeyGen Voice at About a Fifth of the Price ($6.58 per 1M Characters)
⚡ Key Takeaways
  • •The Controlled Voice Arena has every model use the same 8 cloned voices (4 US, 4 UK) with blind user votes, removing the bias of picking a flattering demo voice
  • •Simba 3.5 scores 1192±17 Elo (95% interval 1175-1209, 1,783 samples) with a rank range of 1-3; HeyGen Voice scores 1190±13 with a range of 1-2, so the two are statistically level
  • •Third to fifth: Qwen-Audio-3.1-TTS-Plus 1176, HeyGen Voice Turbo 1174, Qwen-Audio-3.1-TTS-Flash 1164; Eleven v4 Turbo (1156) and Eleven v4 (1155) are sixth and seventh
  • •Price per 1M characters on each creator's API: Simba 3.5 $6.58, HeyGen Voice $30.00, HeyGen Voice Turbo $4.00, Eleven v4 $80.00
  • •Speechify's previous Simba 3.2 sits at 1082 Elo in 14th on the same board; AA's post also puts Simba 3.5 fifth on the Provider Voice board, which uses each vendor's own voices
Read details→
A
Artificial Analysis@ArtificialAnlys·Collected 2h agoFresh · 6h
📊 Benchmark

Artificial Analysis Launches the Diarization Index for Speech to Text: APIs Scored on Word Diarization Error Rate, NVIDIA Nemotron 3.5 Transcribe Leads at 3.3% Ahead of Voxtral Small Transcribe 3 at 7.5%

On November 13 Artificial Analysis published the Diarization Index, a benchmark for whether speech to text APIs attribute each word to the person who actually said it. It scores Word Diarization Error Rate (WDER), the share of words given to the wrong speaker or to no speaker, across 97 English conversations of two to eight people, averaging three speaker bands (2, 3-4 and 5-8) with equal weight. NVIDIA's open-weight Nemotron 3.5 Transcribe leads at 3.3%, ahead of Voxtral Small Transcribe 3 at 7.5%, the most accurate priced API; MAI-Transcribe-2 scores 8.8% and is one of the fastest.

Artificial Analysis Launches the Diarization Index for Speech to Text: APIs Scored on Word Diarization Error Rate, NVIDIA Nemotron 3.5 Transcribe Leads at 3.3% Ahead of Voxtral Small Transcribe 3 at 7.5%
⚡ Key Takeaways
  • •The new metric is WDER = (wrong-speaker words + missed words) / scored reference words, lower is better; AA says it ranks on WDER instead of DER because for APIs DER mostly scores word timestamps rather than who spoke
  • •The set has 97 conversations of about 2-9 minutes each, about 6.8 hours in total, mixing real and synthetic speech; most audio is proprietary and held out, plus about 126 minutes of public NOTSOFAR-1 meeting recordings
  • •APIs are called directly with diarization switched on and are not told how many people are talking, with each conversation sent whole; price includes any separate diarization charge
  • •Nemotron 3.5 Transcribe goes from 1.7% WDER with two speakers to 5.6% with five to eight; in the largest groups every other API gets more than 10% of words wrong
  • •Voxtral Small Transcribe 3 scores 7.5% at $4.00 per 1,000 minutes; MAI-Transcribe-2 scores 8.8% at $1.67 and transcribes 93.7 seconds of audio per second of waiting; Nemotron 3.5 Transcribe is open-weight and has no listed price
Read details→
F
FBI Cyber Branch@FBICyberBranch·Collected 3h agoFresh · 6h
🛠️ Tooling

FBI issues FLASH alert on ARTEX: open-source LLM agent pentest framework weaponized since August, some intrusions reach privileged access in under 3 hours, 1,600+ exposed consoles, DeepSeek Flash models most used by attackers

On November 13 the FBI Cyber Branch published FLASH-20261113-001 on ARTEX, an open-source, LLM-driven multi-agent penetration testing platform. Since at least August 2026, various threat actors have used it to automate intrusion phases from reconnaissance to data exfiltration against financial, government, technology, defense, semiconductor, energy, healthcare and other sectors, with some intrusions going from targeting to privileged access in under three hours. The original developer pulled the GitHub repo in October, but forks, mirrors and a commercial ARTEX PRO keep it available, and researchers found more than 1,600 internet-exposed ARTEX consoles in early November.

FBI issues FLASH alert on ARTEX: open-source LLM agent pentest framework weaponized since August, some intrusions reach privileged access in under 3 hours, 1,600+ exposed consoles, DeepSeek Flash models most used by attackers
⚡ Key Takeaways
  • •ARTEX is written in Go and turns high-level goals given in natural language into commands run by specialized agents, needing almost no human input after the objective is set; it ships no model of its own and plugs into external LLMs including Claude, GPT, DeepSeek, GLM, Grok and Kimi
  • •The FBI says Chinese models are the most common in attacker-controlled ARTEX instances, with DeepSeek Flash family models dominating thanks to their capability-to-cost balance and no observable guardrails when requests are framed as penetration testing
  • •Known campaigns include attacks on South Korean financial institutions that exfiltrated personal data of about 67,000 people, and a ConnectWise Cloud Backup supply chain compromise that reached more than 2,250 downstream tenants
  • •Developer Autumn-27 released it on GitHub in July; it reached an estimated 1,500 to 2,000 stars in 10 weeks and the repo was pulled on October 8, but the FBI says forks, localized variants, archived copies and a commercial ARTEX PRO keep spreading
  • •FBI advice: inventory every internet-facing app including partner portals, mobile backends and legacy services, keep cloud admin, Kudu/SCM publishing endpoints and backup platforms on trusted networks, and scan repos and CI/CD pipelines for embedded secrets and rotate them
Read details→
ADSponsored
G
Grok Bot@bot·Collected 4h agoFresh · 6h
🛠️ Tooling

Grok Bot 1.0 leaves beta: Bots join Google Meet, Zoom and Microsoft Teams calls, answer in meeting chat and send summaries with action items, on Team, Enterprise and Ultra plans

SpaceXSI released Grok Bot 1.0, and the official @bot account then announced that Bots can now join meetings: paste a Google Meet, Zoom or Microsoft Teams link, approve the card, and the Bot joins as a transcribing participant, takes notes, answers when addressed in the meeting chat, and sends a summary and action items after the call. Meetings are on Team, Enterprise and Ultra plans with an Enterprise admin switch; the same release brings Team Bots into Microsoft Teams and adds shared connectors and review of team learnings.

Grok Bot 1.0 leaves beta: Bots join Google Meet, Zoom and Microsoft Teams calls, answer in meeting chat and send summaries with action items, on Team, Enterprise and Ultra plans
⚡ Key Takeaways
  • •To add it, paste the meeting link into the Bot's chat and ask it to join and take notes, approve the card, and the host admits it; a Bot that follows your calendar can join scheduled meetings on its own
  • •During the call, address the Bot by name in the meeting chat; a Zoom private chat gets a private answer, it never shares your credentials, and if someone asks for something it held back it tells you who asked
  • •Disable Interactivity keeps it listening without answering, and scheduled meetings can be cancelled or the Bot told to quit; afterwards it sends a summary and action items, plus a longer report page for Pages users
  • •Enterprise admins switch Meetings on or off for everyone under Bot Capabilities in the team dashboard; when off, Bots cannot join or read meetings
  • •The same release (changelog v1.0.1, November 11) brings Team Bots into Microsoft Teams, adds shared connectors and makes team learnings wait for owner approval; no transcription accuracy data was published
Read details→
C
ChatGPT@ChatGPT·Collected 5h agoFresh · 6h
🛠️ Tooling

OpenAI launches ChatGPT Wallet: dots agents can pay for you with network tokens instead of real card numbers, every purchase needs a biometric check, US Pro users first

On November 13 OpenAI announced ChatGPT Wallet, built with American Express, Mastercard and Visa, which lets dots agents complete purchases after the user approves them. At payment time the card network issues a token in place of the real card number, so neither the business nor the agent sees it; before each purchase the user reviews the items, total and card and confirms with Face ID or a fingerprint. It is rolling out now in dots to US ChatGPT Pro users aged 18+, alongside a Commerce Partner Playbook for businesses.

OpenAI launches ChatGPT Wallet: dots agents can pay for you with network tokens instead of real card numbers, every purchase needs a biometric check, US Pro users first
⚡ Key Takeaways
  • •Users add a card once; each purchase then shows the items, total and selected card and is approved with a security check such as Face ID or a fingerprint, leaving a record of the authorization
  • •After approval the card network issues a payment token (a substitute card number, security code and expiry); the charge still lands on the chosen card and existing rewards and eligible dispute protections stay
  • •Initial scope: ChatGPT Pro subscribers aged 18+ in the US with eligible US-issued cards, via dots; OpenAI says it will expand based on early use
  • •A Commerce Partner Playbook covers claiming a business in ChatGPT, uploading a product feed, recognizing signed agent requests with Web Bot Auth, and building plugins or WebMCP tools
  • •OpenAI is working with fraud partners Forter, Riskified, Sardine and Signifyd and payment providers Adyen, Checkout.com and Stripe to cut false declines; fully delegated purchases within preset limits are only a future plan
Read details→
L
LMSYS Org@lmsysorg·Collected 6h ago
📊 Benchmark

RadixArk runs agentic RL sandboxes on NVIDIA Vera CPUs: episodes about 12% faster than on AMD Turin under load, and one socket carries 1.3-2.1x the load of current x86

A November 13 LMSYS blog post from the RadixArk Miles team says its open-source RL post-training framework Miles trained GLM-4.7-Flash end to end with every agent sandbox on NVIDIA Vera CPUs. With the machines already busy, episodes took 12% longer on average when sandboxes ran on AMD EPYC Turin, and within a fixed latency bar one Vera socket carried 1.3-1.5x the load of Xeon 6 and 1.4-2.1x that of Turin.

RadixArk runs agentic RL sandboxes on NVIDIA Vera CPUs: episodes about 12% faster than on AMD Turin under load, and one socket carries 1.3-2.1x the load of current x86
⚡ Key Takeaways
  • •Miles ran 68 training steps and more than 2,400 episodes on Vera in both synchronous and fully asynchronous modes with no training-code changes; 530 Terminal-Bench and SWE-bench task environments were rebuilt for arm64
  • •Controlled run (same model, tasks, GPUs; 5 steps and 160 episodes each): with sandboxes on Turin each episode took 53 s longer, including 26 s more for agent commands (60% slower) and 11 s more for the verifier
  • •At full load each Vera core slowed only 5%-22% on Python and compile work versus 40%-70% for Turin; Vera with 176 concurrent episodes still beat Turin running just 24
  • •Projection: with 8x faster inference, Turin episodes would take 33% longer than Vera, and 41% longer at 32x (modeled, not measured)
  • •All figures are self-reported from a RadixArk and NVIDIA collaboration; x86 machines used AWS defaults while Vera used NVIDIA-tuned boot parameters
Read details→
V
Vercelvercel·Collected 6h ago
🛠️ Tooling

Vercel ships Workflow SDK 5: durable engine rewritten for agent loops, up to 25x lower overhead, end-to-end encrypted payloads by default and per-region runs

Vercel released Workflow SDK 5. It says the SDK has run over 4 billion steps and 700 million runs; v5 rewrites the engine to cut queue hops, taking a 1,020-step run from a 21-minute to a 3-minute median. Step payloads are encrypted with AES-256-GCM using a per-run key, Workflow infrastructure now runs in every Vercel Function region, and the same durability layer backs harnesses such as Pi and OpenCode.

Vercel ships Workflow SDK 5: durable engine rewritten for agent loops, up to 25x lower overhead, end-to-end encrypted payloads by default and per-region runs
⚡ Key Takeaways
  • •Vendor benchmark (v5.2.0 vs v4.8.12): first-step p75 418 ms to 172 ms, between-step p75 618 ms to 109 ms, late-run overhead 1,748 ms to 70 ms (25x lower)
  • •Streams now use WebSockets by default: replaying a 52.4-second agent response, median delivery fell from 226.1 s to 53.5 s, and token streams shrink about 80% with compression
  • •End-to-end payload encryption with a per-run key; Vercel stores only ciphertext, decryption happens in the browser or CLI and is audit-logged, and retention can be set to zero
  • •Run state lives in the region that started it, or a region set via start(), so one regional outage does not stop new runs elsewhere
  • •durable-harness adds durability to Pi and OpenCode, with experimental Claude Code and Codex integrations in Vercel Sandbox; a Python SDK is in beta
Read details→
ADSponsored
A
Arena.aiarena·Collected 6h ago
📊 Benchmark

Arena analyzes 105 coding models: matching April's best now costs under 1/20 as much, the top score is climbing 3x faster than last winter, and a new model lands almost every other day

Arena studied 105 models across 44 weekly Code Arena: WebDev boards since December 2025. Xiaomi's MiMo-V2.6-Flash now beats April's leader Claude Opus 4.7 at under a twentieth of the price, the top score has risen about 41 points a month since May (3x the winter pace), and 19 of the 25 price-performance frontier models under $1 per answer are Chinese.

Arena analyzes 105 coding models: matching April's best now costs under 1/20 as much, the top score is climbing 3x faster than last winter, and a new model lands almost every other day
⚡ Key Takeaways
  • •Cadence: about 5 new models a month last winter, 12 to 14 a month from July to September, and 11 by October 23; OpenAI listed 12, Anthropic, Alibaba and Google 11 each
  • •Top score: April's best, Claude Opus 4.7, scores 1558 on today's board versus 1807 for today's leader Claude Opus 5.5; a new top score now lasts about three weeks instead of two months
  • •Price: between 5 cents and $1 per answer, today's best has an estimated 65-80% win rate against April's best at the same price; Opus 5.5 (Max) has about 81% but costs about $10 per answer
  • •Volatility: nearly half the top 10 labs change rank each week, and the #10 lab cut its gap to #1 by 38% (282 to 176 points)
  • •Regional split: 13 of the 15 frontier models above $1 are American; 17 of 21 Chinese frontier models have open weights versus 2 of 19 American ones
Read details→
G
Google DeepMindGoogleDeepMind·Collected 7h ago
🚀 Release

Google DeepMind Opens the Datasets Behind WeatherNext 3: PARDIG Estimates Global Rainfall Every 15 Minutes With 30%+ Better Detection Than NASA IMERG, SatWeave Stitches an Hourly Global Satellite Mosaic

On November 13, Google DeepMind released the two datasets behind its WeatherNext 3 model. SatWeave stitches imagery from geostationary satellites such as GOES, Meteosat and Himawari into one global mosaic across 17 visible, water vapor and infrared channels, updated hourly, with an archive spanning more than a decade. PARDIG is an AI-generated global precipitation dataset trained on NASA GPM spaceborne radar, with 15-minute time steps, roughly 10 km resolution and about five hours of average latency. DeepMind says that, evaluated against radar networks in the US, Europe and Japan and more than 36,000 weather stations, it improves hourly detection of light-to-moderate rain by more than 30% over NASA IMERG-Final, with archives from 1999 to 2026. Live feeds and archives for both are on Google Cloud Storage, and PARDIG historical catalogs are also in Earth Engine.

Google DeepMind Opens the Datasets Behind WeatherNext 3: PARDIG Estimates Global Rainfall Every 15 Minutes With 30%+ Better Detection Than NASA IMERG, SatWeave Stitches an Hourly Global Satellite Mosaic
⚡ Key Takeaways
  • •SatWeave fuses geostationary satellites including GOES-East/West, Meteosat 0, Meteosat Indian Ocean and Himawari across 17 channels, updated hourly, with an archive of more than a decade (the post lists five satellites in the text and six in a caption)
  • •PARDIG stands for Precipitation AI Reanalysis: Densely Inferred GPM; it takes SatWeave imagery and ECMWF atmospheric fields as input and is trained on radar from NASA's GPM Core Observatory
  • •PARDIG runs at 15 minutes and about 10 km with roughly five hours of average latency; DeepMind reports more than 30% better hourly detection skill (CSI) than IMERG-Final on light-to-moderate rain and strong results on extreme rain
  • •Live feeds and historical archives of both datasets are open on Google Cloud Storage, and PARDIG historical catalogs are also in Google Earth Engine
  • •Hourly SatWeave input lets WeatherNext 3 issue a new global forecast every hour instead of waiting for analysis data refreshed every six hours
Read details→
I
IBM Graniteibm-granite·Collected 7h ago
🚀 Release

IBM Releases LLMON, an LLM-Native Markup Language, With Granite 4.1 3B and 8B Preview Models: Reserved Tokens Separate Instructions From Data and Block 47% More Indirect Injection Attacks on OPI Than the Best Frontier Model Tested

On November 12, IBM's Granite team published LLMON (LLM Object Notation, pronounced "lemon") on Hugging Face. It wraps semantically tagged blocks such as instructions, data and requirements in reserved special-token delimiters, gives each block a unique ID, and uses an exec block to state which instruction runs on which data. IBM also released two experimental preview models, granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview (Apache 2.0), plus a GitHub toolkit and lossless JSON-to-LLMON converters. IBM says that on the OPI indirect prompt injection benchmark the LLMON models avoided 47% more attacks than the best frontier model it tested and 95% more than the best open-source model, while general capability stays on par with Granite 4.1 Instruct. IBM stresses this is learned behavior, not an enforced guarantee, and the models are an experimental preview, not for production.

IBM Releases LLMON, an LLM-Native Markup Language, With Granite 4.1 3B and 8B Preview Models: Reserved Tokens Separate Instructions From Data and Block 47% More Indirect Injection Attacks on OPI Than the Best Frontier Model Tested
⚡ Key Takeaways
  • •Syntax: tagged blocks (instruction, data, requirement and more) wrapped in reserved special tokens, each with a unique ID, plus an exec block that binds an instruction to the data it should act on
  • •Models: granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview, fine-tuned from Granite 4.1 base under Apache 2.0; they ship a chat_template so apply_chat_template renders the markup for you
  • •Security (vendor-reported): on OPI they avoided 47% more attacks than the best frontier model tested and 95% more than the best open-source model, with similar trends on ASB and StruQ; only static indirect injections are covered, and multi-turn adaptive attacks are still being worked on
  • •Tooling: the GitHub repo generative-computing/llmon includes lossless JSON-to-LLMON converters, IBM's Mellea framework supports LLMON natively, and you can define custom tags and train a LoRA on top
  • •Limits: IBM says this is learned behavior, not an enforced guarantee, and the release is for exploration and evaluation only; keep agent permissions enforced in application code
Read details→
D
DeepSeekdeepseek_ai·Collected 8h ago
🛠️ Tooling

DeepSeek Opens Its Full App Feature Set Through the API: deepseek-flash Gets Built-in Web Search, Deep Thinking Search, File Input, URL Reading and Safety Checks, Plus Standalone OCR, ASR and TTS APIs and an MIT Open-Source Chat Demo

On November 13, DeepSeek said the capabilities behind the DeepSeek App are now available through its API. V4.1-Flash (model name deepseek-flash) supports server-side web search (including image search with citations), deep thinking search, file input for PDF, Office and image files, automatic reading of links in user messages, and input/output safety checks across the Messages, Responses and Chat Completions protocols. OCR, speech-to-text (ASR) and text-to-speech (TTS) also launch as standalone APIs. Tool calls are billed on top of token charges: Search and Fetch cost $0.75 per 1K requests, OCR $0.225 per 1K pages, ASR $0.058 per hour and TTS $0.225 per 10K characters (both at a limited-time 50% discount). DeepSeek also open-sourced an MIT-licensed chat front end that can import DeepSeek chat history. Public-facing apps must enable safety checks.

DeepSeek Opens Its Full App Feature Set Through the API: deepseek-flash Gets Built-in Web Search, Deep Thinking Search, File Input, URL Reading and Safety Checks, Plus Standalone OCR, ASR and TTS APIs and an MIT Open-Source Chat Demo
⚡ Key Takeaways
  • •All three protocols are supported: Messages (/anthropic/v1/messages), Responses (/responses) and Chat Completions (/chat/completions), all with the deepseek-flash model
  • •Turn features on with the deepseek_web_search and deepseek_read_url tools and the safety_check and title parameters; tool calls and context assembly run server-side
  • •Tool prices (vendor figures, on top of tokens): Search and Fetch $0.75 per 1K requests, OCR $0.225 per 1K pages, ASR $0.058 per hour, TTS $0.225 per 10K characters (ASR and TTS at a limited-time 50% off)
  • •The open-source demo deepseek-ai/chat-demo is TypeScript under MIT, imports DeepSeek chat history and keeps your API key only in the browser
  • •The launch post drew about 117K views and 2,100+ likes in two hours; DeepSeek has published no search-quality or OCR/ASR accuracy benchmarks
Read details→
C
Cognitioncognition·Collected 8h ago
🛠️ Tooling

Cognition Launches Devin Apps: Private, Shareable Web Apps That Devin Builds and Hosts on Its Own Cloud Machine at a Stable URL, Billed by Awake Time

On November 13, Cognition launched Devin Apps. You describe the tool you need, Devin builds it as a web app in a session and serves it from its own cloud machine, with nothing deployed to a third-party host. Each App has a stable URL (name--id.preview.devinapps.com); everyone who opens it must sign in to Devin, Apps are never public, and they can be shared with people, an organization or a whole enterprise. Apps can use any stack, reuse connected MCPs, integrations and code, and keep data such as SQLite or Postgres on the same machine. The machine sleeps 5 minutes after the last request and wakes when someone opens the App; billing is by awake time, while building and changes bill as normal session work. Every update is a new version tied to a commit, and if a new version fails to start the previous one keeps serving. Apps are rolling out gradually.

Cognition Launches Devin Apps: Private, Shareable Web Apps That Devin Builds and Hosts on Its Own Cloud Machine at a Stable URL, Billed by Awake Time
⚡ Key Takeaways
  • •Hosting: Apps run on Devin's own cloud machine with nothing sent to a third-party host, and data and uploads stay on that machine
  • •Stable URL: shaped like name--id.preview.devinapps.com and unchanged by renames or updates; viewers must sign in to Devin and Apps are never public
  • •Billing: the machine sleeps 5 minutes after the last request and bills by awake time, the first load after sleep takes a few seconds, and building and edits bill as normal sessions
  • •Versions: Devin commits before every deploy, the previous version keeps serving if a new one fails to start, and the session can redeploy any older version
  • •Use cases: internal tools, dashboards, staging copies and demos; rollout is gradual and Cognition lists no unit price
Read details→
S
SimularSimularAI·Collected 10h ago
🛠️ Tooling

Simular Launches box, a Cloud Linux Desktop Exposed as One Remote MCP Server That Claude, ChatGPT, Gemini, Claude Code, Codex and Cursor Can Share; the Desktop Is Free and Model Calls Use Credits

On November 12 (UTC), Simular, the computer-use agent startup backed by Felicis and NVIDIA, launched box: one cloud Ubuntu desktop per account with Chrome and a persistent shell, exposed as a single remote MCP server (https://mcp.box.simular.ai/mcp, Streamable HTTP, OAuth sign-in). Any MCP client can add it, including claude.ai, ChatGPT, Gemini, Claude Code, Codex, Cursor, OpenCode and VS Code, so different assistants can work on the same machine with shared logins and files. Users watch it live on the web or iPhone and take over to sign in or approve payments. The desktop itself is free; model calls use account credits. The box sleeps when idle, wakes in about a second, and is deleted after 14 straight days asleep. The launch video passed 810K views. Simular has not published a benchmark for its "fastest computer use" claim.

Simular Launches box, a Cloud Linux Desktop Exposed as One Remote MCP Server That Claude, ChatGPT, Gemini, Claude Code, Codex and Cursor Can Share; the Desktop Is Free and Model Calls Use Credits
⚡ Key Takeaways
  • •Setup: one remote MCP URL, mcp.box.simular.ai/mcp, with OAuth; Claude Code needs a single claude mcp add --transport http box command, and CI can use a personal cb_ key
  • •The installer npx @simular-ai/[email protected] connect finds Claude Code, Codex, Cursor, OpenCode, Hermes, OpenClaw and VS Code on your machine and adds box; doctor and remove check and undo it
  • •Billing: the desktop is free and model calls use account credits; it wakes in about 1 second and is deleted with its files after 14 straight days asleep
  • •Secrets: API keys are stored encrypted and the AI only sees a stand-in; box swaps in the real key only on requests to the sites you list
  • •The launch video drew about 815K views; the "fastest computer use" line is a vendor claim with no published OSWorld or other benchmark
Read details→
C
Chubby♨️kimmonismus·Collected 11h ago
🛠️ Tooling

X Debate: AI Commentator Chubby Says Claude Code and Opus 5.5 Have Been His Daily Driver for Two Months and GPT Is "Not Close," but Concedes Computer Use Is Still GPT's Edge; 150+ Replies Focus on Splitting Work by Task and the Same-Day Claude Login Outage

On November 13 at 18:12 Singapore time, AI commentator Chubby (@kimmonismus, about 159K followers, editor-in-chief of Superintel) posted that after a year of switching between Codex/GPT and Claude Code/Opus, Claude Code with Opus 5.5 has been his daily driver for two months: "the most efficient and intelligent model to date," with GPT "good, but not close." He added that Claude's weak spot is computer use, where GPT is "unbeaten," and that he cares more about Claude Duet than ChatGPT dots, though neither is available to him in Europe. In a reply he put his split at about 80% Claude. At writing time the post had about 29K views, 590 likes and 152 replies. It went up during an Anthropic incident that blocked sign-ins to claude.ai and Claude Code from 09:58 to 11:58 UTC. This is one user's opinion and community discussion, not a benchmark.

⚡ Key Takeaways
  • •The post drew about 29K views, 590 likes, 152 replies and 32 bookmarks; the author has about 159K followers and said in a reply he uses Claude about 80% of the time and GPT about 20%
  • •Core claim: Opus 5.5 is "the most efficient and intelligent model to date" and GPT trails, but computer use is GPT's edge; OpenAI says GPT-6.1 Terra at max effort costs about 1/9 as much per task as Opus 5.5 (vendor claim)
  • •Claude Duet's help center says the research preview is open only to US Pro, Max and Ultra users via a waitlist, and always runs on Opus 5.5
  • •At writing time OpenAI's help center still says Pro dots are not offered in the EEA, Switzerland or the UK; the post's hint that Europe is getting access has no official announcement yet
  • •Claude status page: sign-in errors on claude.ai and Claude Code from 09:58 UTC on November 13, a fix deployed at 11:05, resolved at 11:58, about two hours in total
Read details→
C
Continuous IntelligenceContinu_Intel·Collected 12h ago
🚀 Release

London Startup Continuous Intelligence Opens ci-proto Weights: a 167M-Parameter Time-Series Forecaster That Reads 2M+ Steps of History, With fev-bench Results Merged Upstream at 51.5 SQL Skill

Continuous Intelligence, a London lab founded in July, released its first time-series foundation model, ci-proto, with weights on Hugging Face and code on GitHub. It forecasts series such as power load, sales or sensor data zero-shot on CPU or GPU. The company says it reads more than 2 million steps of history, 64 times other time-series foundation models, and returns nine quantiles from 0.1 to 0.9. Its results on the 100 fev-bench tasks were merged into the official fev repo by an AutoGluon maintainer: 51.51 SQL skill and 40.80 MASE skill. The licence builds on Apache 2.0 but adds attribution and a one-time notice for external products.

London Startup Continuous Intelligence Opens ci-proto Weights: a 167M-Parameter Time-Series Forecaster That Reads 2M+ Steps of History, With fev-bench Results Merged Upstream at 51.5 SQL Skill
⚡ Key Takeaways
  • •Size: about 167M parameters (config lists 167,190,592), plus a long-history checkpoint; histories up to 16,384 steps use the standard checkpoint and longer ones switch automatically
  • •Context: the company says it reads 2M+ steps of history, about 64x other time-series foundation models (vendor claim)
  • •Score: 51.51 SQL skill and 40.80 MASE skill zero-shot on 100 fev-bench tasks, submitted by the vendor and merged on Nov 11 in fev PR #211
  • •Outputs: joint multivariate forecasts with past and future covariates and categorical inputs, returning nine quantiles from 0.1 to 0.9
  • •Licence: custom licence based on Apache 2.0, commercial use allowed; external products or redistribution need public attribution and a one-time notice, internal use is exempt
Read details→
C
ClaudeDevsClaudeDevs·Collected 13h ago
🛠️ Tooling

Anthropic Opens Private Beta of Self-Hosted Claude Managed Agents: Harness, Sandboxes, Credentials and Session History Run in Your Own Cloud or Data Center, With Model Calls Routable to Bedrock, Foundry or Your Own Gateway

Anthropic put self-hosted Claude Managed Agents into private beta. Until now teams could either let Anthropic run everything or host only the sandboxes. Now the whole service (API, agent loop, session storage and sandboxes) can run in your own cloud account or on-premises, with session history in your own PostgreSQL. Model calls can go to Anthropic, Amazon Bedrock, Claude on Google Cloud, Microsoft Foundry or your own gateway, and the developer API matches the hosted service. Access is limited to eligible organizations through the Anthropic account team.

Anthropic Opens Private Beta of Self-Hosted Claude Managed Agents: Harness, Sandboxes, Credentials and Session History Run in Your Own Cloud or Data Center, With Model Calls Routable to Bedrock, Foundry or Your Own Gateway
⚡ Key Takeaways
  • •Three tiers: cloud sandboxes (fully hosted), self-hosted sandboxes, and self-hosted Managed Agents (service plus sandboxes on your side), laid out in the official docs
  • •Components: cma-server (API plus agent loop), PostgreSQL 16+, ant beta:worker workers, the cma-server-admin CLI, plus a Docker Compose stack and a Helm chart
  • •Four security principles: harness split from sandbox, credentials kept out of the sandbox, per-environment host allowlists, and a full step record exported over OpenTelemetry
  • •Reach: the @ClaudeDevs launch post had about 11K likes and 790K views at writing time; head of platform Katelyn Lesse says it also ships Anthropic's first real evals product
  • •Access: private beta for eligible orgs via the Anthropic account team; pricing not published
Read details→
N
Neo4jneo4j·Collected 13h ago
🛠️ Tooling

Neo4j Open-Sources Relate, an Embedded Graph Database for AI Agents: No Server, Cypher Graph Traversal Plus Vector Search, Built-In MCP and Agent Skill

At NODES 2026, Neo4j launched Relate, a new open-source embedded graph database written in Rust (Apache 2.0). It starts and stops with your application, with no server to deploy and no account to create. Agents can store what they learn as a connected graph and use one Cypher statement to follow relationships and run vector and full-text search together. It ships with a coding-agent skill and an MCP endpoint, and switches to a token-saving output mode when it runs under a coding agent. v1.0.1 is out on GitHub, but the README says it is still an experimental Neo4j Labs project outside the supported product line.

Neo4j Open-Sources Relate, an Embedded Graph Database for AI Agents: No Server, Cypher Graph Traversal Plus Vector Search, Built-In MCP and Agent Skill
⚡ Key Takeaways
  • •Zero deployment: one command installs it and it starts and stops with your app; data lives in memory, a directory or a single .rl file, with a WAL and Parquet checkpoints for durability
  • •Two kinds of search in one Cypher query: one statement can follow relationships and run vector or full-text search, with no glue code to merge results from two stores
  • •Compatibility: Neo4j says it runs more than 30,000 openCypher, Cypher 25 and GQL test scenarios to match the Neo4j query surface
  • •Many languages and entry points: clients for Rust, Python, JS/WASM, Java, Go, Swift and more, plus an optional single-process server that speaks Bolt, HTTP and MCP
  • •Release status: v1.0.0 shipped on GitHub on Nov 11 and v1.0.1 on Nov 12 under Apache 2.0; no official performance benchmarks yet
Read details→
L
LMSYS Orglmsysorg·Collected 14h ago
📊 Benchmark

LMSYS Details SGLang Megakernel: Muse Spark Open Decodes at 1,109 tok/s on 8x GB300 at Batch 1, Up from 517, with Kernel Launches per Step Cut from 1,450 to 97

LMSYS published a technical deep dive on a megakernel written from scratch in CUDA C++ and PTX (about 8,000 lines) for Meta's open-weight Muse Spark Open. Each decoder layer runs as a single kernel launch that overlaps compute, memory loads and cross-GPU communication. On 8x GB300, single-request decoding goes from 517 tok/s on the SGLang baseline to 1,109 tok/s, about 2.1x, and each decode step drops from 12.9 ms to 5.9 ms. The code is open source as an SGLang plugin at facebookresearch/sgl-muse-mega (MIT). It only covers batch size 1 and is experimental, so it buys latency rather than cheaper tokens.

LMSYS Details SGLang Megakernel: Muse Spark Open Decodes at 1,109 tok/s on 8x GB300 at Batch 1, Up from 517, with Kernel Launches per Step Cut from 1,450 to 97
⚡ Key Takeaways
  • •Twice as fast: on 8x GB300 at TP8 with one GSM8K request, decoding goes from 517 to 1,109 tok/s, about 2.1x, with the same draft model and acceptance length
  • •Far fewer launches: kernel launches per decode step drop from about 1,450 to 97, one per layer
  • •Step time: 12.9 ms to 5.9 ms; verify goes from 10.9 to 5.3 ms and the draft from 1.16 ms to 0.44 ms (175 launches down to 8)
  • •Speculative decoding: the DFlash V2 draft guesses 15 tokens per step; the model verifies 16 and accepts 6.6 on average, versus 8 verified and 6.3 accepted for Xiaomi MiMo-V2.5-Pro
  • •Scope: batch 1 only, with other requests falling back to stock SGLang; eight top GPUs serve one user, so this sells latency, not lower cost
Read details→
L
Lightning Labslightning·Collected 14h ago
🛠️ Tooling

Lightning Labs Open-Sources pi402: Coding Agents Pay for Inference per Token in Bitcoin over Lightning, with No Accounts, API Keys or Cards

On November 12 Lightning Labs released pi402, an extension for the Pi coding agent with an embedded Wavelength Lightning wallet. When the agent calls a paid inference API, it pays automatically over L402 or MPP, and the proof of payment doubles as the API key, so there is no sign-up and no credit card. Sellers put Aperture v0.6.0 in front of an existing inference API and price per token with meterd or lightmeter. The whole stack is open source (MIT). Lightning Labs' example rate of 1 msat per input token and 2 msat per output token works out to about $0.80/$1.61 per million tokens at a bitcoin price of about $80,500.

Lightning Labs Open-Sources pi402: Coding Agents Pay for Inference per Token in Bitcoin over Lightning, with No Accounts, API Keys or Cards
⚡ Key Takeaways
  • •Quick start: buyers run pi install npm:@lightninglabs/pi-402, then top up with a Lightning invoice via /fund or on-chain via /deposit
  • •Two protocols: Aperture v0.6.0 (released November 5) supports both L402 and MPP, the Machine Payments Protocol from Stripe and Tempo (IETF draft-httpauth-payment-00)
  • •Per-token billing: the example rate of 1 msat per input token and 2 msat per output token is about $0.80/$1.61 per million tokens at a bitcoin price of about $80,500
  • •Budget controls: the extension enforces a per-request ceiling and a daily budget, and a footer shows the wallet balance and each payment live
  • •Fully open source: the pi-402 extension, Aperture and the lightmeter reference server are open source, with pi-402 under MIT; the demo pays for Kimi K3.1 Pro inference
Read details→