News · Leaderboard

Latest news, beside the leaderboard

Read what just changed, and see who is ahead. Those are the two doors on this page.

N
NVIDIA@nvidia·13h ago
🔥 Trending

NVIDIA Unveils OpenShell Reference Architecture: Hardware-Isolated Security Guardrails for Autonomous Agents

At GTC Berlin, NVIDIA unveiled the OpenShell Reference Architecture alongside the Agent Knowledge Foundation within its Agent Toolkit. Addressing critical enterprise vulnerabilities where autonomous tool-using agents succumb to prompt injections, hallucinated destructive commands, or unauthorized data exfiltration, OpenShell establishes hardware-isolated runtime boundaries. Operating through hardware roots of trust, OpenShell dynamically intercepts out-of-boundary tool calls and file access in real time with sub-microsecond latency, establishing an authoritative blueprint for secure, auditable enterprise agent deployments.

NVIDIA Unveils OpenShell Reference Architecture: Hardware-Isolated Security Guardrails for Autonomous Agents
⚡ Key Takeaways
  • •NVIDIA officially launched the OpenShell Reference Architecture at GTC Berlin, establishing hardware-isolated boundaries for autonomous agents
  • •Implements dynamic runtime interception, strictly preventing out-of-boundary tool invocations, malicious script execution, and data leaks
  • •Natively integrates with the NVIDIA Agent Toolkit and Agent Knowledge Foundation for end-to-end access control and compliance auditing
  • •Solves critical enterprise security roadblocks preventing production rollout of high-privilege coding and autonomous operations agents
Read details→
M
Mistral AI@MistralAI·13h ago
🔥 Trending

Mistral AI and NVIDIA Forge Industrial Engineering AI Alliance, Previewing 1T Mistral Large 4

At GTC Berlin, Mistral AI and NVIDIA announced a strategic partnership dedicated to advancing AI for industrial engineering, computational physics, and electronic design automation (EDA). The alliance couples Mistral frontier architectures with NVIDIA CUDA-X libraries, Warp physics simulation frameworks, and Omniverse digital twins. Mistral simultaneously revealed architectural specifics for its forthcoming flagship, Mistral Large 4: spanning roughly 1 trillion total parameters with 49 billion active parameters (MoE), trained on 3,800 Grace Blackwell GPUs, with open weights slated for official release at the end of October 2026.

Mistral AI and NVIDIA Forge Industrial Engineering AI Alliance, Previewing 1T Mistral Large 4
⚡ Key Takeaways
  • •Mistral AI and NVIDIA launched a strategic alliance applying frontier foundation models to CAE, physics AI, and EDA semiconductor design
  • •Integrates NVIDIA Warp, CUDA-X simulation libraries, and Omniverse to establish open physics datasets and industrial agent benchmarks
  • •Disclosed architectural parameters for Mistral Large 4: ~1T total parameters with 49B active sparse MoE, trained on 3,800 Grace Blackwell GPUs
  • •Weights for Mistral Large 4 are scheduled for open-source release at the end of October 2026, joining the Nemotron Coalition
Read details→
N
NVIDIA AI@NVIDIAAI·13h ago
🔥 Trending

NVIDIA Launches Nemotron 3.5 Open Model Family, Cosmos World Models, and 13x Faster BioNeMo RFD4-Proteina

During the GTC Berlin keynote, NVIDIA unleashed a sweeping array of open-weights domain-specific foundation models. The release highlights include the multimodal Nemotron 3.5 Super VL, the lightweight Nemotron 3.5 Bolt series, and the end-to-end Nemotron Retriever suite for embedding, reranking, and document OCR. For physical AI, NVIDIA debuted the Cosmos world models and Alpamayo 2 Edge autonomous driving models. In life sciences, NVIDIA and the Baker Lab released BioNeMo RFD4-Proteina, which establishes state-of-the-art accuracy across more than 10 protein design benchmarks while synthesizing 200-amino-acid binders roughly 13x faster than RFdiffusion3.

NVIDIA Launches Nemotron 3.5 Open Model Family, Cosmos World Models, and 13x Faster BioNeMo RFD4-Proteina
⚡ Key Takeaways
  • •NVIDIA released an extensive open-weights portfolio at GTC Berlin: Nemotron 3.5 Super VL, Bolt 4GB edge variants, and Cosmos world models
  • •Unveils the full Nemotron Retriever suite for embedding, reranking, and multimodal document parsing, boosting enterprise RAG fidelity
  • •Co-developed BioNeMo RFD4-Proteina with the Baker Lab, leading on over 10 structural protein design benchmarks
  • •Synthesizes 200-amino-acid de novo proteins 13x faster than RFdiffusion3, dramatically shortening computational drug discovery timelines
Read details→
O
OverSeer Research Team@huggingface·13h ago
🔥 Trending

OverSeer: Multi-Agent World Models Beyond What Agents See via Joint Auxiliary Streaming

Researchers introduced OverSeer in arXiv:2610.28554, pioneering a new class of multi-agent world models operating beyond the field of view of individual agents. Standard video world models collapse in multi-agent environments because individual agents operate under partial observability; naive frameworks feeding external global map inputs suffer severe spatial inconsistency and state hallucination. OverSeer resolves this by jointly predicting auxiliary spatial representation streams alongside the agents' first-person camera streams. In comprehensive Minecraft benchmarks, OverSeer achieves decisive state-of-the-art results across physical grounding, long-horizon spatial memory, and cross-view consistency.

OverSeer: Multi-Agent World Models Beyond What Agents See via Joint Auxiliary Streaming
⚡ Key Takeaways
  • •OverSeer introduced in arXiv:2610.28554, establishing the first scalable multi-agent video world model framework
  • •Replaces external static map inputs with auxiliary spatial streams jointly predicted alongside agents' egocentric perspectives
  • •Achieves state-of-the-art performance across spatial grounding, long-horizon memory, and multi-view consistency in Minecraft
  • •Provides an ungrounded simulation backbone for multi-robot swarm collaboration, multiplayer game AI, and embodied multi-agent fleets
Read details→
ADSponsored
O
OpenAI@OpenAI·15h ago
🚀 Release

OpenAI frontier models and Codex are coming to Google Cloud: Model Garden access, bought via Marketplace against existing GCP commitments

On Oct 21, OpenAI and Google Cloud announced a partnership bringing OpenAI frontier models and Codex agentic workflows into Google Cloud Model Garden, transacted through Google Cloud Marketplace so enterprises can draw down existing GCP commitments. OpenAI models will also come to Google Antigravity and Gemini Agent soon. General availability is planned in the coming weeks, and Microsoft remains OpenAI's primary cloud partner. After AWS, this puts OpenAI models on all three major US clouds.

OpenAI frontier models and Codex are coming to Google Cloud: Model Garden access, bought via Marketplace against existing GCP commitments
⚡ Key Takeaways
  • •Channel: OpenAI frontier models and Codex come to Google Cloud Model Garden, transacted through Google Cloud Marketplace (official)
  • •Procurement: enterprises can draw down existing GCP commitments, no separate OpenAI contract or invoice
  • •Ecosystem: OpenAI models are coming soon to Google Antigravity and Gemini Agent, selectable alongside Gemini
  • •Timing: GA planned in the coming weeks, access requests open now; Microsoft remains the primary cloud partner
  • •Landscape: after Microsoft exclusivity ended in April and AWS added OpenAI models, OpenAI is now on all three major US clouds (per Reuters/CNBC)
Read details→
N
NVIDIA Newsroomnvidianewsroom·17h ago
🛠️ Tooling

NVIDIA launches OpenShell Reference Architecture at GTC Berlin: Vera Rubin, Vera CPUs and BlueField-4 Sentry for hardware-enforced safe AI agents

At GTC Berlin on Oct 21, NVIDIA announced the OpenShell Reference Architecture: building on the open-source OpenShell secure runtime, it pairs Vera Rubin for inference, Vera CPUs for agent harnesses, and BlueField-4 DPUs running NVIDIA Sentry for in-silicon policy enforcement, so enterprises can build, contain, observe and govern agents on-prem and at the edge. NVIDIA says it is available now; partners named include Anthropic, OpenAI, Meta, Microsoft and ServiceNow. The software is Apache 2.0.

NVIDIA launches OpenShell Reference Architecture at GTC Berlin: Vera Rubin, Vera CPUs and BlueField-4 Sentry for hardware-enforced safe AI agents
⚡ Key Takeaways
  • •Full stack: Vera Rubin for model inference, Vera CPUs for agent harnesses/tool use, BlueField-4 + Sentry for in-silicon policy and quarantine (vendor claims)
  • •Vendor claims: Vera Rubin NVL72 about 30x throughput per megawatt on agentic workloads; Sentry can quarantine a boundary-breaking agent in milliseconds and boost agent capacity by up to 20%
  • •Runtime: deny-by-default, enforcement outside the agent process; sandboxes have no direct network, syscalls are filtered in-kernel, credentials are injected only onto allowed requests
  • •Stated agent paths include Claude Code, Codex, GitHub Copilot CLI, OpenCode, OpenClaw, LangChain Deep Agents; deploy with Docker, Podman or Kubernetes via Helm
  • •Start: curl install script then openshell sandbox create; docs at docs.nvidia.com/openshell; GitHub NVIDIA/OpenShell (Apache 2.0) and PyPI package openshell
Read details→
v
vLLM@vllm_project·19h ago
🔥 Trending

vLLM and Ant Group Open-Source Humming: Up to 5x Kernel Acceleration and +43.3% MoE Throughput

The vLLM project team and Ant Group officially open-sourced Humming (humming-kernels), a specialized high-performance kernel library designed for serving quantized MoE and dense LLMs at massive scale. Humming natively supports WnA16, W8A8, W4A8, and W4A4 across INT1–INT8 and FP4–FP8 formats, spanning NVIDIA architectures from Turing through Blackwell as well as T-Head Zhenwu 810E silicon. In production benchmarks, Humming kernels outpace cuBLAS by 3–4x at small batch sizes and surpass Marlin by 2x on H200 clusters. Serving DeepSeek-V4.1-Flash across 8x H20 GPUs, Humming drives a +43.3% throughput gain under 64 concurrent requests while reducing time-to-first-token (TTFT) by 32%, pre-integrated directly into vLLM v0.29.0+.

vLLM and Ant Group Open-Source Humming: Up to 5x Kernel Acceleration and +43.3% MoE Throughput
⚡ Key Takeaways
  • •vLLM and Ant Group open-sourced Humming (humming-kernels), integrated out-of-the-box into vLLM v0.29.0+
  • •Covers WnA16, W8A8, W4A8, and W4A4, compiling JIT kernels in just 1.82 seconds versus 23.35 seconds for CUTLASS
  • •Serving DeepSeek-V4.1-Flash on 8x H20 GPUs yields a +43.3% throughput boost at 64 concurrency (442 to 634 tokens/sec)
  • •Cuts time-to-first-token (TTFT) by 25% to 32% while delivering up to 5x kernel speedups on Blackwell B300 systems
Read details→
A
Artificial Analysis@ArtificialAnlys·19h ago
🔥 Trending

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%

Artificial Analysis released an independent evaluation of Cognition's new coding agent, Devin Fusion. Moving beyond single-model execution, Devin Fusion employs an asymmetric multi-agent architecture pairing Claude Opus 5.5 (max) as the lead reasoning orchestrator alongside GPT-6 Luna (high) as a high-speed parallel worker. In the standardized Coding Agent Index, Devin Fusion achieved an elite score of 68.1 (matching Muse Code at 68.0 and rivaling Claude Code Sonnet 5.5 at 68.4). Crucially, the hybrid architecture slashes average task expense from $13.04 down to $9.01 (a 31% cost reduction) while shortening execution runtime from 65 to 55 minutes.

Artificial Analysis Benchmarks Devin Fusion: Scoring 68.1 on Coding Agent Index While Slashing Task Cost by 31%
⚡ Key Takeaways
  • •Artificial Analysis independently benchmarked Devin Fusion, scoring 68.1 on the standardized Coding Agent Index
  • •Pioneers asymmetric model collaboration: Claude Opus 5.5 orchestrates architecture while GPT-6 Luna executes parallel sub-tasks
  • •Cuts per-task execution costs from $13.04 to $9.01 (a 31% savings) and trims average completion time from 65 to 55 minutes
  • •Outperforms Claude Code with Opus 5.5 on DeepSWE v1.1 (72.6% vs 68.4%) and SWE-Atlas-QnA (69.6% vs 66.4%)
Read details→
ADSponsored
K
Krafton AI@Krafton_AI·19h ago
🔥 Trending

Krafton AI Open-Sources Raon-1 Mini: A 30B MoE with 4B Active Parameters Matching Muse Glimmer on Coding Autonomy

Krafton AI, the research division of global gaming giant Krafton, officially announced the open-weights release of Raon-1 mini under Apache 2.0. Pretrained from scratch, Raon-1 mini features a sparse Mixture-of-Experts (MoE) architecture with 30 billion total parameters and only 4 billion active parameters per token. The release is accompanied by a dedicated DFlash speculative drafting model and a live interactive playground. Internal evaluations reveal that Raon-1 mini matches Meta's Muse Glimmer across agentic tool-use and coding benchmarks while requiring substantially lower VRAM and sustaining lower generation latency.

Krafton AI Open-Sources Raon-1 Mini: A 30B MoE with 4B Active Parameters Matching Muse Glimmer on Coding Autonomy
⚡ Key Takeaways
  • •Krafton AI released Raon-1 mini under Apache 2.0, architecting a 30B total / 4B active parameter sparse MoE model
  • •Trained entirely from scratch, matching Meta's Muse Glimmer across agentic coding and multi-turn tool orchestration
  • •Bundled with a dedicated DFlash draft model for high-throughput speculative decoding on consumer-grade workstations
  • •Accompanied by a live public evaluation playground, providing a viable open backbone for local gaming and coding copilots
Read details→
E
Evolving Interfaces Team@huggingface·19h ago
🔥 Trending

Evolving Agent Interfaces: Empowering Computer-Use Agents to Synthesize Dynamic APIs for 58.58% Success

Researchers introduced 'Evolving Agent Interfaces' alongside the Agent S4 meta-framework in arXiv:2610.28601, removing the fundamental bottleneck of computer-use agents (CUAs). Conventional CUAs are forced to operate through human-designed graphical user interfaces—such as clicking spreadsheet cells one by one—inducing excessive action horizons and high failure rates. The new framework allows meta-agents to inspect live applications in scratch environments, dynamically synthesizing, testing, and evolving programmatic API wrappers and tool repositories on the fly. On OSWorld V2 and ScienceBoard, an open-weights 27B model raised task success from 55.03% to 58.58%, rivaling proprietary frontier models at a fraction of the cost.

Evolving Agent Interfaces: Empowering Computer-Use Agents to Synthesize Dynamic APIs for 58.58% Success
⚡ Key Takeaways
  • •Evolving Agent Interfaces introduced in arXiv:2610.28601, pioneering dynamic API synthesis for computer-use agents (CUAs)
  • •Meta-agents autonomously probe target applications in scratch VMs, writing bespoke programmatic wrappers to replace fragile GUI clicks
  • •Elevates task completion rates on OSWorld V2 and ScienceBoard from 55.03% to 58.58% on an open 27B parameter model
  • •Significantly compresses action sequences and token budgets, establishing an evolutionary paradigm for OS-level agent autonomy
Read details→
v
vLLM@vllm_project·22h ago
🛠️ Tooling

vLLM and Ant Group open-source Humming, one quantized-inference kernel library for many formats and every NVIDIA GPU since Turing, lifting DeepSeek-V4.1-Flash end-to-end throughput by 14-43%

On Oct 21 the vLLM community and Ant Group open-sourced Humming (Apache 2.0), a quantized-inference library that JIT-compiles GEMM kernels on demand. It supports every NVIDIA architecture from Turing on plus T-Head's Zhenwu 810E, and covers weight and activation combinations from INT1-INT8 and FP4-FP8 for dense and MoE workloads. In vLLM's microbenchmarks it runs 2-5x faster than vLLM Marlin, FlashInfer or DeepGEMM in some cases; on 8 H20 GPUs, switching DeepSeek-V4.1-Flash MoE from Marlin W4A16 to Humming W4A8 raised throughput 14-43%. vLLM 0.29.0 ships it built in.

vLLM and Ant Group open-source Humming, one quantized-inference kernel library for many formats and every NVIDIA GPU since Turing, lifting DeepSeek-V4.1-Flash end-to-end throughput by 14-43%
⚡ Key Takeaways
  • •One JIT kernel framework instead of a hand-written kernel per format: WNA16, W8A8, W4A8, W4A4, INT1-INT8 and FP4-FP8 weights, dense and MoE
  • •Hardware: every NVIDIA GPU from Turing (SM75) on, including Blackwell SM100/103/120/121, plus T-Head Zhenwu 810E
  • •End to end: DeepSeek-V4.1-Flash on 8x H20 at TP=8, Humming W4A8 beats Marlin W4A16 by 14-43% in throughput and cuts mean TTFT 25-32%; at concurrency 64 output goes from 442 to 634 tok/s
  • •Microbenchmarks run by the vLLM community: W4A8-MXFP4 on H200 is about 4.5x DeepGEMM W8A8, and the B300 MoE Grouped path is about 5x Marlin; one W4A16 kernel compiles in 1.82 s versus 23.35 s for CUTLASS
  • •Use: pip install humming-kernels (about a 500 KB wheel); built into vLLM 0.29.0+, enable with --linear-backend humming --moe-backend humming
Read details→
C
ChatGPT@ChatGPT·23h ago
🔥 Trending

ChatGPT Officially Rolls Out Locked Chats: Biometric Authentication and Complete Memory Isolation Across All Tiers

OpenAI officially rolled out 'Locked Chats' across all ChatGPT subscription tiers, including Free, Plus, Team, Enterprise, and Edu. Users can now safeguard sensitive individual conversation threads behind a device PIN, Face ID, or Touch ID biometric lock. Crucially, locked chats feature strict memory isolation: interactions inside locked sessions are physically barred from updating ChatGPT's persistent user memory bank. Confidential corporate discussions, sensitive health queries, or proprietary code audits remain strictly ephemeral to the local lockbox without contaminating future general chat contexts.

ChatGPT Officially Rolls Out Locked Chats: Biometric Authentication and Complete Memory Isolation Across All Tiers
⚡ Key Takeaways
  • •OpenAI officially released Locked Chats, rolling out globally across Free, Plus, Team, Enterprise, and Edu subscriptions
  • •Enables hardware-level protection via device PIN, Face ID, and Touch ID, shielding sensitive threads from physical shoulder surfing
  • •Guarantees complete memory isolation: queries, uploaded documents, and confidential context are strictly prohibited from updating user memory
  • •Eliminates context contamination risks when conducting proprietary code reviews, compliance audits, or medical inquiries
Read details→
S
Sage-A1.5 Team@huggingface·23h ago
🔥 Trending

Shanghai AI Lab Releases Sage-A1.5: A 35B MoE Agentic Model Advancing Long-Horizon Software and Scientific Discovery

The Shanghai Artificial Intelligence Laboratory published the technical report for Sage-A1.5 on arXiv:2610.28578, introducing an open-weights 35B Mixture-of-Experts (MoE) foundation model purpose-built for agentic tasks. Building on the Agents-A1 lineage, Sage-A1.5 focuses on scaling the agent execution horizon rather than model parameters through adaptive capability composition. Tailored for complex repository-level software engineering and multi-step scientific hypothesis exploration, Sage-A1.5 consistently outperforms dense 70B+ baselines on long-horizon reasoning benchmarks while maintaining lightweight deployment footprints.

Shanghai AI Lab Releases Sage-A1.5: A 35B MoE Agentic Model Advancing Long-Horizon Software and Scientific Discovery
⚡ Key Takeaways
  • •Shanghai AI Lab published Sage-A1.5 (arXiv:2610.28578), open-sourcing a 35B MoE agentic foundation model
  • •Pioneers horizon scaling over raw parameter expansion, sustaining consistent focus across 100+ execution steps
  • •Optimized for repository-level software engineering bug fixes, matching dense 70B+ baselines on complex git issue resolution
  • •Features intrinsic scientific exploration and hypothesis generation capabilities, tailored for local on-prem cluster deployment
Read details→
A
Alibaba Research & Collaborators@Alibaba_Qwen·23h ago
🔥 Trending

FocusGUI: Focused Omni-Modal GUI Agents Slashing Sequential Distraction and Doubling Type Match to 64.2%

Researchers from Alibaba and collaborating academic institutions introduced FocusGUI in arXiv:2610.26203, establishing a focused attention architecture for streaming omni-modal GUI agents. Across streaming observations of continuous UI screenshots, synchronous audio, and device state histories, agents routinely suffer from 'Sequential Distraction'—where transient visual clutter from previous steps compounds into catastrophic action hallucination. FocusGUI preserves the base model while introducing action-sufficient projection and channel decomposition. Tested across 29 smartphone apps on OmniGUI, FocusGUI elevates Type Match from 31.0% to 64.2% and Exact Match from 11.2% to 33.5% across four omni-modal foundation backbones.

FocusGUI: Focused Omni-Modal GUI Agents Slashing Sequential Distraction and Doubling Type Match to 64.2%
⚡ Key Takeaways
  • •FocusGUI introduced in arXiv:2610.26203 by Alibaba researchers, solving Sequential Distraction in streaming multimodal GUI automation
  • •Integrates action-sufficient projection and channel decomposition to dynamically prune transient visual and audio clutter
  • •On the OmniGUI benchmark (29 apps, 2,572 steps), doubles average Type Match from 31.0% to 64.2% and triples Exact Match to 33.5%
  • •Readily enhances Qwen2.5-Omni, MiniCPM-o 4.5, VITA-1.5, and Baichuan-Omni without requiring end-to-end backbone retraining
Read details→
E
EdgeKernelBench Team@huggingface·23h ago
🔥 Trending

EdgeKernelBench: Unified Benchmark and LEKA Agent for LLM-Driven Kernel Generation on Heterogeneous Edge Backends

Researchers introduced EdgeKernelBench and the LEKA agent architecture in arXiv:2610.24648, establishing the first unified framework for evaluating and generating low-level high-performance kernels across heterogeneous edge backends. While LLM-driven kernel generation has demonstrated success on datacenter GPUs, edge deployments remain plagued by hardware diversity, fragmented compiler toolchains (CUDA, OpenCL, TileLang, Triton), and strict memory-compute constraints. EdgeKernelBench bridges this gap through a unified intermediate representation (IR) suite spanning 331 canonical workloads. The companion Layered Edge Kernel Agent (LEKA) hierarchically decomposes optimization decisions, unlocking efficient automated kernel synthesis on edge silicon.

EdgeKernelBench: Unified Benchmark and LEKA Agent for LLM-Driven Kernel Generation on Heterogeneous Edge Backends
⚡ Key Takeaways
  • •EdgeKernelBench released in arXiv:2610.24648, establishing the premier unified evaluation harness for edge kernel generation
  • •Spans CPU/LLVM, GPU/CUDA, and GPU/OpenCL stacks with 331 canonical compute patterns across 650 concrete benchmark workloads
  • •Introduces LEKA (Layered Edge Kernel Agent), hierarchically decoupling compilation and schedule decisions across IR abstraction tiers
  • •Solves single-shot generation failures (where models achieved only 25.5% [email protected]), paving the way for automated edge NPU acceleration
Read details→
M
Mistral AI@MistralAI·23h ago
🔥 Trending

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency
⚡ Key Takeaways
  • •Mistral AI launched the Voxtral 3 suite spanning transcription, emotional TTS, studio-grade voice cloning, and a LiveKit-powered Voice-Agent SDK
  • •Artificial Analysis independently verified Small Transcribe 3 at a 2.1% error index, outperforming ElevenLabs Scribe v2 (2.2%) and Grok Voice 2.0 (2.3%)
  • •Realtime Transcribe 3 achieves sub-500ms latency, delivering sub-second full conversational voice-agent turns
  • •Aggressive pricing: Mini Transcribe starts at $0.0035/min, and managed voice agent sessions cost just $0.04/min paired with Mistral Small 4
Read details→
v
vLLM@vllm_project·23h ago
🔥 Trending

vLLM Narrows Gap with DeepInfer to 6% on NVIDIA GB200, Reaching 1M Tokens/s per GPU on GB300

Hours after DeepSeek open-sourced DeepInfer, the vLLM project team released official benchmark parity data serving DeepSeek-V4.1-Flash. Utilizing DeepSeek's identical decoding setup (131K context window, nextn=3 speculative decoding), vLLM closed its throughput performance delta to within 6% of DeepInfer across batch sizes 8 through 256 on NVIDIA GB200 systems. On GB300 hardware, vLLM attained up to 1,000,000 tokens/second per GPU and 826 tokens/second per user, generating $38.96 in hourly GPU revenue at DeepSeek off-peak rates. vLLM simultaneously shipped day-0 runtime support for FastH3-Omni and Spark-X2.6-4B.

vLLM Narrows Gap with DeepInfer to 6% on NVIDIA GB200, Reaching 1M Tokens/s per GPU on GB300
⚡ Key Takeaways
  • •vLLM published direct benchmark comparisons, demonstrating that its serving throughput on NVIDIA GB200 is within 6% of DeepInfer
  • •Achieves unprecedented scaling on NVIDIA GB300: up to 1,000,000 tokens/second per GPU and 826 tokens/second per active user stream
  • •Generates up to $38.96 per GPU-hour in revenue when mapped to DeepSeek's production off-peak API pricing schedule
  • •Delivers immediate Day-0 support for the FastH3-Omni video model and the 1M-token Apache 2.0 model Spark-X2.6-4B
Read details→
V
Visual Studio Code@code·23h ago
🔥 Trending

VS Code Preview Introduces Canvases: Shared Workspaces for Developers and Coding Agents

The Microsoft VS Code team announced Canvases in VS Code Preview (v1.142), introducing dedicated shared visual workspaces connecting developers with autonomous coding agents. Addressing the severe UX limitations of cramped sidebar chat windows—where complex multi-file architectural modifications and agent diffs become hard to track—Canvases provides an expansive, interactive infinite-canvas whiteboard. Developers and agents (such as GitHub Copilot, Claude Code, and Cline) can collaboratively organize system flowcharts, live interactive code diffs, execution traces, and unit test rollouts side by side.

VS Code Preview Introduces Canvases: Shared Workspaces for Developers and Coding Agents
⚡ Key Takeaways
  • •Microsoft VS Code Preview v1.142 introduced Canvases, pioneering a spatial human-agent collaborative interface
  • •Transceives beyond claustrophobic sidebar chats to an expansive, pan-and-zoom whiteboard mapping concurrent multi-file agent diffs
  • •Embeds code files, architecture diagrams, interactive git diffs, terminal outputs, and test runners as unified interactive cards
  • •Natively bridges GitHub Copilot, Claude Code, and third-party coding agent harnesses, accelerating IDE spatial development
Read details→
M
Matrix-Game Team@huggingface·23h ago
🔥 Trending

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds via Executable Harness

Researchers introduced Matrix-Game 4.0 in arXiv:2610.27999, bridging the chasm between controllable video generation and genuinely playable, interactive virtual worlds. Current video world models suffer from severe state hallucination, inability to enforce rigid game mechanics (collision physics, inventory, win/loss rules), and sluggish response latency. Matrix-Game 4.0 resolves these barriers by decoupling game logic execution from visual synthesis through an executable game harness. A lightweight runtime tracks deterministic game states and rules, steering high-fidelity streaming video backbones to deliver playable, persistent, and low-latency virtual game environments.

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds via Executable Harness
⚡ Key Takeaways
  • •Matrix-Game 4.0 introduced in arXiv:2610.27999, architecting a decoupled paradigm separating game rule execution from generative video synthesis
  • •Employs an executable game harness maintaining deterministic physics, collision boundaries, and game state, eliminating visual state drift
  • •Transitions generative AI from passive controllable video playback to genuinely playable interactive game sandboxes
  • •Maintains low-latency streaming inference, establishing an open blueprint for next-generation AI-native game design and interactive simulations
Read details→
h
humans&humansand·1d ago
🚀 Release

humans& releases its first model, Ampersand v0.1: a group-collaboration model trained from GLM 5.3, now open via its Agents API

On Oct 20, AI startup humans& released its first model, Ampersand v0.1, pitched as a collaborator that helps groups reach individual and shared goals rather than an assistant that completes tasks alone. It is trained from Z.ai's GLM 5.3 (about 744B total, about 40B active parameters) with long-horizon multi-party RL against simulated users played by humans&'s own user model, Persimmon. It is available now, with no waitlist, through an API compatible with OpenAI's Agents API.

humans& releases its first model, Ampersand v0.1: a group-collaboration model trained from GLM 5.3, now open via its Agents API
⚡ Key Takeaways
  • •Base: GLM 5.3 MoE with about 744B total and about 40B active parameters and a 1,048,576-token context (official model card)
  • •Long-term collaboration simulation (vendor figures): 12.94 for Ampersand versus 9.89 for base GLM 5.3
  • •Collaborative Intelligence teamwork 59.1% (GLM 5.3: 54.3%); CooperBench cooperative success 39.0% versus 17.3% for GLM 5.3
  • •Trade-off: SWE-bench Pro v2 (Hard-51) 82.4%, slightly below the base model's 84.3%; humans& also admits it sometimes over-coaches
  • •Access: model ID ampersand-v0.1, usable with the official OpenAI SDK pointed at the humans& base URL
Read details→