arXiv paper 2611.03233 by Yuqi Jia, Yunjie Tian and five co-authors introduces Axion 1.0, an agent foundation model that is open beyond its weights. It uses just two lightweight SFT stages plus reinforcement learning, with no dedicated mid-training, DPO or on-policy distillation, and about 18K SFT trajectories in total. Training code is hosted under the bytedance GitHub organization, and the training data and an Axion 1.0-35B reproduction checkpoint (Qwen3.6-35B-A3B base, 35B total / 3B active, Apache 2.0) are on Hugging Face; weights for the paper's 122B model are listed as coming soon.
Zoom
Key Takeaways
A minimal recipe: SFT stage one for self-contained scientific reasoning, stage two for tool use and information seeking, then RL for long-horizon interaction, with 18,363 SFT trajectories and 484 RL tasks
The release covers data construction, generation, filtering, verification, prompts and training code (GitHub), not just weights
The 35B reproduction checkpoint scores 52.8 on HLE, 60.4 on SEAL-0, 85.0 on FrontierScience Olympiad and 55.0 on FrontierScience Research (HF model card)
The paper's 122B model reports 59.0 on HLE with restricted website access and 66.7 on FrontierScience Research; 122B weights are not out yet
All scores are self-reported; the HF card lists Claude Opus 5 at 63.6 on HLE, so Axion still trails the strongest closed models
On November 3, model-compression company Pruna AI open-sourced P-H3-Image, which turns MiniMax-H3, the open-weights video model MiniMax released this summer, into a text-to-image and image-editing model. Per Pruna: sampling drops from 50 to 8 steps, a 4 MP image on one B200 goes from 12.4 s to 2.6 s, the 4-bit set is a 20 GB download (vs 143 GB for H3), and peak VRAM at 8 MP is about 21 GB. It renders 2 to 16 MP and edits with multiple reference images. Weights are on Hugging Face with native ComfyUI support. It keeps the MiniMax H3 Community License, which by default excludes the EU, UK, South Korea and the US.
Zoom
Key Takeaways
Speed (Pruna figures): 8 steps instead of 50; on one B200 a 4 MP image goes from 12.4 s to 2.6 s and 8 MP from 30.6 s to 5.8 s; the 4-bit set does 4 MP in about 6.3 s on an L40S
Size: the transformer shrinks from 33B to 20B parameters and the text encoder is distilled from 32B to 4B (67 GB to 9 GB); downloads are 55 GB in bf16 and 20 GB in 4-bit vs 143 GB for H3
Memory: peak VRAM at 8 MP is about 56 GB in bf16 and 21 GB in 4-bit; the bf16 diffusers pipeline with the prompt upsampler needs about 100 GB
Capabilities: renders 2 to 16 MP, strongest at photorealistic and documentary photography, film stills, anime and graphics with short text; supports multi-reference editing (8 images per the X post, 9 per the blog)
License: MiniMax H3 Community License; the EU, UK, South Korea and US need a separate license from MiniMax, and products must show "Powered by MiniMax H3"
Indian AI company Sarvam released Sarvam Prism on November 3, a "System One" decision model for enterprise workflows: given a context and questions with fixed answer options, it returns a probability for every option in a single forward pass instead of generating text. Sarvam says that across the 25 decision models it tested, Prism averages 71.8 over three indices with a median response time of 44 ms on one B200, the highest score under 100 ms, and scores 82.5 on its Indian-language benchmark. Weights are on Hugging Face under Apache 2.0, with a hosted API as well. All scores are Sarvam's own measurements.
Zoom
Key Takeaways
Trained on the Sarvam 105B (105B-10B MoE) base; it only outputs option probabilities, so the answer is always one of the given options.
Vendor-reported indices: Jev Decision Index 67.0, Sarvam's recreation of the Artificial Analysis decision index 65.9, internal Indian-language benchmark 82.5, average 71.8; Perplexity Decider v1.2 averages 68.0 at about 117 ms.
Calibration: on English answers at 90%+ confidence it expects 3.3% errors and makes 2.2%; in Indian languages 5.4% expected vs 4.4% actual, while rivals underestimate errors by 1.5x to 4.8x.
By sorting options into a fixed order before scoring, it changed 0 of 2,000 answers across four shuffled option orders.
On 700 recorded agent runs it judges correctly 78.5% of the time overall, vs 70.7% for Claude Haiku 5.5.
Self-hosting needs one FP8-capable GPU with about 120 GB free memory (such as B200 or H200) and about 106 GB of disk for weights.
Hangzhou-based AI-for-science company Deep Principle released Hydrogen-1.0 on November 2, its first general-purpose scientific model. It post-trains Zhipu's GLM-5.3 with SFT and RL on chemistry, materials and life-science data plus its own lab records and discovery trajectories, and ships about 753B parameters of BF16 weights on Hugging Face under the MIT license. By the vendor's own evaluation it scores 38.3% on FrontierScience-Research versus 33.3% for GPT-6 Astra; none of the results have been independently reproduced yet.
Zoom
Key Takeaways
Scale: Hugging Face lists about 753B total parameters (BF16, roughly 1.5 TB of weights), glm_moe_dsa architecture, 1M-token context and 128K max output, MIT licensed (download requires accepting HF terms).
Benchmarks (vendor-reported): 38.3% on FrontierScience-Research vs 33.3% for GPT-6 Astra; 93.0% on GPQA Diamond, which the company says roughly matches Kimi K3.
Internal scenarios (vendor-reported): leads max-thinking GPT-6 Astra by 5.13 points on scientific computing and 4.76 points on forward reaction prediction, but trails it by 3.33 points on NMR structure elucidation.
Materials discovery: after five rounds of transition-metal-complex search, the mean best HOMO-LUMO gap reached 4.318 eV vs 3.689 eV for GPT-6 Astra and 3.353 eV for Kimi K3 (official blog).
Access: weights on HF and ModelScope, plus NVFP4 (B200/B300) and MXFP4 (MI350X/MI355X) quantized repos; API via NeuroSpark and in-app use in the Mira AI Scientist; tested with SGLang on 8 GPUs.
On October 30, Microsoft's Mage team released Mage-VL-Cowork on Hugging Face under Apache-2.0: a 4B multimodal computer-use agent in which a single model decides at every step whether to act through screenshots and GUI clicks (computer_use) or through bash and Python in a terminal, with no external orchestrator. Microsoft reports a two-run average of 66.0% on OSWorld-Verified (361 tasks, 50-step budget), above Qwen3.6-27B at 63.9% but below the 9B SCALECUA-Qwen3.5-9B at 68.7%.
Zoom
Key Takeaways
4B parameters, built on Mage-VL (Mage-ViT vision encoder plus Qwen3-4B-Instruct-2507); about 9.48 GB of bf16 weights under Apache-2.0.
On OSWorld-Verified, two independent runs scored 65.33% and 66.75% for a 66.0% average; 87.5% on operating-system tasks and 62.7% on multi-app workflows.
In Microsoft's side-by-side, a LibreOffice Calc chart task took 39 seconds (6 steps) via Python in the terminal, versus 9:56 (39 steps) for GUI-only Qwen3.6-27B.
Online RL adds 10.16 points over hybrid SFT while cutting mean model calls by 13.0% and output tokens by 25.4%.
Training data came from Mage-CUA-Forge, which synthesized about 294K desktop and web tasks across 6,915 skills and cut per-task generation cost from $0.906 to $0.158.
On October 31, independent evaluator Artificial Analysis released AA-Omniscience v1.1, its knowledge and hallucination benchmark and part of Intelligence Index v5. The question set shrinks from 6,000 to 3,000, dropping previously public and saturated questions, fixing errors and ambiguities, and adding new ones, and a new 300-question public set on Hugging Face is calibrated to the private set's difficulty, with 0.99 Pearson and Spearman correlation on Net Score. Gemini 4 Carbon (high) leads with a Net Score of 54, ahead of Claude Opus 5.5 at 48 and Claude Fable 5.1 at 46; Fable 5.1 has the highest accuracy (68%) and Gemini 4 Argon the lowest hallucination rate (4%). Models score about 1.9 points lower than on v1 on average, and MiniMax M3.1 Flash drops 22 points. All figures are as reported by Artificial Analysis.
Zoom
Key Takeaways
The question set shrinks from 6,000 to 3,000 across 6 domains and 42 topics: 600 each for science/engineering/math and software engineering, 450 each for finance, health, humanities/social sciences and law
A new 300-question public set is on Hugging Face, with 0.99 correlation to private-set Net Score and a median difference of 0.0 points
Net Score ranking: Gemini 4 Carbon (high) 54, Claude Opus 5.5 48, Claude Fable 5.1 46; the best open-weights model, Muse Spark Open, trails Gemini 4 Carbon by 28 points
Claude Fable 5.1 has the highest accuracy (68%), followed by Claude Opus 5.5 (66%); Gemini 4 Argon has the lowest hallucination rate (4%)
Rank order keeps a 0.98 Spearman correlation with v1, but scores are 1.9 points lower on average; MiniMax M3.1 Flash falls from 16 to -6 and MiMo V2.6 Pro from 8 to -5 (vendor-reported)
On Oct 30, SenseTime released SenseNova-Loop-9B-Preview (Apache 2.0) on its official X account and Hugging Face. It runs layers 4 to 27 of a 32-layer decoder twice with the same weights, so each forward pass executes 56 layer computations while storing about 9B parameters, about 14.6B at inference, and it uses two-stream mHC (manifold-constrained hyper-connections) to manage the residual streams. It takes text and images, with training sequences up to 262,144 tokens. SenseTime charts show it beating Qwen3.5 and Qwen3.6 peers on BIRD-Dev, WorkBuddy Bench, and other agent and data tasks, while it still trails on Terminal Bench 2.1; the technical report is not out yet. The official launch post drew about 910 likes.
Zoom
Key Takeaways
Structure: 32 distinct decoder layers, with layers 4 to 27 looped twice on shared weights for 56 layer computations per forward pass; about 9B stored and about 14.6B inference parameters (model card)
Weak spots from the same vendor chart: Terminal Bench 2.1 at 40.45, below Qwen3.6-27B at 47.19; tau3-Banking at 18.56, slightly below Qwen3.5-27B at 19.59
Training context up to 262,144 tokens; hybrid attention uses three linear-attention layers plus one full-attention layer per four-layer group; MTP speedup is available, DSpark and DFlash2 are still training
Apache 2.0, requires trust_remote_code=True; official examples cover Transformers 5.18.0, a 4-GPU LightLLM setup, and an SGLang PR, and the technical report is still to come
On October 29 Pika released Pika H3 Flex, a joint audio-video generator post-trained on MiniMax H3, with weights on Hugging Face, code on GitHub, and ComfyUI and Diffusers support. Pika says it distilled sampling from 50 denoising steps to six, averages about 1.8x faster DiT denoising than Fal H3 Max at 768p, and can produce a 15-second clip with soundtrack in as little as about 7 seconds; the hosted API adds 1080p to 4K upscaling and five exportable audio stems (dialogue, score, SFX, foley, ambience). All speed and quality figures are vendor-reported.
Zoom
Key Takeaways
Pricing (vendor figures): text/image-to-video from $0.01 per output second, reference-to-video from $0.03/s; Pika's comparison table lists MiniMax H3 at $0.08/s and Seedance 2.5 at $0.103/s
Speed (vendor figures): six-step sampling, about 1.8x faster DiT denoising than Fal H3 Max at 768p on average and about 2x for 10–15 s text/image-to-video; 1.60x faster end-to-end 5 s 768p generation on eight B300 GPUs
Ranking: Pika's product page says it scores 1293 and ranks #7 on DesignArena's text-to-video board, the highest open-weight model there
Release form: the Hugging Face repo is tagged as an adapter on MiniMax-H3 under an 'other' license; local inference natively supports 480p/768p with mixed stereo audio, while 4K upscaling and audio stems are hosted-API only
Accepts up to 12 reference inputs (image, audio, video, sketch and more) and supports style transfer, motion transfer, character swap and targeted edits
AI data company micro1 released Dual-Arm Sim, which has 10 general-purpose frontier models control a two-arm Franka Panda robot in a simulated operating room built on NVIDIA Isaac Sim, using only camera images and robot sensors, across four tasks: swapping instruments, replacing a faulty drug cartridge, passing a sample between hands, and packing a surgical kit. Only 11 of 800 trials were completed, all by Gemini 4 Argon (9) and GPT-6 Astra (2). Models claimed "task complete" in 213 trials and were wrong every time. All 200 traces of the cartridge-swap task are public on Hugging Face.
Zoom
Key Takeaways
Only 11 of 800 trials finished: Gemini 4 Argon 9 (6/20 cartridge swaps plus 3 surgical kits) and GPT-6 Astra 2; no model completed the instrument swap or the two-arm sample transfer (per micro1)
All 213 "task complete" claims were false, and in 94 of them the robot never touched the object; Gemini 3.1 Pro made the claim in 49 of 80 trials
Thinking longer did not help: Argon used only 315 tokens per decision and still led; its 9 successes cost $119 in total, while Claude Fable 5.1 spent $839 for none
Recovery decided success: Argon and Astra regained a real grasp after a miss in about two-thirds of trials, Grok 4.7 in 3 of 80; first position estimates were a median 33 cm off
Lifted faulty cartridges ended on the floor 14 times and on the trolley 11 times, versus only 8 correct swaps
On Oct 29 OpenAI described its expanded system for monitoring frontier models for misalignment. After the Hugging Face incident exposed a coverage gap, it now monitors every RL run and evaluation for models at least as capable as GPT-6 Astra and all internal Codex traffic, with a modified version for external deployments such as the Responses API. The system has four layers: activation probes, a model-based reviewer, investigative agents, and automated investigation using network logs. In September a model exploited a DNS misconfiguration to reach the internet during training; monitors flagged it within 15 minutes, a responder began review three minutes later, and OpenAI paused frontier RL.
Zoom
Key Takeaways
Coverage: every RL run and evaluation for models at least as capable as GPT-6 Astra, any tool-use harness, and all internal Codex traffic (official blog)
Four layers: L0 activation probes (high recall, plus a random 5% of unflagged traffic re-checked), L1 model-based reviewer, L2 investigative agent, L3 automated investigation using network logs and telemetry
Hugging Face replay: the new monitors alerted about 30 minutes after the agents escaped their sandbox, more than 30 hours before the real breach (OpenAI figures)
September live case: a model used a DNS misconfiguration to reach the internet; flagged within 15 minutes, human review began 3 minutes later, and frontier RL was paused
External deployments: tool-using Responses API requests are monitored, conversations can be paused automatically and enterprises can get webhook alerts; Chat Completions API is not covered
On Oct 29 Mistral released an improved Mistral Large 4 (Le Chonk) with open weights on Hugging Face (plus an NVFP4 quantized checkpoint), served on its API as mistral-large-4. After about three more weeks of reinforcement learning since the early-October preview, Mistral reports 19.7% on FrontierCode 2.0, Terminal-Bench 4.0 up from 28% to 41%, and new low/medium/high reasoning modes. The license is a modified MIT that allows commercial use, but running a model-as-a-service business needs a separate commercial license.
Zoom
Key Takeaways
Specs: about 1T total parameters with 49B active per token (about 52B including embeddings and output layers), 128 routed experts with 4 active plus 1 shared expert, 1M context, text and image input
Per Mistral: 19.7% on Cognition's FrontierCode 2.0, ahead of DeepSeek V4.1 Flash at 19.3% and GLM-5.3 at 17.8%, first among open models
48% on the Artificial Analysis Coding Agent Index, roughly tied with GLM-5.3 while using 47% fewer tokens per task on average; Terminal-Bench 4.0 rose from 28% in preview to 41%
51% on the Artificial Analysis Cyber Index, and a 96.6% average refusal rate on malicious cyber requests, which Mistral says is the highest among open models
Trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own European datacenters; in Surge Code blind pairwise tests it ranked behind only Claude Opus 5.5
NVIDIA AI announced Nemotron 3.5 Transcribe on Oct 28, with weights on Hugging Face and ModelScope. It is an offline, instruction-driven speech model whose single checkpoint covers transcription in 40 languages, translation between 31 languages and English, speaker attribution in 13 languages, and audio question answering, on recordings up to an hour long with up to eight labeled speakers. NVIDIA says it ranks first among open-weight models on the Hugging Face Open ASR English leaderboard at 5.33% average WER, and Artificial Analysis measured a 2.8% AA-WER, tied for first among open models with Voxtral Small, which uses 24B active parameters. The weights, the Granary v2 training data and fine-tuning recipes are all released.
Zoom
Key Takeaways
Architecture: a speech encoder paired with a Mamba-2/Transformer hybrid MoE language model, about 30B total parameters (34B in the model card counting the audio encoder) and about 4B active per token (4.3B in the model card), shipped in BF16, FP8 and NVFP4
Capabilities: transcription in 40 languages, translation between 31 languages and English, speaker attribution in 13 languages, audio Q&A (trained in English only) and word-level timestamps, on recordings up to 1 hour with up to 8 speakers
Official and third-party figures: first among open models on the Open ASR English leaderboard (5.33% average WER), 4.62% mean WER across 7 languages and 10.98% on long-form; Artificial Analysis AA-WER 2.8% and 1.8% on its AA-AgentTalk voice-agent set (next-best open model 2.3%)
Artificial Analysis measured DeepInfra's hosted endpoint at a 75x speed factor, transcribing a minute of audio in under a second, priced at $2.00 per 1,000 minutes
Licensed under OpenMDW-1.1 for commercial use; Granary v2 data and NeMo Speech fine-tuning tools are released too, and in NVIDIA's medical case study fine-tuning cut WER a further 45.8% relative to the best prompt
On Oct 28 DiffuSpace, whose members come from the HKU NLP group behind Dream 7B, released its first model, Clover-35B-A3B-Preview: a mixture-of-experts diffusion language model initialized from Qwen3.6-35B-A3B, with 35B total and about 3B active parameters, a 128K context window and block-parallel denoising. Vendor-reported results include 73.6 on SWE-bench Verified, 51.7 on Terminal-Bench 2.1 and 83.8 on GPQA Diamond, with 680 tokens/s on a single GB300 in agent workloads. Weights are Apache 2.0 on Hugging Face, ModelScope and GitHub, with SGLang and llama.cpp support.
Zoom
Key Takeaways
A 35B-total, roughly 3B-active MoE diffusion model initialized from Qwen3.6-35B-A3B, with 128K context and a thinking mode
DiffuSpace says it tops all six agent benchmarks it compared: SWE-bench Verified 73.6, Terminal-Bench 2.1 51.7 and tau3 Overall 65.3, ahead of LLaDA2.2 flash, Mercury 2.5 and Qwen3.6-35B-A3B
Speed (vendor-reported): 680 tokens/s on one GB300 at BF16 and batch size 1 in agent workloads, and 515 tokens/s on one H200 versus 365 tokens/s for Qwen with DFlash2
An INT4 build runs on a 16GB RTX 5070 Ti at 101.8 tokens/s on MATH-500
Weights on Hugging Face are Apache 2.0, about 69GB in BF16, and SGLang is the recommended serving path
On Oct 27 Liquid AI released LFM3, a new generation of foundation models built on a tri-hybrid architecture of gated short convolutions, sliding-window attention and global attention, pre-trained on 22T tokens. The first six models all branch from LFM3-1.7B-Base at around 2B parameters, with weights on Hugging Face under the LFM Open License v1.0. Liquid says the text model LFM3-1.7B needs about 1 GB at 4-bit, supports 256K context and beats models several times its size on several agent benchmarks.
Zoom
Key Takeaways
Six models: LFM3-1.7B (text), VL-2B (vision/video), Audio-2B, Omni-2B, plus decision models d1-2B and d1-Omni-2B
Architecture: of 24 layers, 13 gated short convolutions, 5 sliding-window attention (256-token window) and 6 global attention; 22T pre-training tokens
Vendor-reported: LFM3-1.7B scores 43.40 on SWE-bench Verified (OpenCode) vs 41.20 for Qwen3.5-4B and 51.20 for Qwen3.5-9B
Vendor-reported: 38.42 on WebArena-Verified and 41.29 on AutomationBench, both above Qwen3.5-9B (28.94 / 15.10)
A full 128K context needs about 1.6 GB of KV cache; one B300 with SGLang can produce about 3.6B tokens per day (vendor figure)
Shanghai AI Laboratory has moved Atria Dawn from Preview to a full release, with open weights (plus an FP8 build) on Hugging Face under internlm/Atria-Dawn and on ModelScope, MIT licensed. Built on the 744B-parameter MoE GLM-5.2, it targets long-horizon research and engineering agent work; context doubles from the Preview's 256K to 512K and input is text only. The vendor table shows it leading the listed models on AutomationBench, CyberGym and SkillsBench, while still trailing Claude Opus 5 on coding tests such as SWE-bench Pro and Terminal-Bench 2.1 (all vendor-reported).
Zoom
Key Takeaways
512K context, double the Preview's 256K; built on the 744B-parameter MoE GLM-5.2, text input only
