Release5d ago
Mistral releases the open weights of Mistral Large 4 "Le Chonk": a 1T-total, ~52B-active multimodal MoE that Mistral says leads open models on FrontierCode 2.0
On Oct 29 Mistral released an improved Mistral Large 4 (Le Chonk) with open weights on Hugging Face (plus an NVFP4 quantized checkpoint), served on its API as mistral-large-4. After about three more weeks of reinforcement learning since the early-October preview, Mistral reports 19.7% on FrontierCode 2.0, Terminal-Bench 4.0 up from 28% to 41%, and new low/medium/high reasoning modes. The license is a modified MIT that allows commercial use, but running a model-as-a-service business needs a separate commercial license.
Benchmark16d ago
Tsinghua and Z.AI open-source HarnessPro: agents rewrite their own harness, reaching 80.8% on Terminal-Bench 2 at 34% lower cost per task
HarnessPro (arXiv 2610.26770, submitted Oct 19 and revised Oct 20), from Tsinghua University, Z.AI (Zhipu) and collaborators, is a label-free way to improve an agent harness: specialized agents diagnose execution traces, rewrite instructions and runtime policies, score candidates with LLM-generated tests, and keep Lite, Medium and Heavy harnesses along the performance-cost frontier. Per the paper, with GPT-5.5 and Codex the Heavy mode reaches 80.8% on Terminal-Bench 2, 4.5 points above the prior RHO method, while cost per task drops from $1.09 to $0.72. The code is MIT-licensed and drew wider media coverage this week, including from Pandaily.
Models22d ago
Z.ai introduces GLM-Legal on GLM-5.3-Flash: 19.2% Harvey LAB all-pass (vendor-reported), API by application
On 2026-10-12 Z.ai introduced GLM-Legal, built on GLM-5.3-Flash with legal mid-training and RL across tens of thousands of legal environments, co-trained with its agent harness. Vendor-reported: 19.2% Harvey LAB all-pass (base 6.7%); LegalBench and PLawBench claimed at parity without scores. No open weights; API by application; AutoClaw support coming.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.