Benchmark1d ago
OpenAI Introduces LifeVal, a Benchmark for Everyday Life Tasks Built From Time-Use Studies and a 3,995-Person Survey
On November 2 OpenAI published LifeVal, an evaluation of whether AI can actually get everyday tasks done for ordinary people, such as finding childcare, accessing government services, budgeting, ordering groceries and adapting recipes. The task list draws on the American Time Use Survey, the Multinational Time Use Study and a new demographically representative OpenAI survey of 3,995 people. OpenAI says it has used LifeVal for the past year to track and improve its models, and it lists several best recorded GPT-6 Astra task scores, many at 100%. All scores are vendor-reported and have not been independently reproduced.
Benchmark20d ago
Artificial Analysis launches AA-Robotics v0.1: coding agents drive a real robot arm, GPT-6 Astra leads at 69.4
Artificial Analysis released AA-Robotics v0.1 on 2026-10-14, a research preview in which frontier models running inside coding-agent harnesses (Codex, Claude Code, Antigravity) control a 6-axis robot arm over an HTTP API across eight tabletop tasks. GPT-6 Astra scores 69.4, ahead of GPT-6.1 Sol (64.6), Gemini 4 Argon (55.3), Claude Opus 5.5 (48.8) and Claude Fable 5.1 (46.3). Models take about 30 minutes per task versus roughly 20 seconds for a human.
Benchmark12d ago
Artificial Analysis Releases HealthBench & MLCR-AA: Exposing Severe Verbosity Bias in Medical AI Rankings
Independent AI evaluation platform Artificial Analysis officially released HealthBench Professional alongside the length-normalized MLCR-AA index (@ArtificialAnlys). The benchmark revealed a pervasive industry blindspot: LLM-as-a-Judge evaluations suffer from acute 'verbosity bias', disproportionately rewarding longer generations regardless of medical conciseness. In raw HealthBench scoring where Anthropic outputs were 4–6x longer, Claude Opus 5.5 led at 71.4%. However, once length bias was scientifically normalized via MLCR-AA, GPT-6 Astra (max) tied Claude Sonnet 5.5 for #1, while Claude Opus 5.5 plummeted from #1 down to #6, setting a new rigorous standard for medical model evaluation.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.