Benchmark1d ago
OpenAI Introduces LifeVal, a Benchmark for Everyday Life Tasks Built From Time-Use Studies and a 3,995-Person Survey
On November 2 OpenAI published LifeVal, an evaluation of whether AI can actually get everyday tasks done for ordinary people, such as finding childcare, accessing government services, budgeting, ordering groceries and adapting recipes. The task list draws on the American Time Use Survey, the Multinational Time Use Study and a new demographically representative OpenAI survey of 3,995 people. OpenAI says it has used LifeVal for the past year to track and improve its models, and it lists several best recorded GPT-6 Astra task scores, many at 100%. All scores are vendor-reported and have not been independently reproduced.
Benchmark3d ago
X discussion: is GPT-6 Astra robotics' "GPT-3 moment"? Ex-OpenAI researcher Will Depue says specialized ML got "bitter lessoned"
Over the past day, X has been debating whether GPT-6 Astra can work directly as a robot policy. Former OpenAI researcher Will Depue (whose bio lists Sora 1 and 2 and o3/4o post-training) called Astra beating specialized robotics models "deeply surprising", then described it as "the final death of specialized ML". Investor Freda Duan posted that "Astra IS robotics' GPT-3 moment", drawing about 84K views. Third-party evaluations point both ways: in a RoboDojo paper, Astra averages 22.48% success and ranks above all 40 public policies, while an EBench report puts it at 46.7%, third of nine models. This is a discussion of opinions, not an official OpenAI conclusion.
Benchmark62d ago
Qwen launches E-Commerce Bench: agents run online stores for 365 days with ¥100k
Alibaba Qwen (@Alibaba_Qwen) launched E-Commerce Bench for long-horizon autonomous business ops: agents start with ¥100,000 and run online stores for 365 days in a market driven by real e-commerce data, covering sourcing, negotiation, pricing, promotions, inventory, and cash flow. It includes 6,886 products, 576 suppliers (152 fraudsters), seven-axis scoring, plus open blog, paper, project site, and code.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.