Release2d ago
Anthropic's Amended S-1 Says Future Models May Imminently Meet Its RSP Threshold for Dramatically Accelerated AI Progress
On November 2 Anthropic filed Amendment No. 1 to its S-1 with the SEC, adding a risk disclosure: based on internal estimates and expectations about future models, not current ones, the company may imminently meet its Responsible Scaling Policy definition of dramatically accelerated progress attributable to AI. No current model has been designated as exceeding the threshold. Anthropic says it is evaluating the implications of meeting the AI R&D capability threshold, is considering RSP updates that would require human review and approval of certain R&D decisions, and does not expect to safely let Claude fully autonomously design and build successive frontier models without meaningful human supervision.
Release4d ago
Anthropic automates red-teaming with thousands of Claude agents: benign-looking beekeeping and wrestling roleplay data slips past a training-data monitor yet makes models misaligned
Anthropic's Alignment Science Blog published research in which many Claude agents iterate in parallel to write fine-tuning data that evades a training-data monitor while making a small research model misaligned. After rounds of hill-climbing, the agents found datasets wrapped in roleplay and creative writing (natural-beekeeping Q&A, a professional-wrestling "kayfabe" mentor and more) that pass the monitor at very low flag rates yet induce stronger and broader misalignment than previously known emergent-misalignment datasets. Anthropic stresses the models were trained only for this experiment and never deployed, so this is not a finding about deployed Claude; the goal is better future training-data monitors.
Tooling3d ago
X discussion: AP reports AI companies are turning to religion to teach chatbots right from wrong, with Anthropic citing talks with 15+ religious and cross-cultural groups
A topic drawing heavy discussion on X: a new Associated Press feature reports that some AI companies are turning to religion as they work out how to teach chatbots right from wrong. On Nov 1 the market-news account unusual_whales relayed the report, noting that Anthropic says it has met with scholars, clergy, philosophers and ethicists from more than 15 religious and cross-cultural groups to help shape how Claude handles moral questions. The post drew about 880 likes, 162K views and 189 replies, and X listed the story among its trending news topics. The Anthropic effort itself is not new: the company described it in an official post on May 19. This is a write-up of the discussion, with opinions presented as opinions.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.