Research22d ago
Last Secure Code Benchmark: Vibe Coding Under Fire as Top Agents Produce Secure Code on Only 25.1% of Tasks
While AI coding agents and 'vibe coding' workflows synthesize an unprecedented volume of production software, code security remains highly fragile. Researchers from NUS and Monash University introduced the Last Secure Code Benchmark, evaluating 450 tasks derived from 150 real CVE vulnerabilities across 7 languages (Java, C, C++, JS, Python, PHP, Go) and 24 CWE categories (including 21 of the 2025 CWE Top 25 and 8 of the Top 10 KEVs). While frontier agents achieve 73.6% to 91.3% functional completion rates, even the strongest model (Claude Fable 5) produces code that is both functional and secure on only 25.1% of tasks, exposing acute supply-chain risks in autonomous vibe coding.
Tooling40d ago
Claude Code 2.1.283: availableModelsMatch/deniedModels controls, gateway prompt-id headers, /doctor prompt-audit
Claude Code v2.1.283 (2026-09-25) adds availableModelsMatch=exact and deniedModels for managed model allow/deny lists, opt-in x-claude-code-prompt-id gateway hint headers, /doctor prompt-audit for CLAUDE.md/skills/agents/commands, plus Bedrock Mantle upstream and load_test_mode on the Apps Gateway. npm @anthropic-ai/claude-code 2.1.283 is live.
Tooling2d ago
X Discussion: Addy Osmani of Claude Code Warns of "Cognitive Surrender" and Urges Developers to Keep Critical Thinking When Agents Do the Work
Addy Osmani (@addyosmani), whose X bio lists Claude Code at Anthropic, posted a long article on X on November 3 titled "Critical thinking when agents do the work." He describes a spectrum of working with AI: cognitive offloading (delegating a task but owning the result), deferral (the tool output becomes your new input), and "cognitive surrender" (the AI output quietly becomes your own and you feel no need to check it), a term he credits to Steven Shaw and Gideon Nave at Wharton. He offers self-check questions and verification habits. Within about three hours the post drew roughly 1,400 likes, 2,400 bookmarks and more than 72,000 views and reached X trending. These are the author's views, not an Anthropic announcement.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.