Developer 3s Key Decision Metrics
On 2026-10-01 AWS Strands Labs released Strands Decider 2B (strands-labs/strands-decider, Apache-2.0; weights HF hobson-v19): LM head replaced by an option-scoring head. JevBench public 167/231 ≈72.3%, Brier ~0.35; ~115ms median on RTX 3090. pip install strands-decider for routing, tool choice, and before_tool_call gates.
Key Takeaways
- ✓Blog 2026-10-01; github.com/strands-labs/strands-decider Apache-2.0 (~140★); HF StrandsAgents/strands-decider-2B-hobson-v19
- ✓Arch: Qwen3.5-2B + LoRA r16 + ~1M pointer head; noul/choice/score + confidence (no free text)
- ✓JevBench public 167/231 (~72.3%), Brier ~0.348; 3rd of 33 in 2B class per authors
- ✓Latency ~115ms median RTX 3090; ~153ms small tasks on M3 MacBook
- ✓Try: pip install strands-decider; ask/serve; wire into Strands before_tool_call interventions
Finished reading? Explore benchmark rankings & pricing
Real-world SWE-bench scores & $20/mo vs API cost break-even calculator
Project Links & Resources
Direct AccessIn-Depth Technical Analysis
Core Background & Industry Pain Points
Many agent steps are finite-choice decisions—routing, tool gating, groundedness—where full LLMs are slow/expensive and lack calibrated confidence. After TypeSafe Jev spotlighted decision/system-one models, AWS Strands Labs released Strands Decider 2B on 2026-10-01 for fast local experimentation and harness gates.
Architecture Highlights & Internals
Starts from Qwen3.5-2B, removes the LM head, adds a ~1M-parameter pointer head scoring option hidden states vs the answer position; torso uses rank-16 LoRA. Primitives: noul/choice/score with confidence. Code: github.com/strands-labs/strands-decider (Apache-2.0); checkpoint HF hobson-v19. Fits Strands before_tool_call interventions (Proceed/Deny/Confirm/Guide).
Authoritative Benchmarks & Measured Scores
Author-reported only: JevBench public 167/231 (~72.3%), Brier ~0.348; ~115ms median on RTX 3090; ~153ms small tasks on M3. Limitations: weak on long multi-step docs; question paraphrases may not flip answers; recalibrate thresholds on your traffic.
Developer Hands-on Guide
pip install strands-decider; ask/serve locally; load StrandsDeciderModel in Python; wire hybrid agents that leave hard calls to LLMs.

Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.