Terminal-RSI: Recursive Self-Improving Terminal Agents via Trajectory Self-Rewrite and Critic-Inheriting Policy Refinement Hit 86.52% on Terminal-Bench 2.1
Terminal agents frequently struggle to convert partial command-line progress into complete end-to-end task resolution. Researchers from Tencent AI Lab and NUS introduce Terminal-RSI, alternating Recursive Self-Rewrite (RSR) of verified trajectories with critic-inheriting Recursive Policy-Refine (RPR) alongside Turn-Boundary Skip-Observation GAE (TB-GAE). Evolving Qwen3.8-27B across five stages yields Terminal-RSI-27B, achieving 86.52% on Terminal-Bench 2.1 and 79.00% on Terminal-Bench Hard.
Key Takeaways
- Five-stage recursive self-improvement: alternates verified trajectory Recursive Self-Rewrite (RSR) with critic-inheriting Recursive Policy-Refine (RPR) on Qwen3.8-27B
- Turn-Boundary Skip-Observation GAE (TB-GAE): retains token-specific baselines while decaying strictly across interaction turns rather than verbose shell output logs
- State-of-the-art terminal performance: reaches 86.52% on Terminal-Bench 2.1, 79.00% on Terminal-Bench Hard, and lifts LHTB strict completion from 0/46 to 5/46