Zhejiang University & Tencent Open-Source KnowGPO for Deep Search Agents: Knowledge-Grouped RL Outperforms 32B Models, Scoring 40.2 on GAIA
Deep search agents struggle with credit assignment across long, noisy retrieved contexts. Zhejiang University and Tencent open-sourced KnowGPO (arXiv:2610.22331, GitHub: ZJU-REAL/KnowGPO), an RL framework that groups search trajectories by atomic knowledge conditions rather than surface observations. Qwen3-8B fine-tuned with KnowGPO achieves 38.8% on BrowseComp-ZH and 40.2% on GAIA, outperforming GRPO/GiGPO baselines and rivaling 32B open-source search systems.

Key Takeaways
- Zhejiang University and Tencent open-sourced KnowGPO (arXiv:2610.22331) for credit assignment in deep search agents
- Replaces surface observation matching with atomic knowledge condition states and within-group incremental knowledge rewards
- Qwen3-8B + KnowGPO scores 38.8% on BrowseComp-ZH and 40.2% on GAIA, outperforming standard GRPO by +5.9 and +5.2 points
- Allows an 8B model to rival and outperform 32B open-source search systems including WebSailor-32B and ASearcher-Web-32B