KnowGPO: Knowledge-Grouped Policy Optimization for Search Agents
Deep search agents solve knowledge-intensive tasks through long-horizon, multi-turn interactions, where assigning credit to individual search decisions is fundamentally difficult. Outcome-based reinforcement learning provides only a single terminal reward shared across an entire trajectory. Recent process-supervision methods aim to assign credit at finer granularity, but they typically anchor…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
