VASPO: Self-Distillation with Privileged Value Estimation
On-policy self-distillation provides dense supervision for reasoning models via a privileged self-teacher. However, this supervision reflects local token preferences rather than the expected return of an unguided student continuation. Recent methods combine this signal with GRPO. They use GRPO for update directions and the teacher for signal scaling. However, we demonstrate a more effective…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
