Better Answers, Weaker Evidence Control: Evidence Bypass in On-Policy Distillation
On-policy distillation (OPD) can improve answer accuracy while weakening responsiveness to supporting evidence. We investigate this separation in scientific-document question answering through matched document interventions that change the supported answer while preserving the question and unrelated context. We identify evidence bypass: a student retains an originally correct answer after the…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
