World Models Need Not Be Right to Rank Policies Right: Relative Bounds and Audit Limits
Selecting a reinforcement-learning (RL) policy usually requires additional environment interaction, while learned world models offer cheap but potentially biased evaluations. This raises two distinct questions: can shared model errors preserve pairwise rankings despite poor absolute values, and do they make a small number of real audits more informative? We derive an exact pairwise simulation…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.