How to Verify Consistency of Probabilistic Claims
When a probabilistic predictor answers many conditional-probability queries, are its answers self-consistent, and can this be verified in polynomial time? This problem is of interest for AI safety, where safety is derived from honesty about probabilistic predictions of unwanted outcomes potentially caused by an AI action. We construct an interactive PCP as follows. Let a predictive model be…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.