When uncertainty quantification fails: structural vulnerabilities and corrections for selective prediction under clinical class imbalance
Background. Selective prediction systems improve the safety of clinical artificial intelligence by deferring ambiguous cases to human experts while automating high-confidence decisions. However, this safety mechanism relies entirely on the premise that uncertainty scores accurately reflect clinical ambiguity. In prognostic tasks characterized by severe class imbalance, where the clinical outcome…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.