Attention-Path Fragility as an Uncertainty Signal in Large Language Models
We propose that a model's uncertainty about a token is reflected not only in the breadth of its output distribution but also in whether a confident prediction is \emph{fragile} under perturbation of its attention pathways. We instantiate this as ASMI (Attention-Subnetwork Mutual Information), a training-free estimator that masks attention heads and measures the BALD mutual information among the…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
