Wrong Prediction, Right Answer: Recovering Evidence from Collapsed LLM Sequence Scores
When a large language model fails a reasoning task, it is often assumed to lack the underlying capability. However, this conflates a genuine absence of reasoning with a late-stage output bottleneck. We observe a consistent readout gap across diverse reasoning benchmarks: hidden-state probes successfully decode correct answers even when native sequence scoring completely collapses due to…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
