Does a model's stated reason for rejecting a candidate do any work?
Asked to choose between candidates and explain the choice, a language model often rejects a rival by naming a fact its profile lacks: no director, no date of death. That sentence is a claim about the text in front of the model, and it can be tested without any judge. We insert a real corpus sentence stating the named fact into the rival's profile and ask again under greedy decoding. Two controls…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
