When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control
Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt-only framework that makes answer commitment conditional on an explicit assessment of the information required to answer a question. We evaluate three CoSQ variants under seventeen conditions on the 817-item TruthfulQA multiple-choice validation set…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
