GUT: Quantifying and Optimizing the Reasoning Uncertainty of LLMs via Graph Complexity
Recent years have witnessed great advances in the reasoning ability of Large Language Models (LLMs). However, the reasoning processes of LLMs often exhibit uncertainty, where LLMs often produce a proliferation of divergent branches at each reasoning step even when fed the same prompting inputs, and certain branches exhibit evidently incredible, even nonsensical, reasoning chains and results. In…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
