DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents
Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural hallucination, in which an agent produces individually fluent and factually plausible utterances while deviating from the intended conversational process. We…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.