Hallucination Neurons and Where to Find Them: An Investigation into the existence of Hallucination Neurons
Interpretable machine learning for Large Language Models (LLMs) increasingly relies on sparse probing methods that identify small sets of neurons claimed to detect and causally influence behaviors such as factuality recall, safety alignment, and hallucination. These claims have important implications for model auditing and behavioral steering, yet they are rarely tested against known failure…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.