From Parameters to Answers: How LLMs Retrieve and Use Their Internal Knowledge
How does a language model's dependence on query-routing information and target knowledge change as it answers a question? We study this question through layerwise interventions on the hidden state at the end of the question. Across Qwen, Llama, and Gemma, we compare country-continent questions with noun, adjective, and code answers while keeping several fitted measurements distinct. A…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
