Tracing the Scientific Discovery Capacity of LLMs to Their Training Data
Large language models (LLMs) show growing promise for scientific discovery, yet basic questions remain about what enables reliable discovery. How can we trace the scientific discovery capacity of LLMs to their training data? We study this question as one of missing probability mass and develop a theoretical account in which monofacts-the facts observed once during training-set the discovery…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
