FrontierMat: Benchmarking Language Models at the Frontier of Materials R&D
To accelerate materials discovery, language models must be able to address problems at the research frontier. Yet textbook- and examination-derived benchmarks primarily assess established knowledge, leaving performance on frontier research problems largely untested. We introduce FrontierMat, a benchmark of 330 problems drawn from frontier academic and industrial research in fields including…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.