Autonomous generalizability auditing of scientific foundation models
Determining where scientific foundation models generalize beyond their development data is essential for reliable use, but aggregate benchmarks obscure performance limits and rigorous audits are difficult to conduct routinely. Here, we introduce AutoSPECTRA, a coding-agent protocol for systematic generalizability auditing. To inform its design, we reviewed 38 studies across five biological…
We haven't written up this one. bioRxiv has the full story — the link below goes straight to it.
