METR: Anthropic redacted much of the "most informative" evidence from METR's 100-page report, so readers "must rely on our judgment more than we consider ideal" (@metr_evals)
We submitted a ~100-page full report on our assessment to Anthropic. For the public version, Anthropic redacted a majority of the evidence we found most informative. As a consequence, the public must rely on our judgment more than we consider ideal.
We haven't written up this one. Techmeme has the full story — the link below goes straight to it.
Also reported by 2 other outlets
- METR: Anthropic's models are improving about twice as fast as they did between March 2024 and October 2025, with internal AI use driving ~80% of acceleration (Tiffany Li/The Information) theinformation.com
- Anthropic's models improving nearly twice as fast with help from AI, study finds channelnewsasia.com
