{
  "id": 17024772,
  "title": "AI dominates human peer reviews",
  "url": "https://urgent.news/2026/10/29/ai-dominates-human-peer-reviews",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-29T07:13:03.000Z",
  "source": {
    "name": "Marginal Revolution",
    "slug": "marginal-revolution",
    "url": "https://marginalrevolution.com/marginalrevolution/2026/10/ai-dominates-human-peer-reviews.html"
  },
  "original_language": "en",
  "account": "An AI has demonstrated that its generated article reviews are now superior to those written by compensated human experts, according to a recent study. The AI's reviews were found to be of unusually high quality, as judged by journal editors and authors. This finding has sparked concerns and discussions about the implications for journal policies, publication speed, and overall experience for various stakeholders. Gary King and Steven Worthington utilized Claude Opus 4.8, not the top-of-the-line models, to conduct their research. The results are striking, with the AI's reviews consistently outperforming those of human experts. Despite the AI's performance, some individuals are expressing dissatisfaction and questioning the significance of the study. However, the AI's ability to analyze and critique papers with greater speed and accuracy has raised concerns about potential downsides. The study also found that the errors in the AI-generated reviews tend to align with the authors' ideological stance, a finding that aligns with previous insights from human analysts. To address these concerns, the authors have taken steps to facilitate AI analysis of their work on the MR archive. The researchers encourage various institutions, such as the NSF, prize committees, universities, and tenure committees, to explore AI-enabled audits. While the world has not yet fully embraced this opportunity, the potential benefits of AI in enhancing the publication process and advancing scientific research are evident.",
  "summary": "We show that AI-generated article reviews are now better, by every measure we could construct, than reviews written by well-compensated human experts and judged to be of unusually high quality by journal editors and authors. We then discuss how this result may inform journal policy choices, with concerning downsides as well as potential paths to […] The post AI dominates human peer reviews…",
  "key_points": [
    "AI-generated article reviews outperform human experts",
    "Study conducted by Gary King and Steven Worthington",
    "Errors in AI reviews align with authors' ideological stance"
  ],
  "editors_take": "The superior quality and speed of automated critiques signal a shift toward AI-enabled audits that could fundamentally reshape how academic institutions and journals validate scientific research.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}