{
  "id": 17824692,
  "title": "12% of the Economy: The Benchmark That Grades AI Agents Like Employees",
  "url": "https://urgent.news/2026/11/02/12-of-the-economy-the-benchmark-that-grades-ai-agents-like-employees",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-02T16:55:14.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/danielsamfdo/12-of-the-economy-the-benchmark-that-grades-ai-agents-like-employees-5f8g"
  },
  "original_language": "en",
  "account": "On November 2, 2026, the research firm SemiAnalysis introduced GDPx, a benchmark that tasks state-of-the-art AI models with performing real-world professional duties within a simulated workplace, for up to eight hours per assignment. Out of the top three performers - Anthropic's Claude Opus 5.5, Google's Gemini 4 Carbon, and OpenAI's GPT-6 Astra - all scored below 12%. The leading open-weight model, GLM 5.3, achieved a mere 2.7%. This 12% figure isn't indicative of models' regression; it signifies that the test has finally become authentic. For years, benchmarks have primarily focused on grading answers. GDPx, however, grades jobs, an entity with characteristics that exams do not. While one can perform well in an exam, it doesn't guarantee successful completion of a task, especially when the desired outcome is wrong, a rule is broken, or crucial files are missing. This article delves into what GDPx measures, why the numbers are significantly low, and what these shortcomings imply for the deployment of AI agents in professional settings.",
  "summary": "On November 2, 2026, the research firm SemiAnalysis published GDPx, a benchmark that asks frontier AI models to do actual professional work — not answer questions about it, but do it, inside a simulated workplace, for up to eight hours per task. The best model in the world, Anthropic's Claude Opus 5.5, finished 12.0% of the tasks. Google's Gemini 4 Carbon came second at 10.9%. OpenAI's GPT-6…",
  "key_points": [
    "GDPx benchmark tests AI models in real-world professional tasks",
    "Top performers like Claude Opus, Gemini, and GPT-6 scored below 12%",
    "GLM 5.3, an open-weight model, achieved only 2.7% in GDPx"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}