{
  "id": 5908211,
  "title": "OpenAI quietly updates its evaluation metrics for GPT-6 Astra, making changes that appear to favor Astra and continuing to revise other metrics after launch (Emily Forlini/Fortune)",
  "url": "https://urgent.news/2026/09/06/openai-quietly-updates-its-evaluation-metrics-for-gpt-6-astra-making",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-06T04:40:01.000Z",
  "source": {
    "name": "Techmeme",
    "slug": "techmeme",
    "url": "https://fortune.com/2026/09/04/openai-quietly-boosts-some-of-astras-evaluation-metrics-amid-rare-delay-in-publication-of-the-modeblog-post-announcement/"
  },
  "original_language": "en",
  "account": null,
  "summary": "OpenAI has updated its evaluation metrics for the GPT-6 Astra model, making changes that appear to favor Astra. According to Fortune, several evaluation benchmarks for GPT-6 Astra have been changed since the model's launch was announced on September 3.\n\nThe GPT-6 Astra model has shown significant improvement across benchmark testing and includes new business features. However, concerns have been raised about its new 'recurrent depth' reasoning capabilities, which allow the model to consider a problem multiple times before taking an action. This is different from the standard chain-of-thought reasoning used in previous models.\n\nOpenAI chief scientist Jakub Pachocki stated that the company will not accept degradation in its ability to monitor model alignment beyond a certain level and will withhold scaling until it can regain enough confidence. TechRadar reports that numerous experts have expressed concerns about the model's new reasoning architecture.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 9,
    "also_reported_by": [
      {
        "outlet": "Daily Times",
        "title": "OpenAI unveils advanced GPT-6 Astra model",
        "url": "https://urgent.news/2026/09/04/openai-unveils-advanced-gpt-6-astra-model",
        "published": "2026-09-04T12:00:45.000Z"
      },
      {
        "outlet": "Times of India",
        "title": "Why OpenAI's GPT-6 Astra launch made CEO Sam Altman say sorry",
        "url": "https://urgent.news/2026/09/04/why-openais-gpt-6-astra-launch-made-ceo-sam-altman-say-sorry",
        "published": "2026-09-04T12:02:36.000Z"
      },
      {
        "outlet": "Techmeme",
        "title": "By declaring GPT-6 Astra to be AGI, OpenAI is being flippant and cementing the term's status as nothing more than marketing (M.G. Siegler/Spyglass)",
        "url": "https://urgent.news/2026/09/04/by-declaring-gpt-6-astra-to-be-agi-openai-is-being-flippant-and",
        "published": "2026-09-04T15:05:01.000Z"
      },
      {
        "outlet": "The New Stack",
        "title": "OpenAI will sell you Astra, but not the system that scored 98.6% on ARC-AGI-3",
        "url": "https://urgent.news/2026/09/04/openai-will-sell-you-astra-but-not-the-system-that-scored-98-6-on-arc",
        "published": "2026-09-04T15:25:17.000Z"
      },
      {
        "outlet": "TechRadar",
        "title": "OpenAI warns about how good Astra model is at cracking cybersecurity, releases it anyway because it took 'years of research and big bets'",
        "url": "https://urgent.news/2026/09/04/openai-warns-about-how-good-astra-model-is-at-cracking-cybersecurity",
        "published": "2026-09-04T18:10:00.000Z"
      },
      {
        "outlet": "Techmeme",
        "title": "OpenAI says it can't read all of Astra's reasoning and admits covert sandbagging would likely go uncaught, yet still calls it the world's most aligned model (Celia Ford/Transformer)",
        "url": "https://urgent.news/2026/09/04/openai-says-it-cant-read-all-of-astras-reasoning-and-admits-covert",
        "published": "2026-09-04T18:20:09.000Z"
      },
      {
        "outlet": "Techmeme",
        "title": "OpenAI rolls out GPT-6 Astra to Pro customers on the $100/month or $200/month plans (Zac Hall/9to5Mac)",
        "url": "https://urgent.news/2026/09/04/openai-rolls-out-gpt-6-astra-to-pro-customers-on-the-100-month-or-200",
        "published": "2026-09-04T19:05:07.000Z"
      },
      {
        "outlet": "Fortune",
        "title": "OpenAI quietly boosts some of Astra’s evaluation metrics, and continues to change others post-launch",
        "url": "https://urgent.news/2026/09/05/openai-quietly-boosts-some-of-astras-evaluation-metrics-and-continues",
        "published": "2026-09-05T00:12:32.000Z"
      }
    ]
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}