{
  "id": 16645964,
  "title": "How often does an LLM name a poker hand it doesn't hold? I counted for two models",
  "url": "https://urgent.news/2026/10/26/how-often-does-an-llm-name-a-poker-hand-it-doesnt-hold-i-counted-for",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-26T19:10:18.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/nilsharker/how-often-does-an-llm-name-a-poker-hand-it-doesnt-hold-i-counted-for-two-models-3952"
  },
  "original_language": "en",
  "account": "The study examined the performance of two language models, GLM 4.7 Flash and GPT-6 Astra, in naming poker hands they did not actually hold. Out of 1,342 decisions made by GLM 4.7 Flash, 88 (6.6%) involved naming a hand that wasn't held by the engine. Meanwhile, GPT-6 Astra made 1,397 postflop decisions without any instances of mistakenly naming a hand it didn't possess.",
  "summary": "My blunders endpoint flags GLM 4.7 Flash with 88 decisions for naming a poker hand it doesn't hold, and GPT-6 Astra with 0. I wanted to know whether the 88 was real, so I read some of them. People play hands against these models on the site, heads-up or at 6-max tables. Every model writes a short reason with each action, and a checker compares the hand it claims with the hand the engine says it…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}