{
  "id": 13681091,
  "title": "Version-aware question answering over living oncology guidelines",
  "url": "https://urgent.news/2026/10/11/version-aware-question-answering-over-living-oncology-guidelines",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-11T00:00:00.000Z",
  "source": {
    "name": "bioRxiv",
    "slug": "biorxiv",
    "url": "https://www.biorxiv.org/content/10.64898/2026.10.04.756483v1?rss=1"
  },
  "original_language": "en",
  "account": "Living clinical guidelines regularly update their recommendations as new evidence comes to light, leaving AI-generated answers potentially outdated to a specific version of the guideline. To study this issue, we utilized ASCOBench, a dataset containing 288 unique questions spanning 96 three-turn conversations based on versioned American Society of Clinical Oncology (ASCO) breast and prostate cancer guidelines. The dataset also included oncologist-reviewed reference answers for comparison.\n\nOncologists evaluated version-sensitive answers generated by a frontier model, finding that they corrected one in four of these answers, while fewer than one in ten corrected factual answers. Across the entire guideline corpus, 19 recommendations changed between versions, seven of which were reversals, yet only one out of 14 superseded documents explicitly states that it has replaced the previous version.\n\nWhen strong models performed retrieval over several guideline versions, the frequency of stale answers increased fourfold compared to answering without retrieval. SentryLine, a verification-first system, reduced incorrect answers from 9.7-22.9% for baselines to 4.2-5.2% across three models. However, identifying changes in guidelines before they are officially announced remains an open challenge.",
  "summary": "Living clinical guidelines revise recommendations as evidence emerges, so an AI answer can be faithful to a real guideline and still be out of date. Here we examine this failure using ASCOBench, 288 unique questions in 96 three-turn conversations grounded in versioned American Society of Clinical Oncology (ASCO) breast and prostate cancer guidelines, with oncologist-reviewed reference answers.…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}