{
  "id": 20387119,
  "title": "LLM agents lose confidence under noisy retrieval",
  "url": "https://urgent.news/2026/11/17/llm-agents-lose-confidence-under-noisy-retrieval",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-17T06:00:00.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/olaughter/llm-agents-lose-confidence-under-noisy-retrieval-lkk"
  },
  "original_language": "en",
  "account": "Retrieval agents using large language models (LLMs) display an alarming level of confidence in the face of deteriorating source credibility, according to a recent study. Even when evidence cited by these agents is deliberately corrupted, they continue to produce definitive answers in a majority of cases. This phenomenon, known as over‑confidence, persists despite clear cues of low trustworthiness in the retrieved documents. Standard benchmarks typically assume the retrieved passages are correct or at least plausible, measuring success with a simple right-or-wrong score. However, this study reveals that even when documents are labeled as completely untrustworthy, the systems still generate definitive answers in many runs. The researchers note that accuracy remains stable across varying levels of source credibility, with no discernible change in the agents' abstention rate. Performance of specific models like Search‑R1 remains remarkably consistent between 78% and 80% correct throughout the entire spectrum of trustworthiness. While the current study evaluates only synthetic degradations on selected datasets, safety measures recommend enforcing credibility filters that force agents to abstain when retrieved evidence falls below a minimal trust threshold. The paper suggests that future benchmarks should incorporate stress‑testing regimes like DeepStress to better assess the robustness of these systems.",
  "summary": "Even open‑weight retrieval agents keep shouting answers while the evidence they cite falls apart, exposing a systematic over‑confidence that survives obvious credibility warnings. The phenomenon only becomes visible when source documents are deliberately corrupted at scale, something standard benchmarks rarely do. DeepStress makes this failure mode plain [1] . Before this work, most evaluations…",
  "key_points": [
    "Retrieval agents remain confident despite corrupted or untrustworthy sources.",
    "Standard benchmarks assume correct or plausible retrieved passages.",
    "Performance stable across trust levels, with no change in abstention rate."
  ],
  "editors_take": "The inability of retrieval agents to abstain from answering when presented with untrustworthy data exposes a critical flaw in current benchmarks that fail to account for source credibility.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}