{
  "id": 20734995,
  "title": "Do AI assistants recommend closed places? 12 answers in PlaceBench did",
  "url": "https://urgent.news/2026/11/19/do-ai-assistants-recommend-closed-places-12-answers-in-placebench-did",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-19T10:32:17.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/voygr/do-ai-assistants-recommend-closed-places-12-answers-in-placebench-did-1k60"
  },
  "original_language": "en",
  "account": "In a study conducted by PlaceBench, researchers tested six AI assistants on 150 everyday questions about real places. Out of the 900 first answers generated, 12 directed users to places that either closed, moved, or changed their names. While this doesn't represent the majority of errors, it is an error that becomes apparent only when the user arrives at the destination. To determine if a place is closed, moved, or renamed, researchers referred to public sources such as closure notices, the operator's own list, a license suspension, a dated press report, or Google's \"permanently closed\" indicator. A listing that still indicates the place as open did not override this evidence. When a closed place was the primary recommendation, the answer was usually marked as wrong. However, if it was a backup option or one among several suggestions, it was considered partially correct or a minor error. The cause of AI assistants recommending closed places is unclear, but one possibility is that the assistants rely on outdated listings and web pages that fail to update when a business ceases operations. In fact, out of 400 places checked, approximately one in four closed businesses still appeared as open on Google Maps or lacked a listing altogether. To mitigate this issue, the VOYGR Validate API can be used to check a place's status before recommending it. This API returns whether a business is open, closed, unknown, or does not exist, along with a confidence score. By using this tool, assistants can make more informed recommendations and improve the overall user experience.",
  "summary": "In PlaceBench, our test of six AI assistants on 150 everyday questions about real places, 12 answers sent the user to a place that a public source showed had closed, moved or changed its name. That's 12 out of 900 first answers, so it isn't most of the errors. But it's the error you only find out about when you're standing at the door. How we counted a place as closed We only counted a place as…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}