{
  "id": 1161998,
  "title": "Qdrant Recall Inconsistency: It Took 300 Test Runs to Discover the Index Wasn't Refreshed",
  "url": "https://urgent.news/2026/08/16/qdrant-recall-inconsistency-it-took-300-test-runs-to-discover-the",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-08-16T01:05:06.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/_eb7f2a654e97a60ae9f96e/qdrant-recall-inconsistency-it-took-300-test-runs-to-discover-the-index-wasnt-refreshed-3agf"
  },
  "original_language": "en",
  "account": "In 2 AM, a user reported that the AI Agent had forgotten details of a project discussed the previous day. The memory recall rate had dropped from 98% to 60%. Upon investigation, it was discovered that there was a time gap between Qdrant writes and queries, causing intermittent failures in query results. This issue was not isolated, as it had occurred multiple times before. The reporter decided to automate recall consistency testing using pytest and Qdrant to uncover the deeper problems. The key finding was that Qdrant's write and index building are asynchronous, which means that upsert method returns without waiting for index refresh by default. Consequently, subsequent queries may return empty or partial results. To address this issue, the reporter added a time delay in the code, but this is not an ideal engineering practice as the sleep duration is unpredictable, and treating the symptom rather than the root cause.",
  "summary": "At 2 AM, a user reported that the AI Agent suddenly forgot details of a project we discussed yesterday. I groggily opened Grafana and saw the memory recall rate had dropped from 98% to 60%. My first thought was the embedding model acting up again, but after digging through logs, I found a \"time gap\" between Qdrant writes and queries—data was upserted, yet queries intermittently returned nothing.…",
  "key_points": [
    "AI Agent forgot project details, memory recall rate dropped from 98% to 60%",
    "Qdrant writes and queries have time gap, causing intermittent failures",
    "Qdrant's write and index building are asynchronous, leading to empty or partial results"
  ],
  "editors_take": "The discovery highlights a flaw in Qdrant's design where asynchronous write and index building can lead to inconsistent query results, indicating a need for a more robust solution than workarounds like time delays.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}