{
  "id": 3808854,
  "title": "Float Bloat: vector serialization gone wrong",
  "url": "https://urgent.news/2026/08/27/float-bloat-vector-serialization-gone-wrong",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-08-27T17:12:50.000Z",
  "source": {
    "name": "Lobsters",
    "slug": "lobsters",
    "url": "https://bonsai.io/blog/float-bloat/"
  },
  "original_language": "en",
  "account": "Bonsai has uncovered a widespread issue with vector search across the entire ecosystem, affecting millions of implementations. This problem is present in official vendor SDKs, documentation, tutorials, and articles, with many clients casting and serializing vectors as float64 instead of the default float32. This results in a two-fold precision increase, doubling disk and network costs without adding any accuracy. Bonsai estimates that this unnecessary disk storage overhead could be over 20 Petabytes globally.\n\nThe issue arises when a vector from a model, embeddings API, or inference provider is cast and serialized to float64. This side effect of floating point conversion, known as widening, adds meaningless digits that take up storage space and bandwidth. The problem is prevalent across various tiers of vector search clusters, from sandbox to enterprise levels. It is also found in the main branch of popular embedding vendor SDKs and in the public documentation of large cloud companies.\n\nThe problem is not intentional but is the default behavior in several popular languages used for vector search. To fix the issue, the cast must be done explicitly, or the up-cast to float64 must be deleted, allowing the native encoder to see the original float32. Every fix is lossless and can significantly reduce the unnecessary overhead. Bonsai has released a new agent skill, bonsai-fix-float-bloat, to help find and fix this problem.",
  "summary": null,
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}