{
  "id": 4764175,
  "title": "Numbers Do Not Belong in the Model",
  "url": "https://urgent.news/2026/09/01/numbers-do-not-belong-in-the-model",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-01T01:37:08.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/studiomeyer_io/numbers-do-not-belong-in-the-model-54k5"
  },
  "original_language": "en",
  "account": "When a language model generates a document, it is crucial to understand that numbers require special attention and treatment. Unlike missing numbers, wrong numbers can have significant consequences, as they can be forwarded, quoted, and added to totals without anyone noticing. A single incorrect number can propagate through multiple versions, making it challenging to determine the accurate value.\n\nNumbers pose unique challenges for language models due to their tokenization process. Multi-digit numbers are often split into individual units that may not align with human perception. This discrepancy can lead to errors that are difficult to detect, as they may appear as typographical mistakes or seem innocuous in terms of value. For example, 349,000 could be incorrectly converted to 340,000, which may seem like a simple typo but could have substantial implications in the right context.\n\nThe article argues that treating language models as a viable architecture for extracting numbers from documents is flawed. Instead, it suggests that a valid schema should be established, which guarantees the existence of specific fields and their data types but does not ensure the accuracy of the values. This approach acknowledges that errors in numbers may not always manifest as obvious mistakes, making it essential to be cautious when relying on the model's output.\n\nThe recommended solution involves extracting numbers from the raw document text before involving the language model. This process should be performed using pattern recognition techniques to identify candidates for numerical values. The model is then tasked with assigning the correct figures to their respective fields based on the text and the extracted candidates. While the model's assistance in this step is valuable, particularly for distinguishing between different types of figures, the actual copying of values should be avoided.\n\nTo ensure the reliability of the number extraction process, the article emphasizes the importance of maintaining a fixed source document before the model's involvement. This raw text should be kept intact and handed over as a single version, providing a reliable foundation for comparison and verification. By separating the number assignment from the model's output and incorporating a separate checking layer that operates independently from the model's context, the article aims to mitigate the risk of errors and maintain the integrity of the extracted data.",
  "summary": "A missing number gets noticed. A wrong one does not. That single asymmetry is why reading documents with a language model has to be treated differently from writing text with one. When a model invents a paragraph, someone usually catches it while reading. When it turns 349,000 into 340,000, there is a plausible number, in the right field, in the right format, and nobody has any reason to go look…",
  "key_points": [
    "Numbers in language models require special attention and treatment.",
    "Multi-digit numbers often split into individual units during tokenization.",
    "Recommended solution involves extracting numbers from raw document before model involvement."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}