{
  "id": 8328418,
  "title": "The model obeys your schema, not your description",
  "url": "https://urgent.news/2026/09/18/the-model-obeys-your-schema-not-your-description",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-18T22:40:08.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/marc_kumiko/the-model-obeys-your-schema-not-your-description-1cml"
  },
  "original_language": "en",
  "account": "Two models were asked to follow the same prompt and tool description to generate a response. One model returned a pattern with an entity name and definition fields, while the other returned a pattern with just the entity name and fields. The second model's response was rejected by the downstream patcher, causing confusion and wasted time. The issue was traced back to the exposure gap between the models - the \"smarter\" model had seen the shape before and was able to retrieve the necessary memory, while the less trained model guessed based on the description text and produced an incorrect result. The root cause was the lack of a strict schema for the tool, which led to the model guessing the pattern instead of following the prescribed format. To address this issue, the team focused on writing tight schemas for the common pattern kinds, while providing a more permissive fallback for the rare ones. This approach targeted the failures they actually encountered, rather than investing time in creating schemas for every possible shape.",
  "summary": "Two models. Same prompt, same tool description, same request. One of them returned this: { \"kind\" : \"entity\" , \"entityName\" : \"todo\" , \"definition\" : { \"fields\" : { \"title\" : \"text\" } } } The other returned this: { \"kind\" : \"entity\" , \"name\" : \"todo\" , \"fields\" : { \"title\" : \"text\" } } The second one is wrong, and our downstream patcher rejected it with a 422 that told nobody anything useful.…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}