{
  "id": 20497686,
  "title": "Cut generative AI costs: Code for rules, models for judgment",
  "url": "https://urgent.news/2026/11/17/cut-generative-ai-costs-code-for-rules-models-for-judgment",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-17T21:14:55.000Z",
  "source": {
    "name": "AWS Machine Learning",
    "slug": "aws-machine-learning",
    "url": "https://aws.amazon.com/blogs/machine-learning/cut-generative-ai-costs-code-for-rules-models-for-judgment/"
  },
  "original_language": "en",
  "account": "The article titled \"Cut generative AI costs: Code for rules, models for judgment\" discusses the significant expense of generative AI systems, particularly the cost of calling large language models (LLMs) for every task, even small ones. It argues that skipping LLMs for tasks that can be handled by deterministic rules saves money, reduces latency, and enhances reliability. The article introduces a decision flowchart to determine whether each workflow step requires a model or can be handled by a rule. The three questions in the flowchart are: Can the step be checked with a rule? Can the step be simplified to a model writing the rule once? If neither is true, the step should be run on a right-sized model. Examples of steps that can be checked with a rule include validating an order number's format, while routing a message by intent, extracting a tracking number from an email, and drafting a reply to a customer are better suited for a model. The article emphasizes the importance of deciding whether a step needs a model before selecting the appropriate model, as unneeded model calls can lead to increased costs, longer latency, and varied outputs.",
  "summary": "The biggest cost lever in a generative AI system is whether you call a model at all. Learn how to decide whether each workflow step needs a model, and map each option to AWS: deterministic code, a constrained decision call, or a right-sized model on Amazon Bedrock.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 2,
    "also_reported_by": [
      {
        "outlet": "Techmeme",
        "title": "Microsoft unveils six AI models spanning coding, cybersecurity, images, and voice, saying MAI Code 2 has 98% of GPT-6.1 Sol's performance at 40% of the price (Ina Fried/Axios)",
        "url": "https://urgent.news/2026/11/17/microsoft-unveils-six-ai-models-spanning-coding-cybersecurity-images",
        "published": "2026-11-17T18:25:02.000Z"
      }
    ]
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}