{
  "id": 16170625,
  "title": "Stop Asking One Model to Do Everything: A Four-Layer Pattern for AI Workflows",
  "url": "https://urgent.news/2026/10/23/stop-asking-one-model-to-do-everything-a-four-layer-pattern-for-ai",
  "topic": "ai",
  "section": "AI",
  "published": "2026-10-23T09:48:31.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/shizhe_lim_61b5948cb8081d/stop-asking-one-model-to-do-everything-a-four-layer-pattern-for-ai-workflows-3cjh"
  },
  "original_language": "en",
  "account": "OpenAI released its Decisions API this week, marking a shift in how AI tasks can be structured. The key takeaway is that not all AI work requires the same general-purpose model. Instead, an AI workflow can be divided into four distinct layers, each optimized for specific types of inference.\n\nThe first layer focuses on deterministic rules for hard constraints. Decisions that must always produce the same result, such as permissions, spending limits, and security policies, should be handled by conventional application logic rather than probabilistic inference. While a model can help identify relevant context, it should not override these non-negotiable rules. If a condition must consistently yield the same outcome, it's best to implement it using standard code.\n\nThe second layer deals with bounded models for repetitive judgments. This includes tasks like classification, prioritization, routing, and scoring, which differ from open-ended generation. The output from these bounded decision layers—such as probabilities, selections from a predefined set, or scores against a rubric—is easier to validate and consume by other parts of the application. However, validation is still necessary. Probabilities aren't inherently well-calibrated, so confidence thresholds should be derived from representative application data rather than set arbitrarily.\n\nThe third layer is dedicated to generative models for open-ended work. This is where generative models are most effective, such as drafting explanations, synthesizing documents, writing code, or planning multi-step tasks. The aim isn't to avoid larger models altogether, but rather to reserve them for tasks where their broader capabilities add value. A streamlined workflow might involve checking if a request violates a hard policy (in which case it's blocked or escalated), classifying and routing the decision, or using a selected model for the task when the decision is low-confidence or high-impact.\n\nLastly, there's a human-review path built into the architecture. This is crucial for decisions with significant consequences, such as irreversible actions, those affecting others, accessing sensitive data, or those outside the scope of test evaluations. Human review ensures accountability and accuracy in such critical scenarios.\n\nWhen evaluating this architectural approach, it's important to consider more than just the raw model accuracy. Key metrics include decision calibration, end-to-end latency, cost per successfully completed workflow, escalation and fallback rates, performance drift over time, and the ability to audit each decision. The overarching lesson is that the choice of model should be guided by the specific type of inference required at each step, rather than by a one-size-fits-all approach.",
  "summary": "OpenAI’s Decisions API became generally available this week. The interesting part is not simply that there is another API endpoint. It is the architectural distinction the release makes explicit: Some AI tasks need generation. Many only need a bounded decision. Asking the same general-purpose model to classify a request, select an action, draft a response, and approve the result may be convenient…",
  "key_points": [
    "Hard constraints handled by conventional logic in first layer, not probabilistic inference.",
    "Validation needed for bounded decision layer outputs like probabilities and scores."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}