{
  "id": 7942561,
  "title": "I Let AI Plan 170 Changes. It Made the Same 3 Mistakes Every Time.",
  "url": "https://urgent.news/2026/09/17/i-let-ai-plan-170-changes-it-made-the-same-3-mistakes-every-time",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-17T03:59:17.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/debashish_ghosal/i-let-ai-plan-170-changes-it-made-the-same-3-mistakes-every-time-33ne"
  },
  "original_language": "en",
  "account": "I ran 170 change-planning goals across 40 domains, including identity management, multi-agent operations, SRE, supply chain policy, and FinOps. Using PlannerCritic, an LLM writes a plan, a second LLM reviews it, and deterministic gates decide whether it can move forward. The cost was $0.49. The result was not that the model is bad, but rather a structural failure in planning, with three recurring mistakes: unverified dependencies, unsafe sequencing, and weak rollback. These defects were not random or occasional, but rather three families of problems. Unverified dependencies occurred 57 times, with tasks declaring something must be true without ensuring it is true beforehand. Unsafe sequencing happened 46 times, with steps ordered before their prerequisites. Weak rollback happened 18 times, with high-blast-radius steps having rollback mechanisms that don't actually undo anything. The 3 main defects were unverified dependencies, unsafe sequencing, and weak rollback. A bigger model didn't help, indicating it was a planning-structure problem, not a parameters problem. A revision loop was designed to converge, but the planner tended to fix one blocker and introduce another, failing to close dependency gaps or enforce ordering. A higher-leverage change was a precondition closer, a deterministic linter that verifies every precondition maps to an earlier task. This eliminated 48% of the blockers without asking the model to get smarter.",
  "summary": "Everyone is arguing about which model plans best. I ran 170 goals and found out the model was never the variable. The plan was. I built a small engine called PlannerCritic : one LLM writes a plan, a second LLM reviews it, and a set of deterministic gates decides whether it's allowed to move forward. Then I pointed it at 170 real change-planning goals across 40 domains, including identity…",
  "key_points": [],
  "editors_take": "The experiment reveals a fundamental flaw in AI-powered change planning, where structural defects in planning, specifically unverified dependencies, unsafe sequencing, and weak rollback, persist despite model size or revision attempts.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}