Urgent.News

What's breaking now, across thousands of outlets.

Editions

AI

Your AI Agent Returned HTTP 200. Why Did the Workflow Still Fail?

A successful HTTP response is not a successful agent run. A recent practitioner report from a 58-day deployment of 78 agents recorded 6,768 failed outputs. The failures were not transport errors: every one returned HTTP 200, had plausible length, and looked fluent. The most expensive failures were boring shape mismatches: missing required fields, wrong language, forbidden phrases, or an answer…

The article discusses the importance of treating the model response as untrusted data and validating the contract at the boundary before downstream stages can consume it. The author shares a failure lab that demonstrates how a seemingly successful HTTP 200 response can still lead to workflow failures. The failures are often due to boring shape mismatches, such as missing required fields, wrong language, forbidden phrases, or an answer for a different stage.

The solution is to build a contract gate that performs deterministic checks without asking an LLM to judge another LLM. This gate should return structured evidence, not just true or false, and record why the contract was not satisfied. Storing detailed information about the failure allows for debugging drift and makes the failure repairable instead of turning it into a green dashboard with a missing deliverable.

Brief written by urgent.news from Dev.to's own syndicated text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

Pi Agent vs OpenCode after 100+ Hours of Real Use ✌️

Open-source coding agents had a weird start to 2026. In January, Anthropic suddenly blocked third-party tools from using Claude subscriptions. Overnight, with no warning. OpenCode got hit the hardest.

  • Pi Agent achieved 21/30 task success rate with 362.9 seconds median completion time
  • OpenCode completed 19/30 tasks with 280.6 seconds median completion time
  • Pi Agent edges OpenCode in efficiency, hackability, and raw results

[$] Considering the OpenMDW license

The open-source world has been struggling for a few years now to understand how to approach large language models (LLMs) and the licensing applied to them.

More from Friday 21 August →