Urgent.News

What's breaking now, across thousands of outlets.

More in Tech

Your evals pass. That doesn't mean they work.

Last week I wrote about tracelint , a linter that catches structural bugs in agent traces — the classic one being an agent that calls charge_card , gets a failure back, and just...

  • Muteval tool identifies gaps in evaluation suites by injecting errors.
  • Green eval run only confirms current tests passed, not future regressions.
  • Mutation testing and deterministic trace checking complement each other.

More from Monday 24 August →