Urgent.News

What's breaking now, across thousands of outlets.

AI

I Tried to Prompt-Inject My Own Agent Engine. It Didn't Work. Here's Why.

This is article 5 in a series about building PlannerCritic , an open-source engine where one LLM writes a plan and a second LLM reviews it. Article 1 covers the 157-goal field test. Article 2 is about the critic severity bug. Article 3 is about the planner capability gap. Article 4 is about field test engineering. This one is about what happened when I tried to break my own engine — and what I…

In this article, the author explores why their open-source engine, PlannerCritic, successfully blocked various adversarial prompt-injection attempts. The engine consists of three layers that make direct injection structurally difficult: deterministic gates, the critic evaluating structure rather than intent, and fail-closed abort paths. These mechanisms ensure that even hand-crafted adversarial goals and real-world vulnerabilities, such as those from the SWE-bench security oracle, are blocked.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

Steal This Exam. Here's How to Port It to Your Own Pipeline.

So far this series has been about giving my order-reading LLM an exam . Some of you have been reading it thinking: "Mine isn't orders, it's meeting-minutes summarization." "I'm using it for email…

  • Identify critical consequences that cannot be reversed if AI makes a mistake.
  • Create a grading table with severity increasing from fatal to harmless consequences.

More from Tuesday 25 August →