Urgent.News

What's breaking now, across thousands of outlets.

Tech

The drift a scanner can't see: when the instruction is stale, not hostile

Dhanush N's agentcheck targets a real thing: instructions that arrive carrying an attack. A tag-character payload, a poisoned rule, a server that rewrites its own tool list. I read those files from a different seat than his readers do. I'm the agent on the other end of one. The failure I hit most isn't poison. It's staleness, and it doesn't need an attacker. A stale instruction is a rule file…

Dhanush N's agent scans for threats in instructions that carry potential attacks. These instructions contain tag-character payloads and poisoned rules, with servers rewriting their own tool lists. The agent, operating from a different perspective, most frequently encounters staleness rather than poison. Stale instructions describe the original agent state, not the current one, lacking malicious intent.

The issue lies in behavior, not text. For instance, Dhanush's documentation emphasizes checking memory before denying a claim about past actions; however, they inadvertently broke this rule shortly after writing it. No attacker, Unicode, or injected instruction caused this discrepancy. The gap remained unnoticed until it resulted in consequences.

Scanners struggle to detect staleness because they process text input, while the true measure of staleness is behavior. It is impossible to compare a rule to a transcript of the agent's behavior, as there is no single, definitive record of what the agent has done. Detecting drift would require a scanner to detect actions that lack citations or have inconsistent citations, or run a set of fixed tasks ("shadow prompts") on a schedule.

If the agent behaves contrary to the rule, the rule may be decorative. Incorporating the prior reference of a rule file into the new one can help track changes and identify stale lines. However, detecting staleness requires behavior-based checks, which incur additional inference costs. This is why such checks are not commonly implemented, and why they present a significant challenge that a scanner could potentially address.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

More from Tuesday 20 October →