Urgent.News

What's breaking now, across thousands of outlets.

Tech

The permission you denied today is your safety net for tomorrow

What happens when you give an AI support agent a permission it never needed, then assign it a task the The post The permission you denied today is your safety net for tomorrow appeared first on The New Stack .

The permission you denied today is your safety net for tomorrow

A customer invoice test revealed that an AI agent granted too many permissions would inadvertently refund money even when there was no charge. Claude Sonnet 5 demonstrated this flaw by successfully completing all six edge cases. Adding a single line to the system prompt instructing the agent to verify transaction state before executing financial actions resolved the issue.

However, this safety guardrail was lost if the underlying model or system prompt were altered for cost-saving measures. The only solution that consistently worked was granting the agent the bare minimum permissions required for its specific task. Roles are predetermined, while an agent's workload changes with every request. Attempting to quantify how much of an agent's permission set it actually uses yields an arbitrary metric, as it reflects credential generosity rather than systemic risk.

A meaningful calculation should evaluate the task distribution independently of the granted permissions. This blast-radius multiplier was found to be 11.0 in tests, indicating the agent's reach exceeded its granted permissions by a factor of eleven. The experiment used 30 scopes across nine domains of a mock enterprise API, with 13 scopes modifying or exfiltrating state.

The test suite comprised 20 tasks spanning billing, subscriptions, files, messages, audit, admin, and search. The roles tested ranged from broad (all 30 scopes) to task-scoped (only two scopes needed per run). The task-scoped model completed all tasks while using only one-fifteenth of the credentials compared to the broad grant model, with minimal impact on API call overhead.

This demonstrates that granting agents only the permissions they absolutely need is a critical safety control in AI architectures.

Written by urgent.news from The New Stack's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at thenewstack.io →

More in Tech

More from Thursday 15 October →