Urgent.News

What's breaking now, across thousands of outlets.

AI

Agents expose the limitations of trust

Enterprise computing has long depended on chains of trust. Organizations trust their cloud providers, software vendors, identity systems and administrators to operate as designed. That model has worked because humans have remained the ultimate decision-makers. Agentic artificial intelligence changes that equation. Autonomous systems can retrieve information, make decisions, invoke external tools,…

Agents expose the limitations of trust

The emerging era of autonomous artificial intelligence systems is reshaping the foundations of enterprise computing. No longer can organizations simply depend on the traditional chain of trust placed in cloud providers, software vendors, and identity systems. As AI agents gain the ability to retrieve information, make decisions, execute actions on behalf of enterprises, and collaborate with other agents, the question shifts from whether AI can accomplish complex tasks to whether those actions can be independently verified.

Traditional cybersecurity measures such as identity management, endpoint protection, and monitoring remain essential, but they alone cannot establish the full chain of instructions, inputs, decisions, and actions that lead to an AI agent's outcomes. To ensure confidence in autonomous computing, enterprise leaders must focus on evidence that can be independently verified, rather than solely trusting the vendor, infrastructure, or software.

The transition to verifiable computing requires organizations to identify which actions require higher standards of auditability based on the potential financial, operational, security, or regulatory consequences. By defining the behavior that needs to be auditable, organizations can establish a baseline against which the agent's actual behavior can be evaluated. For consequential actions, such as approving a payment or accessing regulated data, a higher standard of evidence is necessary.

To reconstruct the chain of events, organizations must determine what evidence is needed to link the original intent to the agent's behavior. This includes the information the agent was instructed or authorized to access, the tools it invoked, the decisions or actions it took, and the resulting outcome. The audit record should capture the initiating user or system, policies and permissions, communications with other agents, external service calls, approval events, and any changes made to enterprise systems.

Maintaining this evidence across systems is crucial, as agents rarely operate in isolation. An audit trail that stops at the application level may miss critical parts of the chain, such as information drawn from a database, instructions received from a user, tasks delegated to other agents, and external service calls. Each consequential workflow should have a consistent, traceable identity connecting the original request to subsequent delegations, approvals, and outcomes.

Finally, organizations must assess the trustworthiness of the evidence itself. This is especially important when an action crosses system or organizational boundaries, as responsibility may no longer be clearly defined. By focusing on verifiable computing and establishing a foundation for confidence through independent verification, enterprises can adapt to the new era of autonomous computing while maintaining robust cybersecurity practices.

Written by urgent.news from SiliconANGLE's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at siliconangle.com →

More in AI

More from Friday 25 September →