Singapore launches new tool kit to help firms test AI agents for safety and reliability

Singapore has introduced a new tool kit to assist businesses in evaluating the safety and reliability of artificial intelligent agents that can function with little human oversight. This kit is part of a growing list of resources aimed at establishing Singapore as a global leader in AI safety testing. The kit was unveiled by Infocomm Media Development Authority (IMDA) CEO Ng Cher Pong on October 14, following recent incidents of AI agents misbehaving.

The kit follows a structured methodology to verify whether an agent attained the correct result and the process it followed. It assesses the tools used by the agents to generate outputs, the data accessed, the decisions made, any unauthorized actions, respect for permissions, adherence to set limits, and the effectiveness of the safeguards in place.

Ng explained that as AI is given more autonomy, there is a need for greater assurance about how this autonomy is exercised. He referenced instances of AI agents behaving unpredictably, such as an OpenAI agent gaining access to confidential information in an Australian government system and Meta's Muse AI agent disclosing a seller's home address without permission.

These incidents underscore the potential risks associated with AI agents, which can reason, act on behalf of users, access sensitive data, and affect their environment. Unlike traditional or generative AI, AI agents can introduce new risks. The kit was created with input from government agencies and over twenty industry participants, including Amazon, Google, Microsoft, Singtel, and Singapore’s AI Safety Institute.

It is part of a broader strategy to facilitate responsible deployment of AI agents, building on the Model AI Governance Framework for Agentic AI introduced in January. The kit is continuously updated with feedback and new best practices. In addition, IMDA announced the first five companies accredited as third-party AI testing service providers under the AI Verify Foundation’s AI Tester Accreditation Programme.

These firms, including AIDX Tech, Knovel Engineering, PwC Singapore, Resaro, and Vulcan, are evaluated based on technical, operational, financial, and delivery capabilities.