{
  "id": 278328,
  "title": "Microsoft’s New Testing Agent Tackles the Trust Gap in AI-Generated Code",
  "url": "https://urgent.news/2026/08/07/microsofts-new-testing-agent-tackles-the-trust-gap-in-ai-generated",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-07T19:26:16.000Z",
  "source": {
    "name": "DevOps.com",
    "slug": "devops-com",
    "url": "https://devops.com/microsofts-new-testing-agent-tackles-the-trust-gap-in-ai-generated-code/"
  },
  "original_language": "en",
  "account": "Microsoft has unveiled a new open-source AI agent to improve trust in AI-generated code, specifically for unit testing. This new tool, called code-testing-generator, addresses the issue of developers shipping AI-generated code without proper testing. The agent works by researching the repository, detecting the existing test framework, and studying existing tests to understand local conventions. It then tailors its approach to the size of the task, starting with simple methods and moving to larger ones. During the writing process, the agent tests its own work using mutation testing and checks for weak assertions and coverage gaps. When compared to GitHub Copilot using the same underlying model, the specialized agent achieved a 63% reduction in failures, particularly on vague prompts and larger requests. Microsoft claims this is due to the agent's verification process, which ensures tests catch injected bugs. The agent is currently available as open-source through the GitHub Copilot CLI and supports multiple programming languages, including Python, Go, Java, and Rust. Microsoft plans to further develop this approach for other types of testing in the future.",
  "summary": "Microsoft has unveiled a new open-source agent called code-testing-generator, specifically designed to address the trust gap in AI-generated code. The AI coding assistant, built within the dotnet-test plugin in the dotnet/skills repository, aims to tackle the issue of shallow testing coverage often seen in AI-written code. By starting with research on the repository, detecting the language, test framework, and existing tests, the agent tailors its approach to the size of the task at hand. It writes tests incrementally, from simple code to more complex dependencies, running them as it goes to ensure they compile and pass. The agent also includes mutation testing and verification of weak assertions, checking that the tests catch expected code changes and that all requested scenarios have matching tests. Microsoft has benchmarked the agent against GitHub Copilot using the same underlying model, with the specialized agent completing 92.1% of tasks compared to 78.9% for stock Copilot. The agent's performance was particularly strong on vague prompts and when provided with specific code diffs, passing all test cases while Copilot failed to pass any.",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}