{
  "id": 1207205,
  "title": "How do you unit test an agent skill?",
  "url": "https://urgent.news/2026/08/16/how-do-you-unit-test-an-agent-skill",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-16T05:18:26.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/danielwaltersdev/how-do-you-unit-test-an-agent-skill-1f82"
  },
  "original_language": "en",
  "account": "Agent skills are not code, but rather prompts that are reviewed on a trust system. To ensure these skills are functioning correctly, tests can be built using skilleval. This tool takes a SKILL.md file, a prompt and a fixture for the agent to use and runs a real agent. The results of the test are then asserted against specific criteria such as cost, activated skills, tools used, tool calls, tool arguments, and the final message. These tests save artefacts so that any changes to the skill can be seen when re-running the test. Running the test multiple times can also provide a pass rate, but this should not stop a skilled individual from pushing changes. The goal is to have a result.json file that proves the skill is making fewer mistakes. This is one way to test agent skills and the author is open to hearing about other methods.",
  "summary": "Agent skills are prompts, not code, and there’s no compiler to catch a broken one. Agent skills ship on the honour system. You rewrite one, run it twice, post something convincing in Slack, and that’s the review. Is it faster? More reliable? Going to cost more? This isn’t a strategy. This is astrology for prompts. That bugged me. Not because I thought people didn’t know what they were talking…",
  "key_points": [
    "Agent skills are prompts reviewed on a trust system, not code.",
    "skilleval tool runs a real agent with SKILL.md file, prompt, and fixture.",
    "Tests assert results against criteria like cost, activated skills, and final message."
  ],
  "editors_take": "This approach to testing agent skills shifts quality assurance from a manual process to an automated one, allowing for quicker iteration and more reliable assessment of skill performance.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}