{
  "id": 7929187,
  "title": "I measured whether my coding agent follows its rules",
  "url": "https://urgent.news/2026/09/17/i-measured-whether-my-coding-agent-follows-its-rules",
  "topic": "ai",
  "section": "AI",
  "published": "2026-09-17T01:53:23.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/_41cda9e439997374d9a9f/i-measured-whether-my-coding-agent-follows-its-rules-3chi"
  },
  "original_language": "en",
  "account": "During a session, my coding agent repeatedly wrote files using a shell heredoc, which caused issues as the heredoc swallowed a backslash. Three instances of this mistake were noted in the agent's memory, all of which were retrieved and read correctly. The focus of the investigation was on determining whether the agent's actions changed due to the rules implemented. The results showed that the changes made had little impact compared to expectations. Various attempts at fixing the issue also failed, making it difficult to notice the problems. The implementation of the rules did not yield the desired results.",
  "summary": "My agent made the same mistake four times in one conversation. It kept writing files through a shell heredoc, and the heredoc kept eating a backslash, so the file looked right and ran wrong. Three notes in its memory store described exactly this mistake, and all three had been retrieved and read. I went back through the transcript to make sure. Then it did it again. Work in this space gets filed…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}