{
  "id": 3166366,
  "title": "Nobody has shipped an LLM that grades its own draft without a human in the loop",
  "url": "https://urgent.news/2026/08/25/nobody-has-shipped-an-llm-that-grades-its-own-draft-without-a-human",
  "topic": "ai",
  "section": "AI",
  "published": "2026-08-25T01:31:09.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/unmannedops/nobody-has-shipped-an-llm-that-grades-its-own-draft-without-a-human-in-the-loop-3c04"
  },
  "original_language": "en",
  "account": "A search for prior art on a specific LLM pipeline resulted in two approaches: fully automated with technical gates, and content gates requiring human approval. Neither approach demonstrates a fully automated system that can publish content without human intervention. The only example found was a team that let an LLM publish directly to a platform, which resulted in errors before implementing any checks. The team's new gate employs fixed rules for keyword scanning and formatting checks, with no human involvement in the decision-making process. This approach is being tested with a single, controlled draft to determine its effectiveness in catching potential issues.",
  "summary": "We went looking for prior art on a specific combination: a runner generates a draft with an LLM, a deterministic gate checks it, and — with no human reading it first — the gate decides whether it goes out. Every pipeline we found does one of two things instead. Pipeline A: fully automated, but the gate is technical Several public examples wire an LLM into a CI job that writes a post and pushes it…",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}