{
  "id": 6107344,
  "title": "A finished scraper sat on a git branch for 19 days. Nothing noticed.",
  "url": "https://urgent.news/2026/09/07/a-finished-scraper-sat-on-a-git-branch-for-19-days-nothing-noticed",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-07T06:25:08.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/devil_scrapes/a-finished-scraper-sat-on-a-git-branch-for-19-days-nothing-noticed-4l4i"
  },
  "original_language": "en",
  "account": "A fully developed scraper was left unnoticed on a git branch for 19 days before anyone noticed it. The reason for this oversight was that the build lane mistakenly counted the agent's green status as indicating completion, rather than verifying that the code had been committed to the main branch. Upon finally running the scraper against the live site, it passed without any issues at a cost of just $0.00105, utilizing the cheapest proxy tier available. This incident highlights two important lessons: first, a \"no-go\" label that does not specify every tested proxy tier should not be considered a definitive \"no-go\"; second, the difference between an agent reporting success and the code being successfully merged into the main branch. The scraper that went unnoticed for almost three weeks was discovered by accident while running an unrelated query that listed 97 accumulated worktree branches. The scraper, consisting of models, client, parser, and four test modules, was committed on July 29, 2026, and remained undiscovered on the branch. The original note about a DataDome infeasibility had never been tested against the live site, and the finished scraper was never probed on the actual target. The billing records confirmed that the run used the cheapest proxy tier, as no residential transfer was recorded, despite the scraper being designed to target the DataDome site. This incident emphasizes the importance of verifying both the requested proxy tier and the actual usage through billing records, as relying solely on configuration may lead to false assumptions.",
  "summary": "We keep a written do-not-build list. Vinted has been on it for months, with a one-line reason: DataDome, plus a saturated incumbent at 108k runs and a 5-star rating. That is a perfectly sensible thing to write down. It was also wrong, and it took us 19 days to find out — not because the wall was hard, but because nobody ever tried it. Here is the whole story, with the numbers. Quick answer A…",
  "key_points": [
    "A fully developed scraper remained unnoticed on a git branch for 19 days",
    "Build lane misinterpreted green status as completion, not main branch merge",
    "Incident underscores need to verify proxy tier and actual usage via billing records"
  ],
  "editors_take": "This incident highlights the risks of relying solely on automated status indicators and the importance of verifying code completion and actual usage to avoid unnoticed and untested changes.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}