{
  "id": 4324121,
  "title": "Four reviewers told me the one thing I couldn't fix by myself",
  "url": "https://urgent.news/2026/08/30/four-reviewers-told-me-the-one-thing-i-couldnt-fix-by-myself",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-08-30T01:51:03.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/giulianiregspec/four-reviewers-told-me-the-one-thing-i-couldnt-fix-by-myself-4p08"
  },
  "original_language": "en",
  "account": "The author of DoSync, an open-source protocol, submitted their work to IEEE WF-IoT 2026 for academic peer review. While the reviews were generally positive, highlighting the clarity and practicality of the architecture, four out of five reviewers identified a key issue: the evaluation was too narrow and self-conducted. The protocol's effectiveness was only tested on the author's own hardware and devices, with ground truth defined solely by the author. This lack of independent verification meant the paper was ultimately rejected. The author acknowledges that while they could improve various aspects of the evaluation themselves, the crucial element they couldn't produce was diverse, independent input from other evaluators. They emphasize that the most significant challenge in getting their work accepted was obtaining an unbiased perspective from individuals who hadn't built or tested the system themselves. The protocol is now being distributed and tested by a wider community to address this gap.",
  "summary": "What happens when you submit a solo open-source project to academic peer review: the reviews were good, the paper was rejected, and the gap they found was the one I had no way to close on my own. I've been building DoSync , an open-source protocol that sits between AI agents and physical devices — I wrote about why it exists here if you want the background. I tested it the only way I could: on my…",
  "key_points": [
    "Four reviewers found evaluation too narrow and self-conducted",
    "Protocol's effectiveness tested only on author's hardware",
    "Author acknowledges need for independent evaluators' input"
  ],
  "editors_take": "The author's experience highlights that independent verification is a crucial element in academic peer review, and one that cannot be easily replicated by the author alone, changing how they approach validation.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}