Four reviewers told me the one thing I couldn't fix by myself
What happens when you submit a solo open-source project to academic peer review: the reviews were good, the paper was rejected, and the gap they found was the one I had no way to close on my own. I've been building DoSync , an open-source protocol that sits between AI agents and physical devices — I wrote about why it exists here if you want the background. I tested it the only way I could: on my…
The author of DoSync, an open-source protocol, submitted their work to IEEE WF-IoT 2026 for academic peer review. While the reviews were generally positive, highlighting the clarity and practicality of the architecture, four out of five reviewers identified a key issue: the evaluation was too narrow and self-conducted. The protocol's effectiveness was only tested on the author's own hardware and devices, with ground truth defined solely by the author.
This lack of independent verification meant the paper was ultimately rejected. The author acknowledges that while they could improve various aspects of the evaluation themselves, the crucial element they couldn't produce was diverse, independent input from other evaluators. They emphasize that the most significant challenge in getting their work accepted was obtaining an unbiased perspective from individuals who hadn't built or tested the system themselves. The protocol is now being distributed and tested by a wider community to address this gap.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
