My fact-checker said CONFIRMED about a group that doesn't exist
I built a tool that fact-checks crypto claims. You paste a sentence like "Whales are holding $XYZ" and it plans the on-chain calls that claim needs, runs them against Nansen 's API, and answers CONFIRMED / OVERSTATED / CONTRADICTED / UNVERIFIABLE with the numbers that decided it. Last week it answered CONFIRMED about a group of wallets that does not exist. Not "returned a weak signal." Not "was…
I developed a tool designed to fact-check cryptocurrency claims. Users input a sentence such as "Whales are holding $XYZ," and the tool analyzes the necessary on-chain actions, querying Nansen's API, and returns CONFIRMED, OVERSTATED, CONTRADICTED, or UNVERIFIABLE based on the findings. Recently, the tool confidently answered CONFIRMED regarding a group of wallets that simply don't exist.
The response wasn't a slight discrepancy or a slight inaccuracy - it outright declared the claim as true despite there being no corresponding wallets in the data source. This instance highlights a fundamental flaw in the tool's design, despite having clear limitations documented prior.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
