Four checks I run on any number someone quotes at me
Four checks I run on any number someone quotes at me Someone hands you a number with a sentence attached. A brand report. A study abstract. A headline. A colleague in a meeting. The number is usually real. The sentence is usually too big. I check four things, in this order. Each check can kill the sentence without touching the number. That distinction is the whole method: I am almost never saying…
When someone presents you with a number in a sentence, there are four critical checks to ensure its validity and relevance. These checks help maintain a critical eye on the information provided and prevent falling for misinformation or misuse of data.
First, identify who collected the data and what their motivations are. The counter could be a company selling painkillers, reporting on the gender pain gap. While the numbers might appear accurate, their source could be biased, making the number self-reported from an interested party rather than an unbiased source. Understanding the source's motivations helps you differentiate between neutral data and potentially skewed information.
Second, determine if there's a measurement behind the presented number or merely a statement. Some claims appear as numbers, while others are vague descriptions of data. For example, "Condition X is under-researched in women" is a description of the literature, not a specific rate. To avoid confusion, ask whether there is any measurement to support the claim; if not, the output should be a named gap rather than an incorrect number.
Third, clarify which population the number refers to and which population the statement claims. Sometimes, true counts can combine to create a misleading impression. For instance, a report mentioning "millions of rare books destroyed" might include various factors like pirated downloads, secondhand books, and rare books. By examining the populations described in the number and the sentence, you can distinguish between accurate data and false impressions.
Lastly, consider if the measurements are stable and whether the sentence still accurately describes the same thing. For example, a UK charity reported that women wait eight years for an endometriosis diagnosis. Over the years, the reported wait time has shifted slightly, from eight years to eight years and ten months, and then to nine years and four months.
While the charity maintains the same methodology, the figures fluctuate, making it challenging to compare across years. Similarly, retracted papers do not necessarily refute the original hypothesis. These instances highlight the importance of assessing the stability of measurements and ensuring the sentence aligns with the intended data.
In summary, employing the four checks - questioning the counter, identifying underlying measurements, clarifying populations, and evaluating measurement stability - helps maintain a critical view of quoted numbers. These checks allow you to discern between genuine data and potentially misleading or biased information, providing a solid foundation for your analysis and reporting.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
