{
  "id": 20659099,
  "title": "My analytics undercounted my audience by an order of magnitude",
  "url": "https://urgent.news/2026/11/18/my-analytics-undercounted-my-audience-by-an-order-of-magnitude",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-11-18T21:28:25.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/samuelfmedeiros/my-analytics-undercounted-my-audience-by-an-order-of-magnitude-234b"
  },
  "original_language": "en",
  "account": "Last week, my analytics reported 123 human visitors in a 30-day period, leading me to believe I had no audience. I considered rebuilding the product, changing the niche, or even quitting the channel. However, after reviewing the raw data, I realized my report was answering a narrower question. The report counted one thing: select count (*) from hits where visitante = humano and ts strftime( %s , now , -30 days );. This visitante = humano column is filled by a classifier that identifies humans based on the User-Agent, IP, and certain headers. The classifier was shipped on November 13th. Therefore, visitante = humano does not mean a human visited; it means a human visited after November 13th. The data revealed a critical flaw in my analytics. In October, 15,780 bot visits and 1,226 unclassified desktop or mobile visits were omitted from the human visitor count. These unclassified visits represent ten times more browser sessions than the number I was using to make product decisions. To address this issue, I now report metrics with three additional pieces of information: the denominator (17,006 rows instead of 123 visitors), the date when the measurement instrument changed (classifier shipped November 13th), and the known-unknown bucket (15,780 bots + 1,226 unclassified browsers). Before optimizing any step in the funnel, it is essential to prove that the step exists. In this case, I found that the checkout process was working correctly, and the issue lay elsewhere. My rule of thumb is to never trust a metric that changes shape when the measuring instrument changes.",
  "summary": "Last week my own funnel report told me something comfortable and wrong: 123 human visitors in 30 days . At that number, the only rational conclusion is \"I have no audience\", and the rational move after that is to rebuild the product, change the niche, or quit the channel. I almost did. Then I opened the raw table instead of the report. The report was not lying. It was answering a narrower…",
  "key_points": [
    "Analytics undercounted audience by an order of magnitude",
    "Bot visits and unclassified visits omitted from human count",
    "New metrics report denominator, change date, and known-unknown bucket"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}