Owner of 1.5M-page site PatronView on a year of fighting scrapers: 214:1 bot-to-human page loads, 35K Claude crawls per referred user, Amazon bot referred none (Nick Gray/PatronView)
A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now. August 7, 2026
In a year-long battle against web scrapers, owner Nick Gray of PatronView, a 1.5 million-page site containing philanthropist data, has implemented various firewall rules and measures to combat these automated bots. According to Gray, his website receives millions of requests every week, but visitor stats from tools like Plausible or Fathom only show around 6,000 pageviews per day. This discrepancy highlights the extent of bot traffic affecting his site.
Written by urgent.news from Techmeme's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.