Urgent.News

What's breaking now, across thousands of outlets.

Tech

Owner of 1.5M-page site PatronView on a year of fighting scrapers: 214:1 bot-to-human page loads, 35K Claude crawls per referred user, Amazon bot referred none (Nick Gray/PatronView)

A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what's working now. August 7, 2026

In a year-long battle against web scrapers, owner Nick Gray of PatronView, a 1.5 million-page site containing philanthropist data, has implemented various firewall rules and measures to combat these automated bots. According to Gray, his website receives millions of requests every week, but visitor stats from tools like Plausible or Fathom only show around 6,000 pageviews per day. This discrepancy highlights the extent of bot traffic affecting his site.

Written by urgent.news from Techmeme's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at patronview.com →

More in Tech

multi-token prediction (MTP) support

  • Gemma 4, using Ollama 0.31, shows faster multi-token prediction (MTP)
  • MTP uses smaller draft model to generate and verify tokens quickly
  • Dynamic draft length adjustment maximizes tokens per second generation

More from Tuesday 11 August →