Urgent.News

What's breaking now, across thousands of outlets.

Tech

Google Just Closed Another Scraping Door. Here's the Cheap Way Around It.

Hook Google Search is rewriting organic result links to google.com/goto?url=… . The destination isn't in the query string anymore — it's an opaque reference you can only resolve by asking Google (read the Location header, don't follow the redirect). As of late August 2026, it shows up consistently when you're logged out or in private mode. If you build anything on top of search-result HTML, this…

Google is altering its organic result links to only include google.com/goto?url=…, making the destination a hard-to-track reference. This change, which started in late August 2026, affects SERP scraping, a common method for rank tracking, keyword research, and competitor monitoring. Small sellers and agencies are most impacted as they often rely on scraping for their operations.

Google's actions are aimed at slowing down scraping, making it noisier and easier to detect. The response to this change can be divided into three tiers. Tier 1 suggests owning your data, utilizing first-party sources such as Search Console, your storefront analytics, and marketplace APIs. Tier 2 recommends using official APIs when they are available, as they provide stable and structured endpoints.

Tier 3 advises scraping data carefully by resolving links properly, implementing strict rate limits, aggressive caching, and logging provenance for each field. The underlying message is that anti-scraping measures are not meant to stop scraping but to make it more costly, in terms of latency, detection risk, and engineering hours.

The most successful sellers will be those who adapt quickly, replacing scraped data with official APIs or first-party signals. The crucial step is to audit your current data sources and identify which are owned, licensed, or scraped, replacing the scraped ones with official or first-party alternatives.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

More from Tuesday 15 September →