Urgent.News

What's breaking now, across thousands of outlets.

Tech

Getting Google Trends data in Python without fighting 429 errors

I built this actor; it's a paid tool on Apify with a free trial credit. If you've used pytrends , you've probably seen 429 Too Many Requests . Google Trends throttles anything that looks automated, and a script that worked yesterday can fail today. There's no official public API for it either. I'm an 18-year-old engineering student, and I built Google Trends Scraper mostly around that one…

In the article "Getting Google Trends data in Python without fighting 429 errors," the author shares their experience with accessing Google Trends data in Python and Node without encountering rate limit errors. They have developed an actor, which is a paid tool on Apify with a free trial credit to overcome this issue. The actor handles Google's throttling by using a different Google cookie for each session, making one small flow per search, and retrying failed searches with backoff and jitter.

The actor saves results per search as soon as they are ready, preventing one stubborn search from blocking the rest. The author provides Python and Node examples for calling the actor, as well as a brief overview of the output format. They mention that the actor can track up to 5 keyword searches at a time and can be used to track trends in different countries.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

Why PDF converters mangle Cyrillic (and how to pick one that doesn't)

If you work with Russian, Ukrainian, Bulgarian or any Cyrillic-language documents, you know the special failure: the layout survives perfectly, and the text inside reads as squares, mojibake, or…

  • PDF converters often mangle Cyrillic text due to encoding issues
  • Good converters reconstruct character encoding tables, bad ones assume Western encoding
  • Test converters with Cyrillic/Latin mixed text and tables to verify integrity

Check Markdown examples before someone copies them

A project can have a green test suite while its README example is stale. The docs are often the first thing a new user runs, and one missing colon or moved setup link can waste the first few minutes.

  • Snipverify checks Markdown syntax in code blocks and links
  • Reports file and line for invalid syntax, skips external URLs
  • JSON mode for CI integration with file, line, status, message

More from Saturday 3 October →