Urgent.News

What's breaking now, across thousands of outlets.

Tech

How to find every Shopify store in a list of 10,000 domains

You have a list of domains. A conference attendee export, a directory scrape, a spreadsheet from a colleague. You want to know which of them run Shopify, which run WordPress, which have HubSpot installed, and which are on Cloudflare. That single question sits behind a lot of sales prospecting, competitor tracking and agency audits. The mechanics are not complicated, and it is worth understanding…

To identify Shopify stores from a list of 10,000 domains, examine the response headers returned when each domain is requested. Shopify conveys `x-shopid` in its headers, which can be used as an indicator. Cookies such as `_shopify_y` and `__utma` also suggest Shopify usage. Meta tags containing `_shopify_y` and `__utma` are additional clues.

HTML and meta tags provide direct evidence of the platform in use. URLs from `cdn.shopify.com`, Google Tag Manager scripts (`googletagmanager.com/gtm.js`), and JavaScript libraries from `js.hs-scripts.com` are typical of Shopify sites. DNS records and TXT records from verification tokens for various SaaS tools also indicate the presence of multiple platforms.

Tools like Wappalyzer and online webappanalyzer help identify these technologies by matching known patterns. Common pitfalls include failing to account for JavaScript-injected technologies, which are sometimes not present in the initial HTML. Headless storefronts that use frameworks like Next.js may not show Shopify URLs directly but can still be identified by vendor URLs hidden within inline scripts.

RegEx patterns used for matching must include a confidence tag for accurate detection. When using automated tools like the Apify Actor, `tech-stack-detector`, ensure sufficient confidence levels to minimize false positives. The approach has limitations, such as not executing JavaScript or detecting technologies that leave no trace in HTML or headers.

Real-time site interactions might reveal additional platform indicators, but this approach generally offers a reliable starting point for identifying Shopify stores from a large domain list.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

Tennis, football and basketball results as clean JSON, without a sports data contract

Sports data is one of those areas where the gap between "public information" and "affordable to obtain" is absurd. Scores and results are facts, printed in every newspaper.

  • Tennis matches can retire mid-set or be replayed, requiring unique data treatment
  • Codes 17 and 18 in tennis data represent ongoing matches, not cancelled ones
  • Football scores include additional complexities like penalties and shootouts

A source map is a claim, and nothing checks whether it is true

A source map is a claim about two files: that this position in the built output came from that position in a source file.

  • A source map links positions in output files to source files.
  • Validity of source maps can be questioned even when structurally sound.
  • Tool sourcemap-truth verifies source map accuracy.

More from Saturday 5 September →