{
  "id": 10470765,
  "title": "Detect a website's tech stack in bulk with Python (a Wappalyzer-style lookup)",
  "url": "https://urgent.news/2026/09/28/detect-a-websites-tech-stack-in-bulk-with-python-a-wappalyzer-style",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-28T15:05:12.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/rel8ble/detect-a-websites-tech-stack-in-bulk-with-python-a-wappalyzer-style-lookup-226p"
  },
  "original_language": "en",
  "account": "This article demonstrates how to detect a website's technology stack in bulk using Python, a technique similar to Wappalyzer. The author, an 18-year-old engineering student, created a tool called Website Tech Stack Detector which can be accessed as a paid tool on Apify with a free trial credit. The tool performs HTTP requests, DNS lookups, and TLS handshakes to gather information about a website's technology stack. It then matches the gathered data against a rule set containing over 7,600 technology fingerprints.\n\nThe process involves making one HTTP request with browser-like headers, plus DNS lookups for various record types, and a single TLS handshake for each site. The browser-like headers, cookies, meta tags, script URLs, inline scripts, and HTML are then analyzed using cheerio, a library that parses and manipulates HTML documents like a browser would, but without the overhead of a full browser application. This analysis takes approximately 0.3 seconds per page.\n\nA key feature of the tool is that every detected technology is accompanied by a confidence score and the evidence that matched. This allows users to verify the results themselves rather than relying solely on the black-box algorithm. The code examples provided in the article show how to use the Website Tech Stack Detector in both Python and Node.js environments.\n\nThe output from the tool is a structured JSON object containing various pieces of information about each website, such as the domain name, HTTP status code, whether the site was blocked, the count of detected technologies, content management system (CMS) information, e-commerce platform, analytics tools, tag managers, advertising partners, content delivery network (CDN), programming language server type, email provider, and the technologies themselves. Each technology entry includes a confidence score and the specific evidence that led to the detection.",
  "summary": "I built this actor; it's a paid tool on Apify with a free trial credit. \"What is this site built with?\" is easy to answer for one site with a browser extension. It gets annoying when you have 500 domains in a spreadsheet and want to know which ones run Shopify, which use HubSpot, or who's still on an old WordPress install. I'm an 18-year-old engineering student, and I built Website Tech Stack…",
  "key_points": [
    "Website Tech Stack Detector tool detects tech stacks in bulk using Python",
    "Tool performs HTTP requests, DNS lookups, TLS handshakes for analysis",
    "Output JSON includes tech stack details with confidence scores and evidence"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}