{
  "id": 17462166,
  "title": "Scrape Workday, Greenhouse and Lever jobs into SQLite with Python (and get only the new ones)",
  "url": "https://urgent.news/2026/10/31/scrape-workday-greenhouse-and-lever-jobs-into-sqlite-with-python-and",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-10-31T19:55:09.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/flyingnimbus/scrape-workday-greenhouse-and-lever-jobs-into-sqlite-with-python-and-get-only-the-new-ones-2ddg"
  },
  "original_language": "en",
  "account": "This article explains how to scrape job listings from Greenhouse, Lever, Ashby, SmartRecruiters and Workday and store them in an SQLite database using Python. The process involves fetching jobs using specific filters and saving unique records to a SQLite database. The script uses the Apify API actor, Career Site Jobs Scraper, which is priced at $4 per 1,000 jobs saved. The script fetches job data based on company slugs or full career-page URLs, title keywords, locations, remote-only options, and a posting date range. It then stores the data in an SQLite database, ensuring no duplicate entries using the primary key (ATS job ID and company). The code provided demonstrates the entire process, from setting up the required libraries to executing the script and retrieving the resulting datasets.",
  "summary": "Disclosure: I built and sell the Apify actor used here ( Career Site Jobs Scraper ). It is pay-per-result at $4 per 1,000 jobs saved; companies not found, empty results and filtered-out jobs are free. All code below was executed against the live actor on 2026-10-30 and the outputs shown are real. Job boards are a gold mine for market research, lead generation and personal job hunting, but every…",
  "key_points": [
    "Script scrapes job listings from Greenhouse, Lever, Ashby, SmartRecruiters, and Workday",
    "Data stored in SQLite database with unique records using primary key (ATS job ID and company)",
    "Script uses Apify API actor, Career Site Jobs Scraper priced at $4 per 1,000 jobs saved"
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}