Scrape Workday, Greenhouse and Lever jobs into SQLite with Python (and get only the new ones)
Disclosure: I built and sell the Apify actor used here ( Career Site Jobs Scraper ). It is pay-per-result at $4 per 1,000 jobs saved; companies not found, empty results and filtered-out jobs are free. All code below was executed against the live actor on 2026-10-30 and the outputs shown are real. Job boards are a gold mine for market research, lead generation and personal job hunting, but every…
This article explains how to scrape job listings from Greenhouse, Lever, Ashby, SmartRecruiters and Workday and store them in an SQLite database using Python. The process involves fetching jobs using specific filters and saving unique records to a SQLite database. The script uses the Apify API actor, Career Site Jobs Scraper, which is priced at $4 per 1,000 jobs saved.
The script fetches job data based on company slugs or full career-page URLs, title keywords, locations, remote-only options, and a posting date range. It then stores the data in an SQLite database, ensuring no duplicate entries using the primary key (ATS job ID and company). The code provided demonstrates the entire process, from setting up the required libraries to executing the script and retrieving the resulting datasets.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
