Urgent.News

What's breaking now, across thousands of outlets.

Tech

I built a zero-dependency CLI to snapshot the remote job market into CSV/JSON/SQLite

I had a recurring need: a reproducible, offline snapshot of the remote-job market I could open in a spreadsheet, load into a database, or feed into a script — without scraping five job boards myself, juggling five different site formats, or maintaining five scraping pipelines that break every time a board changes their markup. So I built remote-jobs-export : a small, stdlib-only (zero third-party…

A developer created a command-line interface (CLI) tool called remote-jobs-export to create a reproducible, offline snapshot of the remote job market. The tool pulls normalized job data from the free Remote Jobs API and outputs it in CSV, JSON, or SQLite formats, or simply prints a summary. No API key is required for the free tier.

The developer faced challenges while trying to analyze the remote job market due to the different data formats, pagination, and salary exposure of various job boards. By creating a local export layer on top of the Remote Jobs API, the developer aimed to provide a stable, queryable dataset that could be easily analyzed, filtered, and shared without relying on live data.

The tool has the following features:

- Zero dependencies, making it compatible with any Python 3 environment without unexpected pip install issues.

- Honest by default, showing empty upstream fields as-is and parsing salaries to a consistent floor/top in USD.

- Small and readable, with a clear CLI surface that can be used to export data in various formats based on specific filters like source, skills, or minimum salary.

- The output is a snapshot of the data as of the moment it was generated, allowing for comparisons of the market at different points in time.

The developer is open to feedback and suggestions from users who utilize the tool for job-market data in notebooks, dashboards, or weekly reports.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

Your Backtest Can Pass Every Unit Test and Still Know the Future

A two-timestamp schema and a future-corruption test can catch silent look-ahead leakage in financial feature pipelines. A backtest does not need an obvious bug to cheat.

  • Two-timestamp schema reveals silent look-ahead leakage in financial feature pipelines.
  • Availableat timestamp distinguishes event time from knowledge time in models.
  • SEC company-facts API provides multiple timestamps for accurate feature building.

Pro Sells Time, Not Safety — ELY Agent Input Preflight v0.8.0

ELY Agent Input Preflight v0.8.0 is released. This release introduces an optional paid Pro entitlement, but I made one rule non-negotiable: Pro sells time, not safety.

  • Pro entitlement introduced in ELY Agent Input Preflight v0.8.0
  • Community edition retains verification and safety core
  • Pro focuses on selling time, reducing developer friction

Database Transactions & Consistency

⚡ TL;DR: Transactions guarantee all-or-nothing, but the lever that actually prevents anomalies is your isolation level . Learn to pick it deliberately, choose optimistic vs pessimistic locking by…

Convert HEIC to JPG on Windows 11 Without Uploading (Free)

You copy a batch of photos from your iPhone to your Windows 11 PC — via USB cable or iCloud — and instead of familiar .jpg files you get a folder full of .heic files that Windows refuses to open.

  • Windows 11 natively supports HEIC files since Windows 11
  • Users can convert HEIC to JPG without uploading via browser-based converters
  • Browser-based converters process files in memory, preserving privacy

More from Monday 5 October →