Urgent.News

What's breaking now, across thousands of outlets.

More in Tech

MLH Hack At Home 2020: Hearth

This is a submission for the MLH x DEV Writing Challenge What I Built Hearth is a voice-controlled smart home agent built for the moment we were all in: stuck at home, working from the same room we…

  • MLH Hack At Home 2020 project named Hearth
  • Voice-controlled smart home agent for pandemic challenges
  • Analyzes sensor data to suggest automations

Building an ETL Pipeline with Python, Docker, and PostgreSQL (And Debugging the Real Errors)

Most ETL tutorials show a perfect, frictionless flow. The reality? My pipeline turned into a festival of KeyError's , outdated schemas, and API payload typos.

  • Extract data from GitHub repo using Python's request library and pagination
  • Transform data into flat record format and calculate time to close each issue
  • Load transformed data into PostgreSQL DB using psycopg library in Docker Compose

More from Tuesday 29 September →