Urgent.News

What's breaking now, across thousands of outlets.

Tech

How Upload_Tracker.Py Stops Double-Posting When You Re-Run A Batch

I run my whole asset pipeline on a 1 vCPU, 2 GB RAM box with no GPU. A few months ago I had a batch of 40 sticker assets ready for Adobe Stock, Vecteezy, and Dreamstime. The CSV was built, the files were named, everything looked done. Then the SSH session dropped halfway through my upload queue. I reconnected, re-ran the batch script from the top, and went to make coffee. When I came back I had…

Upload_Tracker.py is a Python script that prevents double-posting when running a batch of assets for online platforms. It works by keeping a ledger of uploaded assets in a text file and checking this ledger before attempting to upload any files. If the process is interrupted during an upload, the asset remains pending for the next run, ensuring that no duplicates are submitted.

The script uses the standard library alone, making it lightweight and easy to integrate into existing asset pipelines. The key insight is that the ledger should be updated after the upload succeeds, not before, allowing the script to pick up unfinished uploads on subsequent runs. This simple approach has prevented double-posting in the author's experience and has become an essential part of their asset submission process.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

Dry-Run Your Asset Pipeline: Validate Covers, Zips And CSVs On A 2 GB Server

Last March I lost a full evening to a header row. I had 60 JPGs ready for Adobe Stock, generated the CSV, uploaded the batch, and every single file came back rejected in under a minute.

  • Author experienced evening-long troubleshooting due to CSV header error
  • Validated all files before uploading to avoid issues
  • Condensed process into four Python scripts to catch failures

Part 3 — Networking: From `fetch()` to Packets

Most web developers use HTTP every day. We write fetch() , call APIs, send requests, and handle responses. But lets understand what happens underneath those familiar abstractions.

  • fetch() abstraction hides HTTP, TCP, IP, Ethernet/Wi-Fi layers
  • HTTP uses ports to identify application endpoints (e.g., 443 for HTTPS)
  • DNS resolves domain names to IP addresses for routing packets

Validate bounding boxes from a general vision model

A general model can take an image plus a question and return segmentation, bounding boxes, and object detection, work that used to require its own trained vision system.

  • Validate bounding boxes before using results from general vision model
  • Ensure boxes adhere to schema, have correct coordinates, and include labels
  • Reject invalid boxes outside image, with zero width/height, or missing labels

More from Sunday 18 October →