Urgent.News

What's breaking now, across thousands of outlets.

Tech

Fixing the Daily Content Generator’s Bluesky Payload – A Code‑First Walkthrough

Fixing the Daily Content Generator’s Bluesky Payload – A Code‑First Walkthrough TL;DR: I rewrote the payload builder for the daily post generator so it correctly writes bluesky_es.json and updates metadata.json . The change eliminates a silent write‑failure and lets the CI pipeline publish to Bluesky without manual intervention. The Problem Our content-automation pipeline runs every morning,…

The Bluesky content generator failed to publish posts because it couldn't locate the necessary payload file. The CI pipeline would skip the git add and commit steps whenever this issue occurred, leaving the metadata flagged as unpublished. The problem stemmed from the file path construction, which used a hard-coded locale of "en" regardless of the actual content being processed.

To fix this, a utility was created to manage locales, ensuring that the correct file name was generated based on the locale provided. The generator was then updated to correctly build the payload for both English and Spanish drafts. Additionally, the metadata file was updated atomically to correctly record the published status and URIs for each locale, eliminating the silent write failures that had been causing the Bluesky posts to go unpublished.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in Tech

Scope Was Always a Test-Design Question

Originally published at tddbuddy.com . Related reading: Agent PRs Do Not Converge Under Design Review argued the current-PR review turn is the wrong artifact for an agent author.

  • Agentic PRs revert due to scope creep in 2.66% of cases
  • Agents rewrite code without considering broader impact
  • Scope assertions can prevent inadvertent modifications

scrapy-playwright

scrapy-playwright 是 Scrapy 官方插件组织维护的下载处理器,用 Playwright for Python 驱动真实浏览器来抓取请求。它的定位是处理需要执行 JavaScript 的页面,同时保留 Scrapy 原有的调度和 item 处理流程。和前面聊的 curl_cffi 方案相比,它不是"模拟"浏览器指纹,而是直接用真浏览器,所以 TLS、HTTP/2、JS…

  • scrapy-playwright is official Scrapy plugin using Playwright for Python.
  • Enables handling JavaScript pages while preserving Scrapy flow.
  • Requires pip install scrapy-playwright playwright install chromium.

More from Monday 16 November →