{
  "id": 6017430,
  "title": "Your zero-downtime deploy is probably fine. Check your p99 before you believe it.",
  "url": "https://urgent.news/2026/09/06/your-zero-downtime-deploy-is-probably-fine-check-your-p99-before-you",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-06T19:07:07.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/remdore/your-zero-downtime-deploy-is-probably-fine-check-your-p99-before-you-believe-it-46g2"
  },
  "original_language": "en",
  "account": "The article discusses a scenario where a zero-downtime deploy appears successful but actually fails during the process. The setup includes two Node/Express replicas behind Nginx, with a ten-client load test on an endpoint that takes three seconds to complete. During a Docker stop on one replica, the app's lack of signal handling results in mid-flight requests dying. Unexpectedly, Nginx detects the upstream connection drop and retries the request, causing clients to experience twice the latency. While error rate metrics may appear flawless, latency metrics reveal a spike during each deploy, which may be overlooked. The author explains that once headers are in transit, Nginx cannot prevent the retry. The solution involves removing the instance from the load balancer before sending SIGTERM, ensuring no requests are sent to a non-responsive instance. This approach eliminates the issue, as demonstrated by a zero-failure rate during testing. The article emphasizes the importance of monitoring latency rather than just error rates to detect potential issues during deploys.",
  "summary": "I went looking for dropped requests during a rolling restart and found something more annoying than dropped requests: a deploy that looks perfect and isn't. Setup is deliberately boring. Two Node/Express replicas behind nginx, ten clients hammering an endpoint that takes three seconds, docker stop on one replica halfway through. The app is the version most of us have shipped at some point, with…",
  "key_points": [
    "Zero-downtime deploy may appear successful but can fail during process.",
    "Lack of signal handling in Node/Express app causes mid-flight requests to die.",
    "Monitoring p99 latency, not just error rates, crucial to detect deploy issues."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}