{
  "id": 16888483,
  "title": "Presentation: Wrangling Telemetry at Scale: A Guide to Self-Hosted Observability",
  "url": "https://urgent.news/2026/10/28/presentation-wrangling-telemetry-at-scale-a-guide-to-self-hosted",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-10-28T11:00:00.000Z",
  "source": {
    "name": "InfoQ",
    "slug": "infoq",
    "url": "https://www.infoq.com/presentations/self-hosted-observability-stack-tradeoffs/"
  },
  "original_language": "en",
  "account": "Colin Douch, a Site Reliability Engineer at DuckDuckGo, recently presented on the topic of \"Wrangling Telemetry at Scale: A Guide to Self-Hosted Observability\" at QCon London. In his presentation, Douch shared battle-tested strategies for building and scaling self-hosted observability stacks, focusing on the effective correlation of metrics, structured logs, and distributed traces using open-source tooling such as Prometheus, VictoriaMetrics, and Jaeger.\n\nDouch explained that while there are several escape hatches to avoid complexity, such as rewriting systems or ignoring them, these methods are often ineffective in the face of large-scale, distributed architectures. Instead, he advocated for turning to observability when faced with complex systems that cannot be easily rewritten or outsourced. This approach, however, often leads to the \"complexity demon\" rearing its head, causing engineers to question whether they should run their own observability stack or continue using managed services like Datadog or Splunk.\n\nDouch emphasized that while there may be times when self-hosting observability systems is necessary, it is generally advisable to stick with a provider to avoid the exponential increase in costs and the potential loss of features as one outgrows their current solution. He also highlighted instances where engineers may need to build custom features or address auditor questions, which can be challenging when relying on SaaS providers.\n\nIn his presentation, Douch discussed his extensive experience building self-hosted observability systems, including his work at Cloudflare and Xero, as well as his involvement in the mining sector. He shared insights on how these experiences have shaped his approach to building, maintaining, and monitoring complex observability systems.",
  "summary": "Colin Douch shares battle-tested strategies for building and scaling self-hosted observability stacks. He explains how to effectively correlate metrics, structured logs, and distributed traces using open-source tooling like Prometheus, VictoriaMetrics, and Jaeger, while navigating the engineering trade-offs of avoiding SaaS vendor lock-in. By Colin Douch",
  "key_points": [
    "Colin Douch presented on self-hosted observability at QCon London.",
    "Advocated for using open-source tools like Prometheus, VictoriaMetrics, and Jaeger.",
    "Emphasized sticking with providers to avoid complexity and cost issues."
  ],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}