{
  "id": 19102063,
  "title": "Voice Robot for Outbound Calls: A Latency Budget from ASR to TTS",
  "url": "https://urgent.news/2026/11/09/voice-robot-for-outbound-calls-a-latency-budget-from-asr-to-tts",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-11-09T06:01:26.000Z",
  "source": {
    "name": "Dev.to",
    "slug": "dev-to",
    "url": "https://dev.to/zoomapps/voice-robot-for-outbound-calls-a-latency-budget-from-asr-to-tts-5hhk"
  },
  "original_language": "en",
  "account": "A voice robot used for confirming appointments can appear accurate yet still feel broken to the customer. The caller responds with agreement, only to experience a two-second silence before the robot begins speaking. Despite the transcript appearing correct, the call experience is flawed. Latency plays a significant role in this experience; people are accustomed to brief pauses and begin filling the silence after approximately one second. Instead of asking which speech model is best, it's crucial to focus on where the milliseconds are spent between the customer's speech and the robot's response. This post breaks down the call path into stages, assigns a budget to each, and identifies the challenges that gradually accumulate this latency. The key metric to measure is the time from the end of the user's speech to the first audio byte played back, termed as turn latency. This metric encompasses all components, rather than focusing individually on ASR processing time, LLM time, or TTS real-time factor. The primary focus should be on achieving a turn latency of 700 ms or less, feeling natural like a quick human operator, while ensuring that a high percentage of calls remain seamless. The outbound call process can be divided into several stages: SIP trunk, media server (RTP), VAD/endpointing, streaming ASR, dialog logic (rules or LLM), streaming TTS, and RTP back to the caller. By breaking down the call path and optimizing each stage, the robot can provide a more seamless experience.",
  "summary": "A voice robot that confirms appointments can be perfectly accurate and still feel broken. The customer says \"yes, I'm coming\", then hears nothing for two seconds, says \"hello?\", and the robot starts answering on top of them. The transcript looks fine. The call does not. On the phone, latency is the product. People tolerate a short pause after they finish speaking, and they start filling the…",
  "key_points": [
    "Voice robot latency critical for seamless customer experience",
    "Turn latency target of 700 ms or less for natural feel",
    "Call path divided into SIP trunk, media server, VAD, ASR, dialog logic, TTS, and RTP stages"
  ],
  "editors_take": "Prioritizing total turn latency over individual model performance shifts the focus toward creating natural human-like interactions that prevent customers from filling awkward silences during automated outbound calls.",
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}