4 articles
Master real-time voice agent turn-taking: optimize Semantic VAD, implement Barge-in Gates, synchronize truncation, and monitor Endpointing SLOs in production.
Latency in real-time voice agents isn't just about model speed—dead air comes from endpointing, pause confirmation, audio buffering, and interruption handling. This guide covers production-grade Turn Detection, Two-Pass EOU, and Barge-in using LiveKit, NVIDIA Riva, and Deepgram, with segmented latency metrics and a practical tuning order.
A practical guide to productionizing real-time voice agents with LLMs, covering WebRTC audio transport, VAD endpoint detection, barge-in recovery, transcription buffering, tool call confirmation, human handoff, and a pre-launch checklist.
A deep dive into the real-time pipeline for speech LLM applications from an engineering perspective, covering how to coordinate streaming ASR, VAD, segmented context, LLM inference, and TTS to reduce end-to-end latency and maintain semantic boundaries in long conversations.