AssemblyAI describes a Python voice agent build that pairs LiveKit transport with its STT, LLM Gateway and TTS on one key.

AssemblyAI has published a tutorial showing how developers can build a browser-ready voice agent on LiveKit using one AssemblyAI API key for speech-to-text, language model access and text-to-speech. The post, published on Thu, 29 Oct 2026, frames the setup as a way to reduce a multi-vendor voice stack to two main systems: LiveKit for transport and orchestration, and AssemblyAI for the models behind the conversation.

According to AssemblyAI, the reference agent uses LiveKit Agents to handle WebRTC transport, room participation and turn-taking, while AssemblyAI supplies Universal-3.6 Pro Realtime for speech-to-text, the LLM Gateway for model access and assemblyai-tts-1 for synthetic voice. The company says the example can be implemented in about 100 lines of Python and supports multi-user rooms, barge-in, tool calling and turn detection without additional glue code.

The post attributes several model-level claims to AssemblyAI’s own materials. 4% entity error rate on names, numbers and addresses. 6 and later forwards automatically into the STT layer. For the voice layer, AssemblyAI says assemblyai-tts-1 streams one sentence at a time, keeps a single WebSocket session open per reply, cancels in-flight audio on barge-in without reconnecting, and publishes per-word timings so interrupted speech can be aligned to what the user actually heard.

Source link