AssemblyAI outlined a structured outbound voice agent using Twilio, Universal-3.6 Pro Realtime, LLM Gateway and Text-to-Speech.
AssemblyAI published a technical guide on Oct. 29, 2026, describing how to build an outbound AI cold-calling agent that dials prospects, qualifies them in a structured conversation and writes outcomes back to a CRM. The guide centers on a fail-closed compliance gate, Twilio for telephony, Universal-3.6 Pro Realtime for speech recognition, an LLM through LLM Gateway for the script and tools, and AssemblyAI Text-to-Speech for replies.
The article says the call flow should be built around four pieces: a compliance gate that blocks the call before it is placed, a telephony path, an agent that runs the script and a tool layer that records the outcome. It specifies that one AssemblyAI API key can cover Universal-3.6 Pro Realtime, LLM Gateway and Text-to-Speech, while Twilio places the call and carries the audio. The implementation example uses a single Python file, server.py, and a Media Streams WebSocket to bridge audio between Twilio and the server.
AssemblyAI framed the system as suitable for structured qualification rather than open-ended persuasion. The guide argues for a closed set of outcomes, with two or three known questions, explicit branching and one of six dispositions written to the CRM. It also says the agent should disclose that it is AI in the first sentence and, where recording is enabled, disclose that as well.
The compliance section places the gate before the dial and recommends fail-closed behavior for unknown timezones or unavailable do-not-call checks.
Source link
