A voice AI gateway is the software that connects phone networks and browsers to AI voice agents. It speaks SIP, the signaling protocol used by phone systems, and WebRTC, the standard browsers use for live audio. The gateway sets up each call, carries and mixes the audio, and handles transfers, live listening, take-over, and hang-ups.
A call to an AI voice agent passes through four layers:
Phone calls reach the gateway over SIP. Browser calls reach it over WebRTC.

| Function | What it means |
|---|---|
| Call setup | Establishes the connection between the caller and the AI agent |
| Audio transport | Carries audio in both directions |
| Audio mixing | Combines audio streams, for example when a supervisor joins |
| Transfers | Moves a call to a human agent or another number |
| Live listening | Lets a supervisor hear the call as it happens |
| Take-over | Lets a supervisor or human agent step in for the AI agent mid-call |
| Hang-up | Ends the call and signals the end to the other side |
A traditional SIP or VoIP gateway is often a hardware device that converts between older phone lines and internet calling. A voice AI gateway is software. Its job is to deliver call audio to an AI system and return the AI's audio to the caller with as little delay as possible, while keeping the call controls a contact center expects.
The gateway is in the path of every call. If a third-party vendor runs it, that vendor's incidents reach callers directly, and the AI provider cannot ship call features the vendor does not support. A provider that runs its own gateway answers for the whole call path. Retell AI runs its own gateway, which as of October 2026 carries 100% of its phone and browser calls.
| Term | Short definition |
|---|---|
| SIP | The signaling protocol that sets up, changes, and ends calls |
| WebRTC | The standard browsers and apps use for live audio and video |
| SBC | Session border controller: the secure entry point for phone calls |
| PSTN | The public switched telephone network: the global phone network |
| SIP trunk | A direct SIP connection between two phone systems |
| SIP header | Extra information carried with a SIP message |
| SIP BYE | The SIP message that signals the end of a call |
| Media layer | The part of the system that carries and mixes call audio |
| Allowlist | The list of addresses a phone system accepts calls from |
| WebRTC SDK | The code a website or app uses to place browser calls |
No. The session border controller receives and routes phone calls at the edge of the network. The gateway sits behind it and carries the audio. Browser calls go straight to the gateway.
No. Carriers still provide phone numbers and the connection to the public phone network. The gateway connects those calls to the AI agent.
Yes. Browser calls connect to the gateway over WebRTC, usually through an SDK, and skip the session border controller.
How Retell handles audits, data retention and access control.
Table of contents