Home

/

Glossary

/

Voice AI Gateway

A voice AI gateway connects phone networks and browsers to AI voice agents over SIP and WebRTC. What it does, where it sits in a call, and related terms.

A voice AI gateway is the software that connects phone networks and browsers to AI voice agents. It speaks SIP, the signaling protocol used by phone systems, and WebRTC, the standard browsers use for live audio. The gateway sets up each call, carries and mixes the audio, and handles transfers, live listening, take-over, and hang-ups.

Where does the gateway sit in a call?

A call to an AI voice agent passes through four layers:

  1. The phone network (PSTN) or a browser. Where the call starts.
  2. A session border controller (SBC). The secure entry point for phone calls. It decides where each call goes. Browser calls skip it.
  3. The media layer. Sets up the call, carries audio both ways, mixes it, and runs transfers and hang-ups. The gateway is the media layer.
  4. The AI infrastructure. Runs the conversation.

Phone calls reach the gateway over SIP. Browser calls reach it over WebRTC.

Diagram of the two paths into an AI voice agent: a phone call goes from the phone network through a session border controller to the gateway and the AI agent; a browser call skips the SBC and connects to the gateway directly. The gateway is highlighted.
The gateway is the media layer that both phone and browser calls pass through.

What does a voice AI gateway do?

FunctionWhat it means
Call setupEstablishes the connection between the caller and the AI agent
Audio transportCarries audio in both directions
Audio mixingCombines audio streams, for example when a supervisor joins
TransfersMoves a call to a human agent or another number
Live listeningLets a supervisor hear the call as it happens
Take-overLets a supervisor or human agent step in for the AI agent mid-call
Hang-upEnds the call and signals the end to the other side

How is a voice AI gateway different from a traditional SIP gateway?

A traditional SIP or VoIP gateway is often a hardware device that converts between older phone lines and internet calling. A voice AI gateway is software. Its job is to deliver call audio to an AI system and return the AI's audio to the caller with as little delay as possible, while keeping the call controls a contact center expects.

Why does it matter who runs the gateway?

The gateway is in the path of every call. If a third-party vendor runs it, that vendor's incidents reach callers directly, and the AI provider cannot ship call features the vendor does not support. A provider that runs its own gateway answers for the whole call path. Retell AI runs its own gateway, which as of October 2026 carries 100% of its phone and browser calls.

Terms around the gateway

TermShort definition
SIPThe signaling protocol that sets up, changes, and ends calls
WebRTCThe standard browsers and apps use for live audio and video
SBCSession border controller: the secure entry point for phone calls
PSTNThe public switched telephone network: the global phone network
SIP trunkA direct SIP connection between two phone systems
SIP headerExtra information carried with a SIP message
SIP BYEThe SIP message that signals the end of a call
Media layerThe part of the system that carries and mixes call audio
AllowlistThe list of addresses a phone system accepts calls from
WebRTC SDKThe code a website or app uses to place browser calls

Frequently asked questions

Is a voice AI gateway the same as a session border controller?

No. The session border controller receives and routes phone calls at the edge of the network. The gateway sits behind it and carries the audio. Browser calls go straight to the gateway.

Does a voice AI gateway replace my carrier?

No. Carriers still provide phone numbers and the connection to the public phone network. The gateway connects those calls to the AI agent.

Do browser calls use the gateway?

Yes. Browser calls connect to the gateway over WebRTC, usually through an SDK, and skip the session border controller.

Related terms and reading

Security & compliance for regulated deployments

How Retell handles audits, data retention and access control.

Add Retell AI as a preferred source on Google

Further Reading

Related terms

No items found.

Table of contents

Revolutionize your call operation with Retell