Skip to main content
Build a voice agent using Deepgram for speech recognition, OpenAI GPT-4o for conversation, and ElevenLabs for natural-sounding text-to-speech synthesis. Best for: Applications requiring natural voices, voice cloning, or multilingual support.

Prerequisites


Installation


Environment Variables


Pipeline Configuration


Service Details

Deepgram STT

Real-time speech recognition with interim results and language detection.

OpenAI LLM

Chat completion with GPT-4o supporting streaming responses and function calling.

ElevenLabs TTS

Natural voice synthesis with word-level timing and voice cloning support. Service options:
  • ElevenLabsTTSService - WebSocket-based, recommended for real-time
  • ElevenLabsHttpTTSService - HTTP-based, simpler setup

Quick Start

Inbound Calls

Configure your Plivo number’s Answer URL to your ngrok URL.

Outbound Calls


Pipecat Overview

Architecture and setup

Deepgram Docs

STT configuration

OpenAI Docs

LLM configuration

ElevenLabs Docs

TTS configuration