The Agents framework supports integrations for providers using plugins. This topic describes LLM, STT, and TTS provider plugins. Additional plugins include support for Retrieval-Augmented Generation (RAG), Natural Language Toolkit (NLTK), LlamaIndex, Silero VAD, turn detection, and more. To see the list of additional plugins and learn more about how LiveKit plugins work, see Working with plugins.
If you want to use a provider not listed in the following sections, contributions for plugins are always welcome. To learn more, see the the guidelines for contributions to the Python repository or the Node.js repository.
Realtime API integrations
Realtime APIs are designed for ulta-low-latency AI responses and use multimodal models. They can be better at understanding a user and their emotions resulting in more natural interactions.
LLM integrations
You can create an instance of an LLM to use in aVoicePipelineAgent for the following providers using a plugin:| Anthropic | Azure | Amazon Web Services (AWS) |
| Cerebras | Deepseek | Fireworks |
| Gemini | Groq | LlamaIndex |
| Octo | Ollama | Openai |
| Perplexity | Telnyx | Together |
| xAI |
STT integrations
LiveKit plugins support the following STT providers. Create an instance of an STT to use in a `VoicePipelineAgent` or as a standalone transcription service.| Provider | Supported frameworks |
|---|---|
| AssemblyAI | Python |
| Azure | Python, Node.js |
| AWS | Python |
| Clova | Python |
| Deepgram | Python, Node.js |
| fal | Python |
| Python | |
| Groq | Python, Node.js |
| OpenAI | Python, Node.js |
| Speechmatics | Python |