Groq and LiveKit

Try out Groq Talk

See our voice assistant playground using Groq STT, LLM, and TTS

Groq ecosystem support

Groq provides fast AI inference in the cloud and on-prem AI compute centers. LiveKit Agents can integrate with the following Groq services:

• STT: Fast and cost-effective English or multilingual transcription based on whisper-large-v3.
• TTS: Fast English and Arabic text-to-speech based on playai-tts.
• LLM: Fast inference for open models like gpt-oss-120b and more.

Groq LLMs are available in LiveKit Inference, with billing and integration handled automatically. The Groq plugin for LiveKit Agents also provides support for STT and TTS models.

Getting started

Use the Voice AI quickstart to build a voice AI app with Groq. Select an STT-LLM-TTS pipeline model type and add the following components to build on Groq.

Use a Groq LLM to initialize your AgentSession:

from livekit.agents import AgentSession

# ...

# in your entrypoint function
session = AgentSession(
    llm="groq/gpt-oss-120b",
    # ... tts, stt, vad, turn_detection, etc.
)

import { AgentSession } from '@livekit/agents';

session = new AgentSession({
    llm: "groq/gpt-oss-120b",
    // ... tts, stt, vad, turn_detection, etc.
});

LiveKit Agents overview

LiveKit Agents is an open source framework for building realtime AI apps in Python and Node.js. It supports complex voice AI workflows with multiple agents and discrete processing steps, and includes built-in load balancing.

LiveKit provides SIP support for telephony integration and full-featured frontend SDKs in multiple languages. It uses WebRTC transport for end-user devices, enabling high-quality, low-latency realtime experiences. To learn more, see LiveKit Agents.

Additional resources

The following links provide more information on each available Groq component in LiveKit Agents.