Groq STT integration guide

Experience Groq's fast STT in a LiveKit-powered playground

Overview

Groq provides fast STT using fine-tuned and distilled models based on Whisper V3 Large. With LiveKit's Groq integration and the Agents framework, you can build AI voice applications with fluent and conversational voices.

Quick reference

This section includes a basic usage example and some reference material. For links to more detailed documentation, see Additional resources.

Installation

Install the plugin from PyPI:

pip install "livekit-agents[groq]~=1.0rc"

Authentication

The Groq plugin requires a Groq API key.

Set GROQ_API_KEY in your .env file.

Usage

Use Groq STT in your AgentSession or as a standalone transcription service. For example, you can use this STT in the Voice AI quickstart.

from livekit.plugins import groq
   
session = AgentSession(
   stt=groq.STT(
      model="whisper-large-v3-turbo",
      language="en",
   ),
   # ... tts, llm, vad, turn_detection, etc.
)

Parameters

This section describes some of the available parameters. See the plugin reference for a complete list of all available parameters.

modelstringOptionalDefault: whisper-large-v3-turbo

Name of the STT model to use. For help with model selection, see the Groq STT documentation.

languagestringOptionalDefault: en

Language of the input audio in ISO-639-1 format.

promptstringOptional

Prompt to guide the model's style or specify how to spell unfamiliar words. 224 tokens max.

Additional resources

The following resources provide more information about using Groq with LiveKit Agents.

Python package

The livekit-plugins-groq package on PyPI.

Plugin reference

Reference for the Groq STT plugin.

GitHub repo

View the source or contribute to the LiveKit Groq STT plugin.

Groq docs

Groq STT docs.

Voice AI quickstart

Get started with LiveKit Agents and Groq STT.

Groq ecosystem guide

Overview of the entire Groq and LiveKit Agents integration.