LiveKit Inference

Overview

LiveKit Inference provides access to many of the best models and providers for voice agents, including models from OpenAI, Google, AssemblyAI, Deepgram, Cartesia, Fish Audio, Inworld, and more. LiveKit Inference is included in LiveKit Cloud, and does not require any additional plugins. It's zero data retention by default, so your prompts, audio, and model outputs are never stored or used to train models. See the guides for LLM, STT, and TTS for supported models and configuration options.

By default, LiveKit Inference routes requests to model providers without regional restrictions. To restrict requests to models served from your project's data region, such as for EU data residency, enable region restriction.

To learn more about LiveKit Inference, see the blog post Introducing LiveKit Inference: A unified model interface for voice AI .

For LiveKit Inference models, use the inference module classes in your AgentSession:

from livekit.agents import AgentSession, inference

session = AgentSession(
    stt=inference.STT(
        model="deepgram/flux-general",
        language="en"
    ),
    llm=inference.LLM(
        model="google/gemma-4-31b-it",
    ),
    tts=inference.TTS(
        model="inworld/inworld-tts-2",
        voice="Ashley",
    ),
)

import { AgentSession, inference } from '@livekit/agents';

const session = new AgentSession({
    stt: new inference.STT({
        model: "deepgram/flux-general",
        language: "en"
    }),
    llm: new inference.LLM({
        model: "google/gemma-4-31b-it",
    }),
    tts: new inference.TTS({
        model: "inworld/inworld-tts-2",
        voice: "Ashley",
    }),
});

String descriptors

As a shortcut, you can pass a model descriptor string directly instead of using the inference classes. This is a convenient way to get started quickly.

from livekit.agents import AgentSession

session = AgentSession(
    stt="deepgram/nova-3:en",
    llm="google/gemma-4-31b-it",
    tts="inworld/inworld-tts-2:Ashley",
)

import { AgentSession } from '@livekit/agents';

const session = new AgentSession({
    stt: "deepgram/nova-3:en",
    llm: "google/gemma-4-31b-it",
    tts: "inworld/inworld-tts-2:Ashley",
});

For detailed parameter references and model-specific options, see the individual model guides for LLM, STT, and TTS.

Zero data retention

LiveKit Inference is zero data retention (ZDR) by default. Your prompts, audio, and model outputs pass through only to generate a response. Neither LiveKit nor the underlying model providers log, store, or train on your data. This applies to every LLM, STT, and TTS model, on every plan, with no configuration required.

Region restriction

By default, LiveKit Inference can route requests to a model provider in any region. To keep inference requests within your project's data region, enable region restriction.

For new projects with agents hosted in the EU, region restriction is enabled by default. To enable it for an existing project, sign in to LiveKit Cloud  and select Project → Settings. In the Data and privacy section, set Inference region restriction to Enabled.

When enabled, LiveKit Inference only routes requests to models with an endpoint in your project's data region. For a project with the EU data region, this limits inference to models served from the EU. Models without an endpoint in your data region are shown as unavailable in the Agent Builder.

Region restriction applies only to models routed through LiveKit Inference. Provider plugins send requests directly to the provider, so you must configure the provider's regional endpoint separately. To configure EU data residency across the rest of your stack, see EU data residency.

Data residency

Some models offer a dedicated endpoint in the EU, in addition to the global endpoint. A checkmark in the EU endpoint column of the model tables means the model has an EU endpoint, which lets you keep inference requests in the EU with region restriction.

Models

The following tables list all models currently available through LiveKit Inference.

Large language models (LLM)

Browse the available large language models by model family.

A checkmark in the EU endpoint column means the model has a dedicated EU endpoint, in addition to the global endpoint. To learn more, see Data residency.

Hosted by LiveKit

DeepSeek

Gemini

OpenAI

SpaceXAI

Kimi

Speech-to-text (STT)

Browse the available speech-to-text models by model family.

A checkmark in the EU endpoint column means the model has a dedicated EU endpoint, in addition to the global endpoint. To learn more, see Data residency.

Deepgram

AssemblyAI

Cartesia

Gemini

Speechmatics

SpaceXAI

Text-to-speech (TTS)

Browse the available text-to-speech models by model family.

A checkmark in the EU endpoint column means the model has a dedicated EU endpoint, in addition to the global endpoint. To learn more, see Data residency.

Cartesia

Deepgram

Fish Audio

Gradium

Inworld

Rime

SpaceXAI

Billing

LiveKit Inference billing is based on usage. Discounted rates are available on the Scale plan. Custom rates are available on the Enterprise plan. Refer to the following articles for more information on quotas, limits, and billing for LiveKit Inference. The latest pricing is always available on the LiveKit Inference pricing page .