Skip to main content

Kimi LLM

How to use Kimi models with LiveKit Agents.

On this page

Use in Agent Builder

Create a new agent in your browser using this model

Overview

Kimi models are available in LiveKit Agents through LiveKit Inference. Pricing is available on the pricing page .

LiveKit Inference

Use LiveKit Inference to access Kimi models without a separate Moonshot API key.

A checkmark in the EU endpoint column means the model has a dedicated EU endpoint, in addition to the global endpoint. To learn more, see Data residency.

Model nameModel IDProvidersEU endpoint
Kimi K2.6
moonshotai/kimi-k2.6
  • vercel
No EU endpoint
Kimi K2 Instruct
moonshotai/kimi-k2-instruct
  • baseten
    Retired
No EU endpoint
Kimi K2.5
moonshotai/kimi-k2.5
  • baseten
    Retired
No EU endpoint
Retired models
A Retired badge means that provider no longer serves the model. A model that is retired by every listed provider is no longer accessible. Switch to a currently available model.

Usage

To use Kimi, use the LLM class from the inference module. You can use this LLM in the Voice AI quickstart:

from livekit.agents import AgentSession, inference
session = AgentSession(
llm=inference.LLM(
model="moonshotai/kimi-k2.6",
extra_kwargs={
"max_completion_tokens": 1000
}
),
# ... tts, stt, vad, turn_handling, etc.
)
import { AgentSession, inference } from '@livekit/agents';
const session = new AgentSession({
llm: new inference.LLM({
model: "moonshotai/kimi-k2.6",
modelOptions: {
max_completion_tokens: 1000
}
}),
// ... tts, stt, vad, turnHandling, etc.
});

Parameters

The following are parameters for configuring Kimi models with LiveKit Inference. For model behavior parameters like temperature and max_completion_tokens, see model parameters.

model
Required
string

The model ID from the models list.

providerstring

Deprecated. Support for provider pinning ends on March 1, 2027. Omit provider to let LiveKit route requests and use fallback providers. See provider pinning deprecation for migration guidance.

extra_kwargsdict

Additional parameters to pass to the Kimi Chat Completions API, such as max_tokens or temperature. See model parameters for supported fields.

In Node.js this parameter is called modelOptions.

Model parameters

Pass the following parameters inside extra_kwargs (Python) or modelOptions (Node.js). For more details about each parameter in the list, see Inference parameters.

ParameterTypeDefaultNotes
temperaturefloatVaries by modelValid range: 0–1. Not configurable for kimi-k2.6.
top_pfloatVaries by modelValid range: 0–1. Not configurable for kimi-k2.6.
max_completion_tokensint1024Maximum number of tokens to generate. Must not exceed the remaining token budget after inputs.
frequency_penaltyfloat0Reduces the model's likelihood to repeat the same line verbatim. Valid range: -2.0–2.0. Not configurable for kimi-k2.6.
presence_penaltyfloat0Increases the model's likelihood to talk about new topics. Valid range: -2.0–2.0. Not configurable for kimi-k2.6.
stopstr | list[str]Sequences that stop generation. Up to 5 sequences, each up to 32 bytes.
nint1Number of completions to generate. Valid range: 1–5. Not configurable for kimi-k2.6.

String descriptors

As a shortcut, you can also pass a model ID directly to the llm argument in your AgentSession:

from livekit.agents import AgentSession
session = AgentSession(
llm="moonshotai/kimi-k2.6",
# ... tts, stt, vad, turn_handling, etc.
)
import { AgentSession } from '@livekit/agents';
const session = new AgentSession({
llm: "moonshotai/kimi-k2.6",
// ... tts, stt, vad, turnHandling, etc.
});

Additional resources

The following links provide more information about Kimi in LiveKit Inference.