xAI LLM

Overview

xAI's Grok models are available in LiveKit Agents through LiveKit Inference and the xAI plugin. With LiveKit Inference, your agent runs on LiveKit's infrastructure to minimize latency. No separate provider API key is required, and usage and rate limits are managed through LiveKit Cloud. Use the plugin instead if you want to manage your own billing and rate limits. Pricing for LiveKit Inference is available on the pricing page.

LiveKit Inference

Use LiveKit Inference to access Grok models without a separate xAI API key.

Usage

To use Grok, use the LLM class from the inference module. You can use this LLM in the Voice AI quickstart:

from livekit.agents import AgentSession, inference

session = AgentSession(
    llm=inference.LLM(
        model="xai/grok-4-1-fast-non-reasoning",
        extra_kwargs={
            "max_completion_tokens": 1000
        }
    ),
    # ... tts, stt, vad, turn_handling, etc.
)

import { AgentSession, inference } from '@livekit/agents';

const session = new AgentSession({
    llm: new inference.LLM({
        model: "xai/grok-4-1-fast-non-reasoning",
        modelOptions: {
            max_completion_tokens: 1000
        }
    }),
    // ... tts, stt, vad, turnHandling, etc.
});

Parameters

The following are parameters for configuring Grok models with LiveKit Inference. For model behavior parameters like temperature and max_completion_tokens, see model parameters.

Model parameters

Pass the following parameters inside extra_kwargs (Python) or modelOptions (Node.js). For more details about each parameter in the list, see Inference parameters.

String descriptors

As a shortcut, you can also pass a model ID string directly to the llm argument in your AgentSession:

from livekit.agents import AgentSession

session = AgentSession(
    llm="xai/grok-4-1-fast-non-reasoning",
    # ... tts, stt, vad, turn_handling, etc.
)

import { AgentSession } from '@livekit/agents';

const session = new AgentSession({
    llm: "xai/grok-4-1-fast-non-reasoning",
    // ... tts, stt, vad, turnHandling, etc.
});

Plugin

LiveKit's plugin support for xAI lets you connect directly to xAI's API with your own API key. The Python plugin uses the Responses API, which supports xAI provider tools (WebSearch, FileSearch, XSearch).

The Node.js plugin uses xAI's Chat Completions endpoint via the OpenAI plugin. It does not support the Responses API or provider tools.

Installation

Install the xAI plugin to add xAI support:

uv add "livekit-agents[xai]~=1.4"

pnpm add @livekit/agents-plugin-openai@1.x

Authentication

Set the following environment variable in your .env file:

XAI_API_KEY=<your-xai-api-key>

Usage

Use xAI within an AgentSession or as a standalone LLM service. For example, you can use this LLM in the Voice AI quickstart

from livekit.plugins import xai

# Use Responses API (recommended)
session = AgentSession(
    llm=xai.responses.LLM(
        model="grok-4-1-fast-non-reasoning",
    ),
    # ... tts, stt, vad, turn_handling, etc.
)

import * as openai from '@livekit/agents-plugin-openai';

const session = new voice.AgentSession({
    llm: openai.LLM.withXAI({
        model: "grok-3",
    }),
    // ... tts, stt, vad, turnHandling, etc.
});

Parameters

This section describes some of the available parameters. For a complete reference of all available parameters, see the plugin reference links in the Additional resources section.

Provider tools

xAI supports the following provider tools that enable the model to use built-in capabilities executed on the model server. These tools can be used alongside function tools defined in your agent's codebase. Provider tools work with both the Responses API and the Grok Voice Agent API.

from livekit.plugins import xai

agent = MyAgent(
    llm=xai.responses.LLM(),
    tools=[xai.XSearch(), xai.WebSearch()],  # replace with any supported provider tool
)

Additional resources

The following links provide more information about the xAI Grok LLM integration.

Python plugin

ReferenceGitHubPyPI

Node.js plugin

ReferenceGitHubNPM

xAI docs

xAI Grok documentation.

Voice AI quickstart

Get started with LiveKit Agents and xAI Grok.

Grok Voice Agent API

Use Grok Voice Agent API for low-latency voice interactions.