Google Gemini integration guide

Overview

Google Gemini provides powerful language models with advanced reasoning and multimodal capabilities. With LiveKit's Google plugin and the Agents framework, you can build sophisticated voice AI applications using Vertex AI or Google Gemini API.

Quick reference

This section includes a basic usage example and some reference material. For links to more detailed documentation, see Additional resources.

Installation

Install the plugin from PyPI:

pip install "livekit-agents[google]~=1.2"

pnpm add @livekit/agents-plugin-google@1.x

Authentication

The Google plugin requires authentication based on your chosen service:

• For Vertex AI, you must set the GOOGLE_APPLICATION_CREDENTIALS environment variable to the path of the service account key file.
• For Google Gemini API, set the GOOGLE_API_KEY environment variable.

Usage

Use Gemini within an AgentSession or as a standalone LLM service. For example, you can use this LLM in the Voice AI quickstart.

from livekit.plugins import google

session = AgentSession(
    llm=google.LLM(
        model="gemini-2.0-flash-exp",
    ),
    # ... tts, stt, vad, turn_detection, etc.
)

import * as google from '@livekit/agents-plugin-google';

const session = new voice.AgentSession({
    llm: google.LLM(
        model: "gemini-2.0-flash-exp",
    ),
    // ... tts, stt, vad, turn_detection, etc.
});

Parameters

This section describes some of the available parameters. For a complete reference of all available parameters, see the plugin reference.

Gemini tools

The gemini_tools parameter allows you to use built-in Google tools with the Gemini model. For example, you can use this feature to implement Grounding with Google Search:

from livekit.plugins import google
from google.genai import types

session = AgentSession(
    llm=google.LLM(
        model="gemini-2.0-flash-exp",
        gemini_tools=[types.GoogleSearch()],
    ),
    # ... tts, stt, vad, turn_detection, etc.
)

import * as google from '@livekit/agents-plugin-google';

const session = new voice.AgentSession({
    llm: google.LLM(
        model: "gemini-2.0-flash-exp",
        geminiTools: [new google.types.GoogleSearch()],
    ),
    // ... tts, stt, vad, turn_detection, etc.
});

The full list of supported tools, depending on the model, is:

• google.genai.types.GoogleSearchRetrieval()
• google.genai.types.ToolCodeExecution()
• google.genai.types.GoogleSearch()
• google.genai.types.UrlContext()
• google.genai.types.GoogleMaps()

Additional resources

The following resources provide more information about using Google Gemini with LiveKit Agents.

Python Agents

ReferenceGitHubPyPI

Node.js Agents

ReferenceGitHubNPM

Gemini docs

Google Gemini documentation.

Voice AI quickstart

Get started with LiveKit Agents and Google Gemini.

Google AI ecosystem guide

Overview of the entire Google AI and LiveKit Agents integration.