AssemblyAI STT | LiveKit Docs

Overview

LiveKit Inference offers transcription powered by AssemblyAI. Pricing information is available on the pricing page.

Model name	Model ID	Languages
Universal-Streaming	assemblyai/universal-streaming	enen-US

Usage

To use AssemblyAI, pass a descriptor with the model and language to the stt argument in your AgentSession:

from livekit.agents import AgentSession

session = AgentSession(
    stt="assemblyai/universal-streaming:en",
    # ... tts, stt, vad, turn_detection, etc.
)

import { AgentSession } from '@livekit/agents';

session = new AgentSession({
    stt: "assemblyai/universal-streaming:en",
    // ... tts, stt, vad, turn_detection, etc.
});

Parameters

To customize additional parameters, use the STT class from the inference module:

from livekit.agents import AgentSession, inference

session = AgentSession(
    stt=inference.STT(
        model="assemblyai/universal-streaming", 
        language="en"
    ),
    # ... tts, stt, vad, turn_detection, etc.
)

import { AgentSession, inference } from '@livekit/agents';

session = new AgentSession({
    stt: new inference.STT({ 
        model: "assemblyai/universal-streaming", 
        language: "en" 
    }),
    // ... tts, stt, vad, turn_detection, etc.
});

modelstringRequired

The model to use for the STT.

languagestringOptional

Language code for the transcription. If not set, the provider default applies.

extra_kwargsdictOptional

Additional parameters to pass to the AssemblyAI Universal Streaming API, including format_turns, end_of_turn_confidence_threshold, min_end_of_turn_silence_when_confident, max_turn_silence, and keyterms_prompt. See the provider's documentation for more information.

Additional resources

The following links provide more information about AssemblyAI in LiveKit Inference.

AssemblyAI Plugin

Plugin to use your own AssemblyAI account instead of LiveKit Inference.

AssemblyAI docs

AssemblyAI's official documentation.