Agent Console

Overview

The LiveKit Agent Console is a web-based tool that allows you to debug your agents in realtime. It provides a visual interface to monitor events and tool execution, analyze timing and performance of models, and interact with participants and agents. It also provides a way to observe live sessions as a hidden participant, allowing you to see exactly how agents behave live with real users.

The Console is compatible with agents running anywhere — whether deployed to LiveKit Cloud via code or the Agent Builder, self-hosted, or running locally on your machine.

Access the Agent Console by clicking the Launch Console button visible on any agent or in your project's Agents dashboard.

Summary pane

The summary pane provides an overview of the current session, including the room name and region key details of the RoomConfiguration, agent models, metrics, and usage.

Tool panes

Audio

The Audio pane shows live audio waveforms for all audio tracks in the session, and highlights turn detection events like agent interruptions and backchanneling for supported agents and models. See Adaptive interruption handling for more details.

Events

The Events pane shows a live stream of agent events using the RemoteSession protocol, including:

• User and agent state transitions
• Conversation and transcription updates
• Turn detection events
• Function tool execution and results
• Model usage and performance metrics
• Errors

Filter events by type, and inspect them to understand your agent's timing and behavior, and to diagnose issues with turn-taking and tool calls.

Session

The Session pane provides a live view of the Room's state, metadata, and configuration options. It also provides means of interacting with certain properties and features that are configurable at runtime. Use this pane to verify that your Room is configured as expected and to monitor changes to the Room's state over time.

Participants

The Participants pane displays all participants in the session, along with other properties including their identity, type, attributes, and metadata. Use the attached controls to update your own participant fields.

RPC

The RPC pane allows you to interact with agents and other participants by executing RPC calls against one or more participants in the session.

DTMF

The DTMF pane simulates a phone keypad to send DTMF tones to the agent. This is useful for testing agents that are designed to respond to DTMF input, such as those used in IVR systems.

Metrics

The Metrics pane provides model performance data over the course of the session, including timing breakdowns for each step of the agent's inference pipeline. Use this data to compare models, tune endpointing, and identify bottlenecks in your agent's response time.

Usage

The Usage pane keeps a cumulative tally of your agent's model usage, including the number of tokens processed, audio transcribed and generated, and other relevant metrics. Use this data to monitor your agent's resource consumption and optimize for cost and performance. For more information on model pricing, see the LiveKit Cloud pricing page.

Observing live sessions

To debug live sessions as a hidden participant, locate an active agent session in your project's Sessions dashboard and click the Observe in Console button. As an observer, you can see and hear everything in the session without being seen or heard by other participants. Though you may not publish audio or video tracks as an observer, sending text and executing RPC calls is permitted.

Links