Overview
LiveKit Agents integrate with physical devices to enable hardware-based agent interactions. A variety of platforms are supported, from embedded Linux systems to ESP32 microcontrollers.
Supported platforms
LiveKit provides SDKs for building hardware frontends that connect embedded devices and microcontrollers to agents. These SDKs handle audio capture, playback, and realtime communication, making it straightforward to integrate agents into physical products and IoT devices.
Embedded Linux
Use the Python SDK or Rust SDK to interface with local audio capture and playback devices and connect to an agent. Both SDKs support AEC (acoustic echo cancellation) to ensure audio played through speakers doesn't get picked up again by the microphone.
Python SDK
The LiveKit Python SDK publishes audio and video tracks to a room. It includes a MediaDevices helper class that simplifies setting up capture and playback devices.
Rust SDK
The LiveKit Rust SDK publishes audio and video tracks to a room.
ESP32 microcontrollers
The LiveKit ESP32 SDK enables ESP32 S3 and P4 series microcontrollers to connect to LiveKit and interact with an agent from low-cost embedded devices.
ESP32 devices must have audio capture from both the microphone and the speaker output to use AEC features.
For supported chips, development boards, and the SDK architecture, see ESP32 microcontrollers.