Anthropic LLM provider for LiveKit Agents.

Remarks

Implements the llm.LLM interface using the Anthropic Messages API. Supports streaming, tool calling, and system prompt isolation required by Claude 3.5+ models.

Hierarchy (view full)

Constructors

Accessors

Methods

Constructors

Accessors

Methods

  • Returns Promise<void>

  • Pre-warm connection to the LLM service.

    Establishes DNS resolution and the TLS connection to the provider before the first inference request, reducing time-to-first-token on the initial reply. Non-blocking (fire-and-forget) and idempotent; calls made after aclose are ignored. Providers enable it by overriding _prewarmImpl.

    Returns void