Optional apiOptional apiOptional baseURL?: stringOptional inferenceOptional modelOptional provider?: stringOptional strictGet the model name/identifier for this LLM instance.
The model name if available, "unknown" otherwise.
Plugins should override this property to provide their model information.
Get the provider name for this LLM instance.
The provider name if available, "unknown" otherwise.
Plugins should override this property to provide their provider information.
Returns a LLMStream that can be used to push text and receive LLM responses.
Optional connOptional extraOptional inferenceOptional parallelOptional toolOptional toolPre-warm connection to the LLM service.
Establishes DNS resolution and the TLS connection to the provider before the first inference request, reducing time-to-first-token on the initial reply. Non-blocking (fire-and-forget) and idempotent; calls made after aclose are ignored. Providers enable it by overriding _prewarmImpl.
Update LLM configuration options used by the next chat call.
modelOptions replaces the persistent options object instead of merging;
pass {} to clear it.
Optional model?: LLMModelsOptional modelStatic from
Livekit Cloud Inference LLM