Interface FallbackAdapterOptions

Options for creating a FallbackAdapter.

interface FallbackAdapterOptions {
    attemptTimeout?: number;
    llms: llm.LLM[];
    maxRetryPerLLM?: number;
    retryInterval?: number;
    retryOnChunkSent?: boolean;
}

Properties

attemptTimeout? llms maxRetryPerLLM? retryInterval? retryOnChunkSent?

Properties

Optional attemptTimeout

attemptTimeout?: number

Timeout for each LLM attempt in seconds. Defaults to 5.0.

llms

llms: llm.LLM[]

List of LLM instances to fallback to (in order).

Optional maxRetryPerLLM

maxRetryPerLLM?: number

Internal retries per LLM before moving to next. Defaults to 0.

Optional retryInterval

retryInterval?: number

Interval between retries in seconds. Defaults to 0.5.

Optional retryOnChunkSent

retryOnChunkSent?: boolean

Whether to retry when LLM fails after chunks are sent. Defaults to false.

Settings

Member Visibility

Theme

On This Page

attemptTimeoutllmsmaxRetryPerLLMretryIntervalretryOnChunkSent