Class LLMAbstract

Hierarchy (view full)

Constructors

Accessors

Methods

Constructors

Accessors

  • get model(): string
  • Get the model name/identifier for this LLM instance.

    Returns string

    The model name if available, "unknown" otherwise.

    Remarks

    Plugins should override this property to provide their model information.

  • get provider(): string
  • Get the provider name for this LLM instance.

    Returns string

    The provider name if available, "unknown" otherwise.

    Remarks

    Plugins should override this property to provide their provider information.

Methods

  • Returns a LLMStream that can be used to push text and receive LLM responses.

    Parameters

    • __namedParameters: {
          chatCtx: ChatContext;
          connOptions?: APIConnectOptions;
          extraKwargs?: Record<string, unknown>;
          parallelToolCalls?: boolean;
          toolChoice?: llm.ToolChoice;
          toolCtx?: ToolContextLike;
      }
      • chatCtx: ChatContext
      • Optional connOptions?: APIConnectOptions
      • Optional extraKwargs?: Record<string, unknown>
      • Optional parallelToolCalls?: boolean
      • Optional toolChoice?: llm.ToolChoice
      • Optional toolCtx?: ToolContextLike

        Tools to advertise to the LLM. Accepts either a ToolContext instance or a raw (FunctionTool | ProviderTool)[] array — the array form is normalized into a ToolContext internally so callers don't have to construct one themselves.

    Returns llm.LLMStream