Class LLMStream`Abstract`

Hierarchy (view full)

LLMStream
- inference.LLMStream

Implements

AsyncIterableIterator<ChatChunk>

Index

Constructors

Accessors

chatCtx connOptions toolCtx

Methods

[asyncIterator] close next

Constructors

constructor

new LLMStream(llm, __namedParameters): llm.LLMStream
Parameters
- llm: llm.LLM
- __namedParameters: {
      chatCtx: ChatContext;
      connOptions: APIConnectOptions;
      toolCtx?: ToolContext;
  }
  - chatCtx: ChatContext
  - connOptions: APIConnectOptions
  - Optional toolCtx?: ToolContext
Returns llm.LLMStream
- Defined in llm/llm.ts:108

Accessors

chatCtx

get chatCtx(): ChatContext
The initial chat context of this stream.

Returns ChatContext
- Defined in llm/llm.ts:239

connOptions

get connOptions(): APIConnectOptions
The connection options for this stream.

Returns APIConnectOptions
- Defined in llm/llm.ts:244

toolCtx

get toolCtx(): undefined | ToolContext
The function context of this stream.

Returns undefined | ToolContext
- Defined in llm/llm.ts:234

Methods

[asyncIterator]

[asyncIterator](): llm.LLMStream
Returns llm.LLMStream
Implementation of AsyncIterableIterator.[asyncIterator]
- Defined in llm/llm.ts:256

close

close(): void
Returns void
- Defined in llm/llm.ts:252

next

next(): Promise<IteratorResult<ChatChunk, any>>
Returns Promise<IteratorResult<ChatChunk, any>>
Implementation of AsyncIterableIterator.next
- Defined in llm/llm.ts:248