Class LLMStreamAbstract

constructor

• new LLMStream(llm, chatCtx, fncCtx?): llm.LLMStream

• Parameters

  • llm: llm.LLM
  • chatCtx: ChatContext
  • Optional fncCtx: FunctionContext

  Returns llm.LLMStream

Abstract label

chatCtx

• get chatCtx(): ChatContext

• The initial chat context of this stream.

  Returns ChatContext

fncCtx

• get fncCtx(): undefined | FunctionContext

• The function context of this stream.

  Returns undefined | FunctionContext

functionCalls

• get functionCalls(): FunctionCallInfo<any, any>[]

• List of called functions from this stream.

  Returns FunctionCallInfo<any, any>[]

[asyncIterator]

• [asyncIterator](): llm.LLMStream

• Returns llm.LLMStream

close

• close(): void

• Returns void

executeFunctions

• executeFunctions(): FunctionCallInfo<any, any>[]

• Execute all deferred functions of this stream concurrently.

  Returns FunctionCallInfo<any, any>[]

next

• next(): Promise<IteratorResult<ChatChunk, any>>

• Returns Promise<IteratorResult<ChatChunk, any>>