Class DuplexSession<Events>Abstract

A provider session with continuous audio output.

Events adds provider-specific callbacks to DuplexSessionCallbacks. Provider-specific APIs are accessible through Agent.duplexSession.

Type Parameters

  • Events extends EventMap = Record<never, never>

Hierarchy

Constructors

  • Create a provider session owned by the given model.

    Type Parameters

    • Events extends EventMap = Record<never, never>

    Parameters

    • duplexModel: DuplexModel

      Model that created this session.

    Returns DuplexSession<Events>

Properties

duplexModel: DuplexModel

Model that created this session.

Accessors

Methods

  • Ask the model to speak; its next speech is the reply. Providers may override this.

    Parameters

    Returns void

  • Apply instructions, or reject changes the provider cannot accept.

    Parameters

    • instructions: string

    Returns Promise<void>

  • Apply the complete startup configuration before releasing a waiting provider connection.

    Parameters

    Returns Promise<void>

  • Mark the session closing, release configuration waits, and close provider resources.

    Returns Promise<void>

  • Feed an input audio frame to the provider.

    Parameters

    • frame: AudioFrame

    Returns void

  • Feed an input video frame. Providers without video input can ignore it.

    Parameters

    • _frame: VideoFrame

    Returns void