Type alias LLMMetrics

LLMMetrics: {
    cancelled: boolean;
    completionTokens: number;
    durationMs: number;
    label: string;
    promptCachedTokens: number;
    promptTokens: number;
    requestId: string;
    speechId?: string;
    timestamp: number;
    tokensPerSecond: number;
    totalTokens: number;
    ttftMs: number;
    type: "llm_metrics";
}

Type declaration

  • cancelled: boolean
  • completionTokens: number
  • durationMs: number

    Duration of the request in milliseconds.

  • label: string
  • promptCachedTokens: number
  • promptTokens: number
  • requestId: string
  • Optional speechId?: string
  • timestamp: number
  • tokensPerSecond: number
  • totalTokens: number
  • ttftMs: number

    Time to first token in milliseconds.

  • type: "llm_metrics"

Settings

Member Visibility

Theme