Class AiGatewayModelLimits

Token limits reported by the enrichment source.

Hierarchy

  • AiGatewayModelLimits

Constructors

constructor

Properties

additionalProperties? contextWindowTokens? maxInputTokens? maxOutputTokens?

Constructors

constructor

Properties

Optional additionalProperties

additionalProperties?: {
    [key: string]: any;
}

A container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.

Type declaration

  • [key: string]: any

Optional contextWindowTokens

contextWindowTokens?: number

Total model context window in tokens.

Optional maxInputTokens

maxInputTokens?: number

Maximum input tokens when reported separately.

Optional maxOutputTokens

maxOutputTokens?: number

Maximum output tokens.

Settings

Member Visibility

Theme

Generated using TypeDoc