Class AiGatewayRateLimitUsageAttributes

Live consumption of one AI Gateway rate limit.

Hierarchy

  • AiGatewayRateLimitUsageAttributes

Constructors

constructor

Properties

additionalProperties? inputTokens limitedRequests outputTokens requests wouldLimitRequests

Constructors

constructor

Properties

Optional additionalProperties

additionalProperties?: {
    [key: string]: any;
}

A container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.

Type declaration

  • [key: string]: any

inputTokens

inputTokens: number

Input tokens counted in the rolling one-minute window.

limitedRequests

limitedRequests: number

Requests this rate limit rejected in the last 15 minutes. Applies when mode is ENFORCE.

outputTokens

outputTokens: number

Output tokens counted in the rolling one-minute window.

requests

requests: number

Requests counted in the rolling one-minute window.

wouldLimitRequests

wouldLimitRequests: number

Requests this rate limit would have rejected in the last 15 minutes. Applies when mode is ALERT.

Settings

Member Visibility

Theme

Generated using TypeDoc