Class: DatadogAPIClient::V2::AiGatewayRateLimitInstanceAttributes
- Inherits:
-
Object
- Object
- DatadogAPIClient::V2::AiGatewayRateLimitInstanceAttributes
- Includes:
- BaseGenericModel
- Defined in:
- lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb
Overview
One counter of a template rate limit and its live usage.
Instance Attribute Summary collapse
-
#additional_properties ⇒ Object
Returns the value of attribute additional_properties.
-
#cost_microcents ⇒ Object
Priced spend, in microcents, counted in the rolling one-minute window.
-
#cost_microcents_per_minute ⇒ Object
The rate limit's per-counter spend limit, in microcents.
-
#first_seen ⇒ Object
readonly
When the gateway first recorded a request for this counter.
-
#input_tokens ⇒ Object
readonly
Input tokens counted in the rolling one-minute window.
-
#input_tokens_per_minute ⇒ Object
The rate limit's per-counter input token limit.
-
#instance_key ⇒ Object
readonly
Opaque canonical key identifying the counter.
-
#last_seen ⇒ Object
readonly
When the gateway last recorded this counter as hot, meaning it was at 80% or more of a limit, or it limited or would have limited a request.
-
#limited_requests ⇒ Object
readonly
Requests this counter rejected in the last 15 minutes (ENFORCE).
-
#output_tokens ⇒ Object
readonly
Output tokens counted in the rolling one-minute window.
-
#output_tokens_per_minute ⇒ Object
The rate limit's per-counter output token limit.
-
#rate_limit_id ⇒ Object
readonly
Rate limit UUID.
-
#requests ⇒ Object
readonly
Requests counted in the rolling one-minute window.
-
#requests_per_minute ⇒ Object
The rate limit's per-counter request limit.
-
#split_dims ⇒ Object
readonly
The counter's value for each per-value dimension.
-
#usage_known ⇒ Object
readonly
False when this counter's usage wasn't read because the request already read the most counters it may.
-
#utilization ⇒ Object
readonly
The fullest of the rate limit's limits in the rolling window, as a fraction.
-
#would_limit_requests ⇒ Object
readonly
Requests this counter would have rejected in the last 15 minutes (ALERT).
Method Summary
Methods included from BaseGenericModel
Instance Attribute Details
#additional_properties ⇒ Object
Returns the value of attribute additional_properties.
75 76 77 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 75 def additional_properties @additional_properties end |
#cost_microcents ⇒ Object
Priced spend, in microcents, counted in the rolling one-minute window. The value is 0 when the rate limit doesn't limit cost.
25 26 27 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 25 def cost_microcents @cost_microcents end |
#cost_microcents_per_minute ⇒ Object
The rate limit's per-counter spend limit, in microcents. Null when the rate limit doesn't limit cost.
28 29 30 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 28 def cost_microcents_per_minute @cost_microcents_per_minute end |
#first_seen ⇒ Object
When the gateway first recorded a request for this counter.
31 32 33 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 31 def first_seen @first_seen end |
#input_tokens ⇒ Object
Input tokens counted in the rolling one-minute window.
34 35 36 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 34 def input_tokens @input_tokens end |
#input_tokens_per_minute ⇒ Object
The rate limit's per-counter input token limit. Null when it doesn't limit input tokens.
37 38 39 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 37 def input_tokens_per_minute @input_tokens_per_minute end |
#instance_key ⇒ Object
Opaque canonical key identifying the counter.
40 41 42 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 40 def instance_key @instance_key end |
#last_seen ⇒ Object
When the gateway last recorded this counter as hot, meaning it was at 80% or more of a limit, or it limited or would have limited a request. This value can lag live traffic by a few minutes.
43 44 45 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 43 def last_seen @last_seen end |
#limited_requests ⇒ Object
Requests this counter rejected in the last 15 minutes (ENFORCE).
46 47 48 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 46 def limited_requests @limited_requests end |
#output_tokens ⇒ Object
Output tokens counted in the rolling one-minute window.
49 50 51 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 49 def output_tokens @output_tokens end |
#output_tokens_per_minute ⇒ Object
The rate limit's per-counter output token limit. Null when it doesn't limit output tokens.
52 53 54 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 52 def output_tokens_per_minute @output_tokens_per_minute end |
#rate_limit_id ⇒ Object
Rate limit UUID.
55 56 57 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 55 def rate_limit_id @rate_limit_id end |
#requests ⇒ Object
Requests counted in the rolling one-minute window.
58 59 60 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 58 def requests @requests end |
#requests_per_minute ⇒ Object
The rate limit's per-counter request limit. Null when it doesn't limit requests.
61 62 63 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 61 def requests_per_minute @requests_per_minute end |
#split_dims ⇒ Object
The counter's value for each per-value dimension. user_id and team_id values are raw UUIDs.
64 65 66 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 64 def split_dims @split_dims end |
#usage_known ⇒ Object
False when this counter's usage wasn't read because the request already read the most counters it may. Its usage then reads as zero.
67 68 69 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 67 def usage_known @usage_known end |
#utilization ⇒ Object
The fullest of the rate limit's limits in the rolling window, as a fraction. 1 or more means the counter is at its limit.
70 71 72 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 70 def utilization @utilization end |
#would_limit_requests ⇒ Object
Requests this counter would have rejected in the last 15 minutes (ALERT).
73 74 75 |
# File 'lib/datadog_api_client/v2/models/ai_gateway_rate_limit_instance_attributes.rb', line 73 def would_limit_requests @would_limit_requests end |