Class: DatadogAPIClient::V2::AiGatewayRoutingReasoningLevel

Inherits:
Object
  • Object
show all
Includes:
BaseEnumModel
Defined in:
lib/datadog_api_client/v2/models/ai_gateway_routing_reasoning_level.rb

Overview

Optional reasoning effort preference for this model destination. Must be supported by the selected model and provider. For provider "*", every eligible provider must support the level. An explicit value overrides the request's reasoning setting, subject to model-group policy. Omitted or null preserves request and provider behavior; none is an explicit level, not the default. On update, omission preserves a saved target override; null explicitly clears it. Routing-rule references cannot set this field; each referenced model destination owns its override. If an override cannot be applied at runtime, the gateway keeps the destination and restores the caller's original reasoning settings, or preserves the provider default when omitted. It rechecks all applicable route and model-group policies against those settings before sending. Model-group max_reasoning_level enforces hard limits; the override is not an additional cap. Normal fallback applies if governance denies the resulting request or the destination cannot otherwise serve it. Metrics and span tags record the override outcome and incompatibility reason. When response headers have not already been committed, X-Ai-Gateway-Reasoning-Override reports applied or not_applied for the returned attempt, and X-Ai-Gateway-Reasoning-Override-Reason reports the reason when not applied.

Constant Summary collapse

NONE = 
"none".freeze
MINIMAL = 
"minimal".freeze
LOW = 
"low".freeze
MEDIUM = 
"medium".freeze
HIGH = 
"high".freeze
XHIGH = 
"xhigh".freeze
MAX = 
"max".freeze

Method Summary

Methods included from BaseEnumModel

included