Optional additionalA container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.
Optional anthropicAnthropic-specific metadata for an inference request.
Optional azureAzure OpenAI-specific metadata for an integration account or inference request.
Optional bedrockAmazon Bedrock-specific metadata for an inference request.
Optional errorError details returned when an inference provider returns an error.
Optional frequencyFrequency penalty that was applied.
Optional jsonJSON schema that was applied for structured output.
Optional maxMaximum number of completion tokens that were configured.
Optional maxMaximum number of tokens that were configured.
List of messages in an inference conversation.
The model identifier used for inference.
Optional openaiOpenAI-specific metadata for an inference request.
Optional presencePresence penalty that was applied.
The output of a completed LLM inference call.
Optional temperatureSampling temperature that was used.
Optional toolsList of tools available to the model.
Optional topKTop-K sampling parameter that was used.
Optional topPNucleus sampling parameter that was used.
Optional vertexVertex AI-specific metadata for an integration account or inference request.
Generated using TypeDoc
The result of an LLM inference request, including input parameters and the model response.