The output of a completed LLM inference call.

Hierarchy

  • LLMObsInferenceRunResult

Constructors

Properties

additionalProperties?: {
    [key: string]: any;
}

A container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.

Type declaration

  • [key: string]: any
assessment: null | string

An optional assessment of the inference output quality.

content: string

The text content of the model response.

finishReason: string

The reason the model stopped generating tokens.

inferenceCodes: LLMObsInferenceCode[]

List of generated code snippets for the inference configuration.

inputTokens: number

Number of input tokens consumed.

internalReasoning?: LLMObsInternalReasoning

The model's internal reasoning or thinking output, if available.

latency: number

Request latency in milliseconds.

outputTokens: number

Number of output tokens generated.

List of tools available to the model.

totalTokens: number

Total tokens used (input plus output).

Generated using TypeDoc