Class LLMObsCustomEvalConfigLLMJudgeConfig

LLM judge configuration for a custom evaluator.

Hierarchy

  • LLMObsCustomEvalConfigLLMJudgeConfig

Constructors

constructor

Properties

additionalProperties? assessmentCriteria? inferenceParams lastUsedLibraryPromptTemplateName? modifiedLibraryPromptTemplate? outputSchema? parsingType? promptTemplate?

Constructors

constructor

Properties

Optional additionalProperties

additionalProperties?: {
    [key: string]: any;
}

A container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.

Type declaration

  • [key: string]: any

Optional assessmentCriteria

assessmentCriteria?: LLMObsCustomEvalConfigAssessmentCriteria

Criteria used to assess the pass/fail result of a custom evaluator.

inferenceParams

inferenceParams: LLMObsCustomEvalConfigInferenceParams

LLM inference parameters for a custom evaluator.

Optional lastUsedLibraryPromptTemplateName

lastUsedLibraryPromptTemplateName?: string

Name of the last library prompt template used.

Optional modifiedLibraryPromptTemplate

modifiedLibraryPromptTemplate?: boolean

Whether the library prompt template was modified.

Optional outputSchema

outputSchema?: {
    [key: string]: any;
}

JSON schema describing the expected output format of the LLM judge.

Type declaration

  • [key: string]: any

Optional parsingType

parsingType?: LLMObsCustomEvalConfigParsingType

Output parsing type for a custom LLM judge evaluator.

Optional promptTemplate

promptTemplate?: LLMObsCustomEvalConfigPromptMessage[]

List of messages forming the LLM judge prompt template.

Settings

Member Visibility

Theme

Generated using TypeDoc