Type Alias ExperimentSummaryEvaluator
ExperimentSummaryEvaluator: (
inputs: any[],
outputs: any[],
expectedOutputs: any[],
evaluatorResults: Record<string, any[]>,
metadata?: Record<string, any>[],
) => any | Promise<any>
Type Declaration
-
- (
inputs: any[],
outputs: any[],
expectedOutputs: any[],
evaluatorResults: Record<string, any[]>,
metadata?: Record<string, any>[],
): any | Promise<any>
-
Parameters
- inputs: any[]
- outputs: any[]
- expectedOutputs: any[]
- evaluatorResults: Record<string, any[]>
Optionalmetadata: Record<string, any>[]
Returns any | Promise<any>
Scores all rows in an experiment run and emits a summary metric.