Class ExperimentsVariantResultsV2DTODataAttributesMetricsItemsAnalysesItems

One statistical comparison for a metric and variant.

Hierarchy

  • ExperimentsVariantResultsV2DTODataAttributesMetricsItemsAnalysesItems

Constructors

Properties

additionalProperties?: {
    [key: string]: any;
}

A container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.

Type declaration

  • [key: string]: any

Lower and upper bounds of the reported statistical interval.

confidenceLevel?: number

Configured nominal confidence level. Interval bounds can use an adjusted level for multiple testing or hybrid methods.

evsi?: number

Expected reduction in minimum expected regret from collecting more sample data.

expectationAboveZero?: number

Expected effect when the effect is positive.

expectationBelowZero?: number

Expected effect when the effect is negative.

globalLift?: number

Estimated lift across the population. Calculated as metric coverage multiplied by the experiment lift.

globalLiftLowerBound?: number

Lower bound of the estimated lift across the population.

globalLiftUpperBound?: number

Upper bound of the estimated lift across the population.

isCupedAdjusted?: boolean

Whether CUPED used pre-experiment data to reduce variance in this result.

isUnreliable?: boolean

Whether the statistical result is marked as unreliable.

Whether the reported lift is relative or absolute.

Statistical method used to calculate this result.

minimumExpectedRegret?: number

The smaller expected opportunity cost of choosing treatment or control.

pValue?: number

Probability, under the no-effect hypothesis, of a result at least as extreme as the observed result.

pointEstimate?: number

Estimated difference between the variant and control for this metric.

probabilityAboveZero?: number

Estimated probability that the effect is greater than zero.

probabilityBelowZero?: number

Estimated probability that the effect is less than zero.

standardError?: number

Estimated uncertainty in the effect estimate.

Reason that the statistical result is marked as unreliable.

variantMetricValue?: number

Metric value calculated for this variant.

zScore?: number

Standardized statistic used to compare the observed effect with zero.

Generated using TypeDoc