Skip to content

Add CUPED variance reduction documentation page#37941

Draft
tbuffington7 wants to merge 5 commits into
masterfrom
tyler.buffington/cuped-documentation
Draft

Add CUPED variance reduction documentation page#37941
tbuffington7 wants to merge 5 commits into
masterfrom
tyler.buffington/cuped-documentation

Conversation

@tbuffington7

Copy link
Copy Markdown

Summary

Adds a new experiments methodology page documenting CUPED (Controlled-experiment Using Pre-Experiment Data), our default variance reduction technique.

The page covers:

  • Overview: why variance reduction matters and what CUPED does
  • How CUPED works: zero-in-expectation adjustments added to the raw lift
  • Default covariates (30-day pre-exposure aggregations + subject properties) and missing-value handling
  • How coefficients are selected (variance minimization, not regression adjustment)
  • Variance reduction across mean, ratio, and percentile metrics
  • FAQ addressing common misconceptions

Also wires the page into the experiments nav and cross-links it from Analysis Methods.

Test plan

  • Preview renders correctly (formulas, alert callouts, definition lists, covariate table)
  • Page appears in the experiments sidebar between Analysis Methods and Read Experiment Results
  • Internal links and the Analysis Methods cross-link resolve

Document CUPED as a metric-augmentation variance reduction technique:
overview, how the adjustments work, default covariates and missing-value
handling, coefficient selection, metric-type coverage, and an FAQ. Wire
the page into the experiments nav and cross-link from Analysis Methods.
@github-actions github-actions Bot added the Architecture Everything related to the Doc backend label Jul 2, 2026
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Architecture Everything related to the Doc backend

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant