Figure 2From “What is CUPED?”
A CUPED analysis record
Write down the metric, the covariate, the window, the coverage, the unit and the checks before reading an adjusted result.
Figure 2A CUPED analysis record
Source: Author's decision worksheet. The covariate and window fields follow Deng et al. (2013), pp. 127 to 130; the metric field follows Deng et al. (2013), p. 130; the coverage and unit fields follow Deng et al. (2013), pp. 127 to 129; the checks field follows Kohavi et al. (2009), pp. 151 and 152, and Deng et al. (2013), p. 128. The fields are reader inputs; no company data is supplied.

Source and evidence
Each line names a claim related to this exhibit, its source, and how it was checked.
- B CUPED-OWN-C3 A CUPED analysis is written down as one record: metric, covariate and why the treatment cannot move it, pre-period window, coverage, unit (user, account, page or order), and checks (unadjusted result, A/A test); illustrated with a hypothetical B2B software firm's report builder test that randomizes whole accounts, analyses per user with the delta method, and checks the pre-period correlation of revenue per account before adjusting it.Author worksheet grounded in DXKW13-C4, DXKW13-C5 and KLSH09-C5
Grades: A, verified against the printed page of the primary source · B, primary source, text layer only · C, authoritative secondary · D, reported.
From the essay
From the research bench
What is CUPED?
CUPED adjusts an A/B test metric with the same metric measured before the test. It cuts noise, not bias, and needs a covariate the test cannot move.
Read the essayThis exhibit belongs to an essay: the numbers live here, the argument lives there.
Cite or embed
Contact
Bring the question you're working on.
Research, a guest lecture, or a commercial question.


