What is Simpson's Paradox? Give an example.
StatisticsLevel: FoundationStatistics and probability
What is Simpson's Paradox? Give an example.
Hints
- Identify the random variable, sample and estimated parameter.
- State the assumptions; distinguish an estimate from its uncertainty.
Answer
Simpson's Paradox occurs when a trend appears in several different groups of data but disappears or reverses when the groups are combined — usually due to a confounding/lurking variable with unequal group sizes. Classic example: a treatment can have a lower success rate than a control in every age subgroup individually, yet a higher overall success rate, because more severe cases (lower baseline success) were disproportionately assigned to the control group. It's a strong argument for always checking results within relevant subgroups, not just in aggregate.
Follow-up: How would you detect Simpson's Paradox in an A/B test result?
Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT