What is a confidence interval, and what does "95% confidence" actually mean?
StatisticsLevel: FoundationStatistics and probability
What is a confidence interval, and what does "95% confidence" actually mean?
Hints
- Specify the null hypothesis, observation unit and test statistic.
- Separate effect size, uncertainty and the probability of data under the null.
Answer
A confidence interval is a range constructed from sample data that is likely to contain the true population parameter. "95% confidence" means: if you repeated the sampling process many times and built an interval each time using the same method, 95% of those intervals would contain the true parameter — it does not mean there's a 95% probability the true value lies in this one specific interval (a common misconception, since the true value is fixed, not random).
Follow-up: How does confidence interval width change as sample size increases?
Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT