Explain p-value in plain language.
StatisticsLevel: IntermediateStatistics and probability
Explain p-value in plain language.
Hints
- Specify the null hypothesis, observation unit and test statistic.
- Separate effect size, uncertainty and the probability of data under the null.
Answer
The p-value is the probability of observing data at least as extreme as what you saw, assuming the null hypothesis is true. It is not the probability the null hypothesis is true, and it's not the probability your result is due to chance. A small p-value (typically < 0.05) suggests the observed data would be unlikely under the null, giving evidence to reject it — but statistical significance isn't the same as practical significance.
Follow-up: Why is p-hacking a problem, and how do you guard against it?
Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT