What is the difference between Type I and Type II error?
StatisticsLevel: FoundationStatistics and probability
What is the difference between Type I and Type II error?
Hints
- Identify the random variable, sample and estimated parameter.
- State the assumptions; distinguish an estimate from its uncertainty.
Answer
A Type I error (false positive) is rejecting a true null hypothesis — concluding there's an effect when there isn't one. Its probability is α (significance level). A Type II error (false negative) is failing to reject a false null hypothesis — missing a real effect. Its probability is β, and 1 − β is statistical power. There's a trade-off: lowering α (stricter significance) generally increases β unless you increase sample size.
Follow-up: How would you decide which error is more costly in a fraud-detection system?
Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT