Skip to content
Quantoros

What is the difference between Type I and Type II error?

StatisticsLevel: FoundationStatistics and probability

What is the difference between Type I and Type II error?

Hints
  • Identify the random variable, sample and estimated parameter.
  • State the assumptions; distinguish an estimate from its uncertainty.

Answer

A Type I error (false positive) is rejecting a true null hypothesis — concluding there's an effect when there isn't one. Its probability is α (significance level). A Type II error (false negative) is failing to reject a false null hypothesis — missing a real effect. Its probability is β, and 1 − β is statistical power. There's a trade-off: lowering α (stricter significance) generally increases β unless you increase sample size.

Follow-up: How would you decide which error is more costly in a fraud-detection system?

Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT

Related questions