What is the ROC curve, and what does AUC actually represent?
Classic MLLevel: FoundationClassical machine learning
What is the ROC curve, and what does AUC actually represent?
Hints
- Write TP, FP, TN and FN for a small example.
- Separate ranking quality, threshold selection and probability calibration. Which error costs more?
Answer
The ROC curve plots True Positive Rate (recall) against False Positive Rate at every possible classification threshold. AUC (Area Under the Curve) represents the probability that a randomly chosen positive example is ranked higher (by the model's score) than a randomly chosen negative example — an AUC of 0.5 means random guessing, 1.0 means perfect ranking. AUC is threshold-independent, which makes it useful for comparing models, but it can be misleadingly optimistic on heavily imbalanced datasets where PR-AUC is more informative.
Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT