Why can one-vs-rest and one-vs-one multiclass ROC-AUC react differently to imbalance?
Classic MLLevel: AdvancedMulticlass AUC aggregation
Why can one-vs-rest and one-vs-one multiclass ROC-AUC react differently to imbalance?
Hints
- Inspect the negative population in each binary problem.
- Class weighting and decomposition both matter.
Answer
This answer is part of mentoring
Advanced questions come with a full breakdown and a mock interview with a working quant researcher. The first call is free.
Source and licence: scikit-learn 1.7.2 — model evaluation · BSD-3-Clause · answer: Quantoros editorial