Skip to content
Quantoros

Is ROC-AUC computed on all crossvalpredict probabilities necessarily equal to mean fold ROC-AUC?

Classic MLLevel: AdvancedPooled out-of-fold metrics

Is ROC-AUC computed on all cross_val_predict probabilities necessarily equal to mean fold ROC-AUC?

Hints
  • AUC uses pairs, including cross-fold pairs when pooled.
  • Different models may use different score scales.

Answer

This answer is part of mentoring

Advanced questions come with a full breakdown and a mock interview with a working quant researcher. The first call is free.

Source and licence: scikit-learn 1.7.2 — cross validation · BSD-3-Clause · answer: Quantoros editorial

Related questions