Skip to content
Quantoros

Explain overfitting and list five concrete ways to prevent it.

Classic MLLevel: IntermediateClassical machine learning

Explain overfitting and list five concrete ways to prevent it.

Hints
  • Compare training and independent validation errors.
  • Imagine fitting on a different sample. Which predictions change, and why?

Answer

Overfitting is when a model captures noise/idiosyncrasies of the training set rather than the true underlying pattern, leading to strong training performance but poor generalization. Mitigations: (1) more training data, (2) regularization (L1/L2, dropout), (3) cross-validation with early stopping, (4) reducing model complexity (fewer features/parameters, shallower trees), (5) ensembling (bagging averages out variance) and/or data augmentation.

Source and licence: Ishan Dutta — Awesome Data Science Interview Q&A · MIT

Related questions