Skip to content
Quantoros

What is overfitting? How to avoid it in strategy development?

Quant ResearchLevel: Intermediate

What is overfitting? How to avoid it in strategy development?

Hints
  • Compare training and independent validation errors.
  • Imagine fitting on a different sample. Which predictions change, and why?

Answer

Strategy overfitting includes choosing a rule that happened to fit historical noise after many trials, even when each individual model is simple. Preserve a chronological holdout, use walk-forward development, record rejected variants and account for multiple testing. Check nearby parameters, different regimes and economic mechanisms without repeatedly redesigning against the final test set. Large in-sample versus out-of-sample gaps are warnings, not a complete diagnosis; costs, leakage and regime changes must be investigated separately.

Source and licence: Quant Research Interview Notes — SoYuCry; English translation by photon2563 · MIT · answer: Quantoros editorial

Related questions