What is overfitting? How to avoid it in strategy development?
Quant ResearchLevel: Intermediate
What is overfitting? How to avoid it in strategy development?
Hints
- Compare training and independent validation errors.
- Imagine fitting on a different sample. Which predictions change, and why?
Answer
Strategy overfitting includes choosing a rule that happened to fit historical noise after many trials, even when each individual model is simple. Preserve a chronological holdout, use walk-forward development, record rejected variants and account for multiple testing. Check nearby parameters, different regimes and economic mechanisms without repeatedly redesigning against the final test set. Large in-sample versus out-of-sample gaps are warnings, not a complete diagnosis; costs, leakage and regime changes must be investigated separately.
Source and licence: Quant Research Interview Notes — SoYuCry; English translation by photon2563 · MIT · answer: Quantoros editorial