What are the main parameters in the gradient boosting model?
Classic MLLevel: IntermediateGradient boosting
What are the main parameters in the gradient boosting model?
Hints
- What does the next learner predict relative to the current ensemble?
- Connect sequential model additions to loss optimization.
Answer
There are many parameters, but below are a few key defaults.
- learning_rate=0.1 (shrinkage).
- n_estimators=100 (number of trees).
- max_depth=3.
- min_samples_split=2.
- min_samples_leaf=1.
- subsample=1.0.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0