Skip to content
Quantoros

What are the main parameters in the gradient boosting model?

Classic MLLevel: IntermediateGradient boosting

What are the main parameters in the gradient boosting model?

Hints
  • What does the next learner predict relative to the current ensemble?
  • Connect sequential model additions to loss optimization.

Answer

There are many parameters, but below are a few key defaults.

  • learning_rate=0.1 (shrinkage).
  • n_estimators=100 (number of trees).
  • max_depth=3.
  • min_samples_split=2.
  • min_samples_leaf=1.
  • subsample=1.0.

Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0

Related questions