Skip to content
Quantoros

Why can two LightGBM trees with the same number of leaves have very different maximum depths?

Classic MLLevel: IntermediateLightGBM · Tuning

Why can two LightGBM trees with the same number of leaves have very different maximum depths?

Hints
  • A leaf budget says nothing about branch balance.
  • Follow repeated splits along one branch.

Answer

Leaf-wise growth repeatedly expands the most promising leaf, so it can create an unbalanced chain. A leaf budget does not impose a balanced shape; constrain depth separately if needed.

Source and licence: LightGBM · Tuning · MIT · answer: Quantoros editorial

Related questions