Why can two LightGBM trees with the same number of leaves have very different maximum depths?
Classic MLLevel: IntermediateLightGBM · Tuning
Why can two LightGBM trees with the same number of leaves have very different maximum depths?
Hints
- A leaf budget says nothing about branch balance.
- Follow repeated splits along one branch.
Answer
Leaf-wise growth repeatedly expands the most promising leaf, so it can create an unbalanced chain. A leaf budget does not impose a balanced shape; constrain depth separately if needed.
Source and licence: LightGBM · Tuning · MIT · answer: Quantoros editorial