Can an XGBoost round contribute a nonzero prediction when gamma prevents every split?
Classic MLLevel: IntermediateXGBoost · Parameters
Can an XGBoost round contribute a nonzero prediction when gamma prevents every split?
Hints
- Separate a split from a leaf score.
- A depth-zero tree still has a leaf.
Answer
Yes. A tree can consist of a single leaf with a fitted score. Gamma regulates whether splitting improves the objective enough, not whether the unsplit leaf must predict zero.
Source and licence: XGBoost · Parameters · Apache-2.0 · answer: Quantoros editorial