Skip to content
Quantoros

Can an XGBoost round contribute a nonzero prediction when gamma prevents every split?

Classic MLLevel: IntermediateXGBoost · Parameters

Can an XGBoost round contribute a nonzero prediction when gamma prevents every split?

Hints
  • Separate a split from a leaf score.
  • A depth-zero tree still has a leaf.

Answer

Yes. A tree can consist of a single leaf with a fitted score. Gamma regulates whether splitting improves the objective enough, not whether the unsplit leaf must predict zero.

Source and licence: XGBoost · Parameters · Apache-2.0 · answer: Quantoros editorial

Related questions