Given a parent histogram and the histogram of its smaller child, how can LightGBM avoid scanning the larger child?
Classic MLLevel: IntermediateLightGBM · Features
Given a parent histogram and the histogram of its smaller child, how can LightGBM avoid scanning the larger child?
Hints
- Parent rows are the disjoint union of child rows.
- Additive statistics can be subtracted bin by bin.
Answer
Subtract the smaller-child bin statistics from the parent to obtain the sibling histogram. This works because the aggregated statistics are additive for the partition, with the same bin definitions.
Source and licence: LightGBM · Features · MIT · answer: Quantoros editorial