Why can distributed histogram boosting communicate less than a scheme that exchanges raw candidate data at every split?
Classic MLLevel: IntermediateLightGBM · Features
Why can distributed histogram boosting communicate less than a scheme that exchanges raw candidate data at every split?
Hints
- Look at the representation sent over the network.
- Compression changes the communication scaling.
Answer
Workers exchange compact aggregated bin statistics and selected split information rather than every raw feature value. The gain depends on bin/feature counts and network costs; more workers are not automatically faster.
Source and licence: LightGBM · Features · MIT · answer: Quantoros editorial