Skip to content
Quantoros

Why can distributed histogram boosting communicate less than a scheme that exchanges raw candidate data at every split?

Classic MLLevel: IntermediateLightGBM · Features

Why can distributed histogram boosting communicate less than a scheme that exchanges raw candidate data at every split?

Hints
  • Look at the representation sent over the network.
  • Compression changes the communication scaling.

Answer

Workers exchange compact aggregated bin statistics and selected split information rather than every raw feature value. The gain depends on bin/feature counts and network costs; more workers are not automatically faster.

Source and licence: LightGBM · Features · MIT · answer: Quantoros editorial

Related questions