Skip to content
Quantoros

What’s the difference between random forest and gradient boosting?

Classic MLLevel: IntermediateGradient boosting

What’s the difference between random forest and gradient boosting?

Hints
  • How are training samples formed and how do ensemble trees differ?
  • Consider correlation between model errors, not only individual quality.

Answer

  1. Random Forests builds each tree independently while Gradient Boosting builds one tree at a time. 2. Random Forests combine results at the end of the process (by averaging or "majority rules") while Gradient Boosting combines results along the way.

Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0

Related questions