What’s the difference between random forest and gradient boosting?
Classic MLLevel: IntermediateGradient boosting
What’s the difference between random forest and gradient boosting?
Hints
- How are training samples formed and how do ensemble trees differ?
- Consider correlation between model errors, not only individual quality.
Answer
- Random Forests builds each tree independently while Gradient Boosting builds one tree at a time. 2. Random Forests combine results at the end of the process (by averaging or "majority rules") while Gradient Boosting combines results along the way.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0