Skip to content
Quantoros

How can we know which features are more important for the decision tree model?

Classic MLLevel: IntermediateDecision trees

How can we know which features are more important for the decision tree model?

Hints
  • How is one split selected and which objective does it improve?
  • Check stopping rules, leaf size and the difference between fitting and prediction.

Answer

Often, we want to find a split such that it minimizes the sum of the node impurities. The impurity criterion is a parameter of decision trees. Popular methods to measure the impurity are the Gini impurity and the entropy describing the information gain.

Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0

Related questions