How do we interpret weights in linear models?
Classic MLLevel: IntermediateRegularization
How do we interpret weights in linear models?
Hints
- State the task, inputs and prediction target.
- Compare with a simple baseline: assumptions, objective and independent validation.
Answer
Without normalizing weights or variables, if you increase the corresponding predictor by one unit, the coefficient represents on average how much the output changes. By the way, this interpretation still works for logistic regression - if you increase the corresponding predictor by one unit, the weight represents the change in the log of the odds.
If the variables are normalized, we can interpret weights in linear models like the importance of this variable in the predicted result.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0