What is regression? Which models can you use to solve a regression problem?
Classic MLLevel: FoundationLinear regression
What is regression? Which models can you use to solve a regression problem?
Hints
- State the task, inputs and prediction target.
- Compare with a simple baseline: assumptions, objective and independent validation.
Answer
Regression is a part of supervised ML. Regression models investigate the relationship between a dependent (target) and independent variable (s) (predictor). Here are some common regression models
- Linear Regression establishes a linear relationship between target and predictor (s). It predicts a numeric value and has a shape of a straight line.
- Polynomial Regression has a regression equation with the power of independent variable more than 1. It is a curve that fits into the data points.
- Ridge Regression helps when predictors are highly correlated (multicollinearity problem). It penalizes the squares of regression coefficients but doesn’t allow the coefficients to reach zeros (uses L2 regularization).
- Lasso Regression penalizes the absolute values of regression coefficients and allows some of the coefficients to reach absolute zero (thereby allowing feature selection).
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0