What is linear regression? When do we use it?
Classic MLLevel: FoundationLinear regression
What is linear regression? When do we use it?
Hints
- Write the model using the design matrix, parameters and residual.
- Distinguish conditions for computing the estimate from conditions for inference about it.
Answer
Linear regression is a model that assumes a linear relationship between the input variables (X) and the single output variable (y).
With a simple equation:
y = B0 + B1*x1 + ... + Bn * xN
B is regression coefficients, x values are the independent (explanatory) variables and y is dependent variable.
The case of one explanatory variable is called simple linear regression. For more than one explanatory variable, the process is called multiple linear regression.
Simple linear regression:
y = B0 + B1*x1
Multiple linear regression:
y = B0 + B1*x1 + ... + Bn * xN
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0