What is the normal equation?
MathematicsLevel: IntermediateLinear regression
What is the normal equation?
Hints
- Translate the statement into notation and check the domain.
- Start with a simple case, then check the theorem's assumptions.
Answer
Normal equations are equations obtained by setting equal to zero the partial derivatives of the sum of squared errors (least squares); normal equations allow one to estimate the parameters of a multiple linear regression.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0