Can we use L2 regularization for feature selection?
Classic MLLevel: IntermediateFeature selection
Can we use L2 regularization for feature selection?
Hints
- Start from the loss: what changes when a parameter penalty is added?
- Compare the constraint geometry and behavior near zero. Separately consider feature scaling.
Answer
No, Because L2 regularization does not make the weights zero but only makes them very very small. L2 regularization can be used to solve multicollinearity since it stabilizes the model.
Source and licence: Alexey Grigorev & contributors — Data Science Interviews · CC-BY-4.0