Why is one numeric variance threshold questionable across features measured in dollars, meters and fractions?
Classic MLLevel: IntermediateVariance filter and units
Why is one numeric variance threshold questionable across features measured in dollars, meters and fractions?
Hints
- Rescaling a feature changes its variance.
- The procedure is unsupervised.
Answer
Variance depends on squared measurement units. A raw threshold can select scale rather than useful signal; choose a deliberate representation and remember the filter ignores y.
Source and licence: scikit-learn 1.7.2 — feature selection · BSD-3-Clause · answer: Quantoros editorial