Why sample a positive scale parameter over several orders of magnitude with loguniform rather than uniform?
Classic MLLevel: IntermediateMultiplicative search scale
Why sample a positive scale parameter over several orders of magnitude with loguniform rather than uniform?
Hints
- Compare intervals [0.001, 0.01] and [1, 10].
- Equal ratios differ from equal differences.
Answer
Loguniform allocates comparable probability to multiplicative intervals. Uniform sampling spends most draws in the largest numeric region and undersamples small orders of magnitude.
Source and licence: scikit-learn 1.7.2 — grid search · BSD-3-Clause · answer: Quantoros editorial