Skip to content
Quantoros

Why sample a positive scale parameter over several orders of magnitude with loguniform rather than uniform?

Classic MLLevel: IntermediateMultiplicative search scale

Why sample a positive scale parameter over several orders of magnitude with loguniform rather than uniform?

Hints
  • Compare intervals [0.001, 0.01] and [1, 10].
  • Equal ratios differ from equal differences.

Answer

Loguniform allocates comparable probability to multiplicative intervals. Uniform sampling spends most draws in the largest numeric region and undersamples small orders of magnitude.

Source and licence: scikit-learn 1.7.2 — grid search · BSD-3-Clause · answer: Quantoros editorial

Related questions