Skip to content
Quantoros

Why is the spacing window in a sample-based differential-entropy estimator not merely a speed option?

MathematicsLevel: IntermediateInformation measures

Why is the spacing window in a sample-based differential-entropy estimator not merely a speed option?

Hints
  • Spacings estimate local density.
  • Window size changes smoothing.

Answer

It controls smoothing of order-statistic spacings and the bias–variance tradeoff. Too small is noisy; too large can oversmooth local density variation.

Source and licence: SciPy — entropy and relative entropy · BSD-3-Clause · answer: Quantoros editorial

Related questions