Skip to content
Quantoros

Can entropy be calculated from category counts without manually normalizing them in SciPy?

MathematicsLevel: IntermediateInformation measures

Can entropy be calculated from category counts without manually normalizing them in SciPy?

Hints
  • Normalization makes proportions.
  • Entropy alone ignores n.

Answer

Yes: entropy normalizes the input weights. They must represent nonnegative mass with a meaningful positive total; counts do not retain sample-size uncertainty.

Source and licence: SciPy — entropy and relative entropy · BSD-3-Clause · answer: Quantoros editorial

Related questions