Can entropy be calculated from category counts without manually normalizing them in SciPy?
MathematicsLevel: IntermediateInformation measures
Can entropy be calculated from category counts without manually normalizing them in SciPy?
Hints
- Normalization makes proportions.
- Entropy alone ignores n.
Answer
Yes: entropy normalizes the input weights. They must represent nonnegative mass with a meaningful positive total; counts do not retain sample-size uncertainty.
Source and licence: SciPy — entropy and relative entropy · BSD-3-Clause · answer: Quantoros editorial