Entropy, Derivation Operators and Huffman Trees

07/23/2021
by   Simon Burton, et al.
0

We build a theory of binary trees on finite multisets that categorifies, or operationalizes, the entropy of a finite probability distribution. Multisets operationalize probabilities as the event outcomes of an experiment. Huffman trees operationalize the entropy of the distribution of these events. We show how the derivation property of the entropy of a joint distribution lifts to Huffman trees.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset