Normalized subset entropy
ID: normalized-subset-entropy
For a discrete random vector with coordinates, this is the average information entropy per coordinate over all subsets of size . Independent coordinates give the same average for every , even when their individual entropies differ. If all coordinates are copies of one random variable , the average is .
New to topics? Read the docs here!