Let be the set of valid quintuples and choose uniformly from . ThenApply Shearer's inequality to the ten pairs . Every index occurs in four pairs, so
Put . Since , it has cardinality . For each element of , its membership bits in are one of ; outside they are forced to be . Thus at most ordered pairs have any prescribed union. The chain rule for information entropy, conditional entropy, and the support bound for information entropy givebecause every belongs to . There are ten pairs, henceExponentiating proveswhich is the five-variable case of the entropy bound for pairwise-union tuples.
Articles by others on the same topic
There are currently no matching articles.