Entropy bound for pairwise-union tuples Created 2026-09-24 Updated 2026-09-24
Let be random subsets of a common ground set. If every pairwise union takes values in a fixed family of sets of cardinality at most , then Shearer's inequality and the fact that a pair of bits with prescribed OR has at most three possibilities give
Let be the set of valid quintuples and choose uniformly from . Then
Apply Shearer's inequality to the ten pairs . Every index occurs in four pairs, so
Put . Since , it has cardinality . For each element of , its membership bits in are one of ; outside they are forced to be . Thus at most ordered pairs have any prescribed union. The chain rule for information entropy, conditional entropy, and the support bound for information entropy give
because every belongs to . There are ten pairs, hence
Exponentiating proves
which is the five-variable case of the entropy bound for pairwise-union tuples.