Entropy bound for pairwise-union tuples Created 2026-09-24 Updated 2026-09-24
Let be random subsets of a common ground set. If every pairwise union takes values in a fixed family of sets of cardinality at most , then Shearer's inequality and the fact that a pair of bits with prescribed OR has at most three possibilities give
Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 164 3 ii Solution Created 2026-09-24 Updated 2026-09-25
Let be the set of valid quintuples and choose uniformly from . ThenApply Shearer's inequality to the ten pairs . Every index occurs in four pairs, so
Put . Since , it has cardinality . For each element of , its membership bits in are one of ; outside they are forced to be . Thus at most ordered pairs have any prescribed union. The chain rule for information entropy, conditional entropy, and the support bound for information entropy givebecause every belongs to . There are ten pairs, henceExponentiating proveswhich is the five-variable case of the entropy bound for pairwise-union tuples.