Entropy bound for a union-closed family Created 2026-09-24 Updated 2026-09-24
Every finite union-closed family other than has an element belonging to at leastof its members. The proof applies the binary entropy product inequality coordinate by coordinate to the union of two independent uniform members of the family.
Past exam of the mathematics course of the University of Cambridge 2025 iii Paper 164 3 i Solution Created 2026-09-24 Updated 2026-09-24
Letwhere is the golden ratio. If the union-closed family consists of one nonempty set, any element of that set has frequency one, so assume its cardinality exceeds one. Choose independent uniform members and let be their characteristic vectors of sets. Then .
Suppose for a contradiction that every element has frequency . Put , and let , the characteristic vector of a set of . The chain rule for information entropy and conditioning reduces entropy givebecause is a function of .
Fix the two prefixes and setThe two conditioned bits are independent random variables, and exactly when both are zero. The supplied binary entropy product inequality therefore givesAveraging over the independent prefixes yieldswhenever either conditional entropy is positive. Summing and using gives .
But set union keeps inside the union-closed family, so is supported on . The maximum entropy distribution on a finite set gives , a contradiction. Some element must therefore occur in at least members, proving the entropy bound for a union-closed family.