Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2015/iii/paper-36/3/solution

The Hoeffding inequality states that if are independent random variables with almost surely, then for
The same bound holds for the lower tail. Consequently the two-sided tail is at most twice this bound. When all ranges have length zero, the sum is deterministic and every positive tail probability is zero.
We construct an exponential packing of a Hamming cube. Choose an inclusion-maximal separated set in with separation at least for the Hamming distance. It exists by a finite greedy procedure: keep adding any vertex at distance at least from all selected vertices until none remains. By maximality, every vertex is within distance strictly less than of some member of . This is the principle that maximal separated sets give covers.
For a uniformly random vertex and any fixed vertex , the mismatch indicators in different coordinates are independent Bernoulli random variables with success probability . Hence has the binomial distribution with parameters . The lower-tail Hoeffding inequality gives
Thus the Hoeffding lower-tail bound for Hamming balls shows that every strict-radius ball has at most vertices. Using a strict ball handles noninteger without changing the required separation.
The strict balls centered at cover the entire Hamming cube. Counting their union by the sum of their sizes yields
Therefore
In particular this proves the assertion for every . Maximality here means that no further vertex can be added; finding a largest separated set is unnecessary.

New to topics? Read the docs here!