Hoeffding confidence interval

ID: hoeffding-confidence-interval

For a fixed positive sample size of independent and identically distributed Bernoulli random variables, let
The Hoeffding inequality makes a conservative confidence interval for : for every . Indeed, exclusion from the closed interval implies , an event contained in the deviation event bounded by . Clipping to retains coverage because already lies there. For , , and an observed frequency , , giving approximately .
Coverage concerns repeated independent samples: the unknown is fixed and the confidence interval is random. This fixed- guarantee does not justify repeatedly checking the same bound and stopping as soon as it looks favorable. The Hoeffding sample size for Bernoulli frequencies chooses in advance; guarantees across repeated inspection times require separate control of the additional events, for example through a union bound with an allocated failure probability at each time.

New to topics? Read the docs here!