Hoeffding lemma states that if almost surely, then for every real ,
Convexity of bounds it on by the secant joining its endpoint values. Taking expectations reduces the centered moment-generating function to that of a two-point variable on having the same mean. After rescaling to , its logarithm is
where is its mean. Twice differentiating in shows that the second derivative is a Bernoulli variance and hence at most . The value and first derivative vanish at zero, so Taylor's theorem gives at most . Rescaling proves the claim.

Articles by others on the same topic (0)

There are currently no matching articles.