Hoeffding lemma states that if almost surely, then for every real ,Convexity of bounds it on by the secant joining its endpoint values. Taking expectations reduces the centered moment-generating function to that of a two-point variable on having the same mean. After rescaling to , its logarithm iswhere is its mean. Twice differentiating in shows that the second derivative is a Bernoulli variance and hence at most . The value and first derivative vanish at zero, so Taylor's theorem gives at most . Rescaling proves the claim.
Articles by others on the same topic
There are currently no matching articles.