For an integrable real random variable , its cumulant-generating function is the extended-real convex functionwhere if the exponential moment diverges. Its Legendre transform of a cumulant-generating function is
Let be independent and identically distributed random variables, let , and write . Cramér theorem states that the empirical means obey a large deviation principle with good rate function . In particular, for ,with the usual extended-real interpretation; the analogous lower-tail formula holds for .
For every , the exponential Markov bound and independence giveTaking the infimum over yieldsFor , convexity makes this supremum equal to , proving the upper bound in the stated tail form of Cramér theorem.
Fix and then . By the assumptions on the derivative , there is a unique with . Apply exponential tilting to each summand:Under the product tilted law, the variables remain independent and identically distributed random variables and have mean . Hence the strong law of large numbers implies that, for every ,Changing measure on this event givesThereforeFirst let and then . The continuity of a convex function gives the lower bound . The endpoint follows by letting , while for the strong law of large numbers makes the probability tend to one. This proves the required lower bound.
Articles by others on the same topic
There are currently no matching articles.