If a sequence converges, its Cesaro means have the same limit. Given a small tolerance, split the average error into a fixed finite initial segment and a tail whose individual errors are below that tolerance. The first contribution is a fixed constant divided by , while the second is bounded by the tolerance. The converse fails: the alternating sequence has means tending to zero while its terms do not converge.
For independent random variables with , write
Then . Hence converges in exactly when the scalar Cesaro means converge.
Let and suppose . Telescoping gives
To justify the Cesaro mean limit directly, choose so that for . The finite initial sum contributes at most , which tends to zero. The remaining terms contribute at most , and replacing by contributes . Consequently .
Because is a monotone sequence, every one of its first terms is at most , so
On the other hand, every term from through is at least , and hence
Both the lower bound and upper bound tend to because the Cesaro means converge to . The squeeze theorem gives
Suppose . Given , choose such that for . Then
The first term tends to zero because its numerator is fixed, and the second is at most . Thus the Cesaro mean tends to .
The converse is false. For , the Cesaro means tend to , while the original sequence alternates between and and does not converge.
The strong law of large numbers states that for independent identically distributed integrable random variables,
To prove it, set . The tail-sum formula gives , so the Borel-Cantelli lemmas make the two sequences eventually equal. Also
The Kolmogorov convergence theorem implies that converges almost surely, and Kronecker lemma yields
Finally , so the Cesaro mean of these expectations tends to .
If in a Hilbert space, some subsequence has Cesaro means converging in norm to . For , choose the subsequence so successive vectors have summably small inner products; expansion of the squared norm of its averages then proves convergence.