Convergence in probability means
The probability concerns each index separately; it does not require eventual closeness along almost every sample path.
For , convergence in Lp means the variables belong to and
Equivalently the th absolute moment of the difference tends to zero. The analogous definition for uses the essential-supremum norm.
Almost sure convergence means
Outside a single null set, the numerical sequence converges pointwise.
For events , the Borel-Cantelli first lemma states that implies . Indeed,
These unions decrease to , so continuity from above proves the assertion.
The Borel-Cantelli second lemma states that independent events with satisfy . For every fixed , independence and give
Continuity from above shows there is probability zero of no event after . A countable union over gives probability zero of only finitely many occurrences. Independence is needed for this second conclusion, but not for the first.
For fixed and ,
so there is convergence in probability to one. The absolute difference is exactly on the exceptional event, hence
For every this tends to infinity, so convergence in Lp fails. In contrast its first moment is , so convergence actually holds in .
There are exactly summands in , and the triangle inequality gives
The last step is convergence of arithmetic means of a sequence tending to zero. Thus in , and Markov's inequality gives
Let . These events are independent and . By the Borel-Cantelli second lemma, they occur infinitely often almost surely.
If had any finite sample-path limit, then
But on , is either or , contradicting this convergence infinitely often. Therefore the averages have no finite almost sure limit. This is a rare-jump counterexample to a strong law with convergent first-moment averages.

Articles by others on the same topic (0)

There are currently no matching articles.