Use the standard infinite-population slotted ALOHA model with independent fresh arrivals with Poisson distribution , . Newly arrived packets attempt in the next slot. Given old backlogged packets, each independently attempts with fixed probability , so the retransmission count has binomial distribution , independent of and earlier random choices. Let record whether is zero, one, or at least two. A single transmission succeeds and departs; a collision makes every transmitted packet remain. Therefore
Only the present backlog determines the law of the next independent choices, so is a time-homogeneous Markov chain.
For , put and , with . Its nonzero transition probabilities are
For example, a single fresh arrival leaves the backlog unchanged only if no old packet transmits; if an old packet also transmits, that fresh arrival becomes a new backlogged packet. These cases explain the extra diagonal term and the suppressed one-step increase at . At the same formulas hold with , and for .
Here is an almost-sure proof of permanent collisions in constant-probability slotted ALOHA for , rather than just a positive-drift heuristic. For , the conditional exponential increment is
As this tends to a number strictly below one. Choose so the expression is at most one for . Stopping when the chain first enters gives a nonnegative supermartingale. Downward jumps have size at most one, so it hits at . Optional sampling theorem for a supermartingale, first at bounded times and then by a limit, yields the exponential-supermartingale escape bound
This is an irreducible Markov chain: every positive state can successively decrease to zero, and from zero Poisson batches reach every state at least two, with state one then reached from two. An irreducible recurrent Markov chain would hit that finite set with probability one from every state, contradicting the bound. Hence every state is a transient state, every finite set is visited only finitely often, and almost surely.
The conditional success probability is . The centered success indicators form a martingale difference sequence with bounded increments. The strong law for martingales with bounded increments gives
The conditional means have Cesàro average zero, while the strong law of large numbers gives . Therefore almost surely. Finally
decays exponentially along this linear backlog growth. Its sum over is almost surely finite. The Conditional Borel-Cantelli lemma then implies that only finitely many slots have zero or one transmission. Thus . At , a fresh batch of size at least two eventually occurs, after which at least two old packets retransmit in every slot, giving the same conclusion directly.
The qualification is essential: if , then depends only on the independent Poisson arrivals, and zero- or one-arrival slots occur infinitely often. Positive mean arrival rate alone, without the Poisson model or another assumption allowing collisions to develop, would also be insufficient: Bernoulli fresh arrivals and initial backlog zero never collide.
One alternative is binary exponential backoff: after collisions a packet selects a waiting time uniformly from and tries when its counter expires. Its attempt behavior depends on its collision history, rather than a common constant . Another possibility, if a backlog estimate is available, is to set the attempt probability near , keeping the offered retransmission count near one. These descriptions illustrate adaptive access rules; they do not assert that every backoff variant is stable at arbitrary load.
The useful autoregressive model is for the squares, not for signed observations. Put and
Then
The errors form a martingale difference sequence relative to the noise history, because the current standardized noise is independent of the past. When the fourth moment is finite they have finite variance and are uncorrelated across distinct times, although their conditional variance depends on the regressor. In centered form, .
For ordinary least squares, use the response-regressor pairs , , . With their separate means and , minimize . If the regressor sum of squares is positive, the estimators are
The two means use the matched pairs; replacing them indiscriminately by a single full-sample mean is not the exact least-squares formula. The noise-series representation supplies an ergodic stationary process. If , finite regressor second moments and the error's zero conditional expectation justify the usual population regression and statistical consistency argument. The observations still define a finite-sample least-squares fit outside that moment range, but the ordinary finite-variance justification must not be claimed there. If parameter constraints are required, minimize the same criterion subject to and , rather than assert that unconstrained estimates automatically satisfy them.
This covariance is also zero, but symmetry is essential to the proof. Write , where is an independent fair sign. The normal distribution makes that sign independent of its magnitude and of every other driving variable. Conditional on the magnitudes and all noise except this sign, changing flips and leaves unchanged. Every future conditional scale uses only squared past observations, so is unchanged for .
Thus is independent of the remaining fair sign in . Averaging that sign gives , and hence
The Cauchy-Schwarz inequality again guarantees integrability. For odd , the parity decomposition of a lag-two ARCH process also gives independence directly. For even , the sign symmetry of an ARCH process supplies the argument; the martingale difference sequence property alone would not justify this reversed covariance.
The covariance is zero. Let . The stationary noise-series representation makes measurable with respect to , whereas the martingale difference sequence property gives . The law of total expectation therefore gives
Since , this is the required covariance. All products are integrable by the Cauchy-Schwarz inequality, using finite second moments of and the stipulated square integrability of .
Write for the martingale difference sequence. Bounded increments mean that one deterministic satisfies for every , almost surely. Then and, for ,
The increments are uncorrelated random variables, uniformly bounded in . Applying the supplied strong law for uniformly L2-bounded uncorrelated random variables gives almost surely. Also , because is finite almost surely. Therefore a martingale with bounded increments has zero linear growth:
This is the strong law for martingales with bounded increments.
For the submartingale, let and define its predictable drift and compensator by
This is the Doob decomposition in discrete time. The process is a martingale. Since , we have , so . The result just proved gives almost surely, and . Consequently the strong law for submartingales with bounded increments is
The compensator may grow, so the conclusion is a lower bound rather than a claim of convergence to zero.
With symmetric driving noise whose sign is independent of its magnitude, changing the sign of one driving variable changes the corresponding but leaves future conditional scales unchanged. Consequently for and square-integrable . This conclusion uses symmetry, beyond the martingale difference sequence property.
If a martingale has increments bounded by a single deterministic constant, then almost surely. Its increments form a uniformly -bounded martingale difference sequence; apply the strong law for uniformly L2-bounded uncorrelated random variables to their partial sums and note . No square-integrability of the initial value is needed beyond the usual martingale integrability.
Strong law for uniformly L2-bounded uncorrelated random variables Created 2026-10-06 Updated 2026-10-25
If and the are pairwise uncorrelated random variables, then almost surely. Independence is unnecessary for this version of the strong law of large numbers. A uniformly bounded martingale difference sequence meets its hypotheses, since the differences have mean zero and are orthogonal in .