**Chebyshev's inequality: if has finite mean and variance , then for ,
Apply Markov's inequality to the nonnegative random variable with threshold . Since and , the desired statement follows immediately.
Represent the removed half as the first cards in a uniformly random ordering. Every unordered half is then equally likely. Let be their values. Each has mean zero and variance one, and every distinct pair has covariance by the same ordered-pair argument as in (ii).
The general covariance expansion from (b), applied without imposing independence, gives
This is the finite population correction for a half-sample; treating the draws as independent would give the wrong variance.
Finally , so Chebyshev's inequality yields
The cards returned before this sampling step restore the original population; no conditioning on the earlier two observed values is imposed.
By linearity of expectation, . The variance of a sum and the negative covariance just proved give
Apply Chebyshev's inequality to the empty-box indicators in uniform allocation:
This proves the required concentration of the empty-box fraction. Since , it also yields convergence in probability of to .
For a nonnegative integer , this Coulomb potential energy eigenstate has principal quantum number and maximal magnetic quantum number. Put . Including the spherical volume element, its radial probability density is a gamma distribution proportional to ; its polar density is proportional to , while its azimuth is uniform. Radial and polar variables are independent. Their moments satisfy
The radial identities follow by successive integration by parts; the angular identity follows from .
Set . Chebyshev's inequality and Markov's inequality give and . By the union bound, outside an event of probability at most , the point lies at distance from the equatorial circle of radius . The quantum state therefore concentrates near a classical circular orbit in relative units as grows. The absolute orbit radius and absolute transverse width both grow; this statement does not assert localization in a fixed narrow tube.
Probability inequality Created 2026-09-24 Updated 2026-10-18
Probability inequalities bound event probabilities from limited information, such as moments, without requiring a complete probability distribution. Markov's inequality uses a nonnegative random variable's expected value; Chebyshev's inequality uses a variance to bound deviations from a mean. The attraction is a guarantee that applies to many possible probability distributions. Their bounds can be conservative for a particular model, and distributions attaining equality show when the available information really cannot give more.
Second moment method Created 2026-09-24 Updated 2026-10-14
The second moment method uses a random variable's expected value and second moment to establish that a counted or measured quantity is positive with substantial probability. It is useful when a positive average alone could be caused by extremely large values on very rare outcomes. Controlling the variance rules out too much of that concentration in rare outcomes.
For a nonnegative random variable with and finite second moment, the second-moment bound for positivity gives
Equivalently, . The method also includes the simpler Chebyshev's inequality bound . Thus a sequence of such random variables with has with probability tending to one. These statements require no independence assumption. The variance argument and its use for random counts are developed in Zhao's lecture notes. [ref].
For an original toy count, let count successes in ten independent Bernoulli trials with success probability . The binomial distribution gives
Consequently . The exact probability is . The first moment method and union bound only give the upper bound here. First and second moments therefore answer complementary existence questions.
Figure 1.
The second moment method certifies a positive count, while statistical dependence can change the conclusion despite an unchanged mean
. Left: exact binomial distribution probabilities of at least one success and second-moment lower bounds for ten independent trials as the success probability varies. Right: the same ten trials with either occur independently or share one common Bernoulli outcome. Both counts have mean one, but the perfectly linked count has much larger variance and only probability of being positive. All data are original specified probability models. Details.
For a sum of indicator random variables, the variance of a sum is
Independence makes the covariances vanish, but the formula itself also covers dependent counts. For the same ten success probabilities, let every trial share a single Bernoulli random variable : then , with mean one, variance nine, and . The second-moment lower bound is exactly . Ignoring the positive covariances would produce the false independent-count conclusion. Zhao's discussion of sums of indicators explains why overlapping counted structures require these pairwise terms. [ref].
The count has binomial distribution with mean and variance . The information content per symbol is an affine function of , so its variance is
Chebyshev's inequality therefore gives the finite-sample lower bound
The bound is often loose, but it proves that every fixed positive tolerance eventually captures nearly all the probability. Direct summation of the binomial distribution's probability masses gives . A finite sample does not need to have a nearly full typical set: the 40-symbol example above captures only about .
Figure 1.
Longer biased-coin messages concentrate in typical sets with controlled size
. The left plot compares exact typical set probabilities with the lower bound from Chebyshev's inequality. The right shows and its finite-sample bounds. The tolerance stays fixed; the curve is not asserted to converge to exactly . All points are exact finite-model calculations. Details.
Variance of a sample mean Created 2026-09-24 Updated 2026-10-14
Let be an IID sample of real-valued random variables with finite expected value and finite variance , where . Its sample mean satisfies
Linearity of expectation gives the first identity. The variance of a sum and vanishing cross covariances give ; scaling by scales the variance by . Pairwise independent random variables with the same expected value and variance suffice for these identities, even without full independence. Grinstead and Snell state the corresponding finite-variance independent-trials result.[ref]
The standard deviation of the sample mean is . Four times as many observations halve this scale; they do not divide it by four. In the fair Bernoulli distribution example, , so sample sizes and give standard deviations and , respectively. The common-coin averaging example shows why merely repeating observations with a common marginal law does not justify this calculation.
Chebyshev's inequality turns the variance identity into a probability bound: for ,
This proves convergence in probability of the sample mean to in this finite-variance setting, a form of the weak law of large numbers. It is an upper bound, so values above one convey no improvement over the universal probability bound one. Cauchy sample mean stability lies outside these hypotheses.
On a cyclic sequence of independent Bernoulli random variables with success probability , count all runs of consecutive successes, allowing overlaps and taking . The count has expected value . Its variance is the displayed expression: each starting indicator has variance ; two starts at cyclic distance have joint probability ; nonoverlapping starts are independent. There are ordered overlapping pairs at each such distance, because the two ranges do not meet when .
For , summing a geometric series gives . Markov's inequality therefore proves absence with high probability when , and Chebyshev's inequality proves existence and relative concentration when . This remains valid for varying probabilities eventually at most one half.
Weak law without an absolute first moment Created 2026-10-14 Updated 2026-10-31
Let have a symmetric probability distribution with for , mass at zero, and no mass with . Then , but independent copies satisfy the weak law of large numbers with limit zero. Indeed . Their symmetric truncations have mean zero and second moment , so Chebyshev's inequality gives in probability. A union bound shows that the original and truncated sums differ with probability tending to zero. This also gives a differentiable characteristic function at zero whose derivative cannot be interpreted as an absolutely convergent expectation.