Under the studentized normal sample mean assumptions, let denote the quantile at cumulative probability of the Student's t-distribution. For , rearranging the event gives a Student t confidence interval for the unknown mean with exact coverage probability . [ref]
Choose the list as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown , then
There are four statistical degrees of freedom. For a 95% confidence interval, , so
Using the standard normal quantile with the same estimated standard error would give only . That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is , rather than 0.95.
Figure 1.
Chosen five-value example: estimating the spread requires a wider t confidence interval
. Details.
The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact quantile cover the same fixed . This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.
For this four-degree case, the cumulative distribution function has an especially simple form:
One can check the formula by differentiation: , with limits zero and one at the two ends of the real line. Solving the increasing equation by the bisection method gives the quantile used above.
Statistical inference Created 2026-09-24 Updated 2026-10-13
Statistical inference uses observed data and a statistical model to learn about unknown features of the process that generated them. In a parametric statistical model, write : the probability distribution depends on an unknown statistical parameter . An estimand specifies the target, such as a mean or a difference of means. A statistic is a function of the observations; an estimator is a statistic used to estimate the target. Uppercase denotes the random data before observation, while lowercase denotes their realized values.
Three questions lead to different outputs. Statistical estimation asks which target value the observations suggest. A confidence interval asks for a range produced by a procedure with calibrated coverage probability. A hypothesis test asks whether the observations depart sufficiently from a specified null hypothesis to enter its rejection region. These outputs complement one another: an estimated effect size describes magnitude, while a standard error describes the sampling distribution of an estimator. A p-value describes a tail probability under the null hypothesis.
The appeal of statistical inference is that it turns variable observations into reproducible uncertainty statements. In the normal mean confidence interval with known variance below, a sample mean of has standard error : both the estimated shift and its precision matter. The calibration depends on the statistical model, including independence and the specified probability distribution. Increasing sample size improves precision under those assumptions; it does not repair a systematically misleading sampling procedure. Bayesian inference provides another framework, using a prior distribution and a likelihood function to obtain a posterior distribution.
A concrete idealized implementation uses a Stern-Gerlach experiment twice: a preparation filter along passes only its plus spin channel, and a analyzer resolves both output channels for many fresh atoms. This prepares the spin one-half along an axis state . The authored apparatus description uses slit collimation, a nonuniform magnetic field with a pointed pole, and counters at the separated outputs.[ref] The two-channel spin one-half preparation and analyzer are described separately; the source's recombining “improved” apparatus is explicitly idealized, so the setup here is a proposed estimation model, not a report of observed counts.[ref]
Count every accepted analyzer event in its calibrated or channel and compute from the count difference. The magnetic field gradient separates trajectories through their magnetic moments; calibrated channel labels convert positions into spin eigenvalues. The readout is a population imbalance, not an intermediate trajectory carrying spin . Beam position also depends on flight time and field geometry, so averaging raw positions alone does not establish a calibrated spin expectation value.
As controls, feed known and preparations to check the channel assignment and leakage, hold the analyzer axis fixed, and repeat short blocks to check preparation drift. Measure background counts and relative channel efficiencies. With efficiencies and and negligible background, the detected plus fraction is
Unequal efficiencies bias the naive sample mean, even for arbitrarily many counts. For example, , , and give detected fraction and naive mean , rather than . Background, overlapping beams, detector saturation, angle misalignment, unwanted internal states, and preparation correlations require a better measurement in quantum mechanics model. Increasing only reduces the independent sampling contribution; it cannot remove these systematic errors. The selected preparation beam is the population being estimated, so losses in preparing it must be distinguished from losses in reading its two outcomes.
Strong law for adjacent products Created 2026-10-05 Updated 2026-10-06
For independent and identically distributed random variables with and , the sample mean of tends to almost surely. Split into odd and even indexed products; each subsequence consists of independent and identically distributed random variables that are integrable random variables. Apply the strong law of large numbers separately.
Strong law of large numbers Created 2026-09-24 Updated 2026-10-14
Let be real independent and identically distributed random variables with , and let be their expected value. Their sample mean satisfies
This is almost sure convergence: with probability one, an entire infinite sequence of observations has averages that eventually stay within every prescribed positive tolerance of . The variance need not be finite. The strong law of large numbers implies the weak law of large numbers, which asserts convergence in probability at each increasing sample size.
For independent trials with a Bernoulli distribution of parameter , is one for success and zero for failure. Then is the observed success proportion, and the strong law of large numbers says almost surely. This turns a theoretical probability into a quantity one can estimate by repetition. It does not say that each new trial improves the estimate: a long string of failures can move the proportion away from before later observations bring it back.
Figure 1.
Bernoulli averages approach their mean: sample paths and exact error probabilities
. The left panel shows four reproducibly simulated sequences of independent Bernoulli trials with success probability . The right panel calculates from the exact binomial distribution and compares it with the bound from the Chebyshev inequality. Small irregularities reflect integer-valued counts. The paths illustrate almost sure convergence; a finite simulation cannot prove it. Details.
The strong law of large numbers gives the limiting location of the sample mean, while the central limit theorem describes its fluctuations when the variance is finite and positive. The two assertions can hold together:
The first error shrinks to zero; the second has been enlarged enough to retain a nontrivial probability distribution. The second assertion is convergence in distribution, not a claim that the enlarged error along one sequence approaches a particular normal random variable.
The assumptions make a practical difference. If every observation repeats the same nonconstant Bernoulli random variable, , then for all : identical probability distributions alone do not make repeated observations informative. For independent observations with a Standard Cauchy distribution, the Cauchy sample mean has an unchanged distribution, so it does not concentrate around a constant. Its expected value is undefined, and ; neither example contradicts the stated strong law of large numbers.
A brief proof outline in the case of finite variance uses the Kolmogorov maximal inequality for the centered partial sums. The probability that their maximum up to exceeds is at most . These bounds are summable, so the Borel-Cantelli lemma controls all sufficiently large such blocks and hence every intermediate sample size. The general case requires truncation to control large observations; the argument using finite variance alone does not prove that full version.
Suppose , , are independent and identically distributed with normal distribution , where the mean and standard deviation are unknown. Define the sample mean and sample variance by
Under these assumptions,
Substitution gives the exact ratio
The unknown cancels. The denominator estimates the standard error of the sample mean; its sampling variability is precisely why the Student's t-distribution has wider tails than the standard normal distribution.
The crucial independence has a geometric explanation. Apply an orthogonal transformation to the standardized observations , choosing its first coordinate along . That coordinate is ; the remaining coordinates are independent standard normal random variables whose squared sum is . Their joint probability density factorizes because the transformation preserves the squared length. This also explains the loss of one statistical degree of freedom when estimating the mean. Uncorrelatedness alone would not establish the required independence for arbitrary data.
The result is exact for every under the stated normal distribution model. A small sample size by itself does not justify it: a sample from an arbitrary probability distribution need not have the displayed chi-squared distribution or the necessary independence.
Surrogate split 2026-10-14
A surrogate split uses another predictor to approximate the left-versus-right assignments made by a tree node's primary split. It can route observations whose primary predictor is missing. Surrogates are ranked by agreement with the primary split on observations where both predictors are known, accounting for trivial majority assignments. This differs from simply filling a missing predictor with its sample mean.
Tail measurability of limits of sample averages Created 2026-10-05 Updated 2026-10-14
Let be a sequence of finite real random variables, and write for its sample mean. For fixed and , put . Then, at each outcome,
Consequently . The right-hand limit superior is a measurable function of for every , so the extended-real random variable is measurable with respect to the tail sigma-algebra. The same holds for the limit inferior. Thus the event of convergence to a finite limit of a sequence, and the event for any specified real , are tail events.
For a worked deterministic example, let alternate , and replace its first three entries by . For every the two sample means differ by exactly , so both converge to . Finite edits can change small-sample answers while preserving the infinite limit of a sequence.
Under independence, Kolmogorov's zero–one law makes each specified convergence event have probability zero or one. It does not select which value occurs. If a finite random variable measurable with respect to the tail sigma-algebra exists, the events for rational each have probability zero or one; continuity of probability and their nesting force to be constant almost surely. For fair independent Bernoulli trials, the strong law of large numbers establishes almost surely; the zero–one conclusion alone proves neither convergence nor the value .
Tail sigma-algebra Created 2026-09-24 Updated 2026-10-14
For a sequence of random variables on a probability space , define
The decreasing sigma-algebras are generated by the listed random variables. Their intersection consists of events expressible after discarding every finite prefix. No independence is required.[ref]
The point is to distinguish a long observation record from a property of an infinite sequence. The event of seeing infinitely many heads and the event that sample means converge survive any finite change, while an exact first-head time does not. Kolmogorov's zero–one law adds the striking conclusion that under independence each tail event has probability zero or one; the tail sigma-algebra itself can still contain many nonempty sets.
Variance of a sample mean Created 2026-09-24 Updated 2026-10-14
Let be an IID sample of real-valued random variables with finite expected value and finite variance , where . Its sample mean satisfies
Linearity of expectation gives the first identity. The variance of a sum and vanishing cross covariances give ; scaling by scales the variance by . Pairwise independent random variables with the same expected value and variance suffice for these identities, even without full independence. Grinstead and Snell state the corresponding finite-variance independent-trials result.[ref]
The standard deviation of the sample mean is . Four times as many observations halve this scale; they do not divide it by four. In the fair Bernoulli distribution example, , so sample sizes and give standard deviations and , respectively. The common-coin averaging example shows why merely repeating observations with a common marginal law does not justify this calculation.
Chebyshev's inequality turns the variance identity into a probability bound: for ,
This proves convergence in probability of the sample mean to in this finite-variance setting, a form of the weak law of large numbers. It is an upper bound, so values above one convey no improvement over the universal probability bound one. Cauchy sample mean stability lies outside these hypotheses.
For pots per treatment and leaves per pot, the group sample mean decomposes into two averages:
The variance of a sum adds the variances of the independent terms. Every pot random effect has weight , whereas each remaining error has weight , giving the short proof
This is also the variance of the arithmetic mean of the pot sample means, each with variance . Equal numbers of leaves per pot make the two averaging procedures identical.
If all leaf measurements were falsely treated as independent, the predicted variance would instead be . The ratio of correct to false variance is
Thus pseudoreplication can underestimate a standard error by the square root of this ratio. Equality holds when or ; sharing a pot creates an error here precisely when the shared influence has positive variance.
Choose , , and as constructed model parameters in squared length units. These are assumptions rather than fitted experimental values. For each group,
The treatment contrast has expected value . Since the group errors are independent conditional on the allocation, its variance is twice the group variance, namely , whereas the false calculation gives . Its correct standard error is length units; the false value is . The variance ratio is .
Figure 1.
Constructed variance predictions: adding pots reduces uncertainty faster than adding leaf measurements within four pots
. Each curve uses and ; the horizontal axis counts measurements per treatment. The solid designs agree at four pots with three leaves each. The dashed curve assumes all measurements are independent and therefore illustrates pseudoreplication; none of the curves are observed experimental data. Details.
With four pots fixed, increasing drives the error contribution towards zero, but the limit of the group variance remains . Measuring twelve leaves on each of four pots gives . Using the same forty-eight measurements on sixteen pots, with three leaves per pot, gives . More independent experimental units reduce both contributions. Extra nested measurements are useful for characterizing each experimental unit, but cannot average away its shared random effect. This is why sample collection effort and the number of independent treatment replicates answer different questions.[ref]
For independent and identically distributed random variables with characteristic function , suppose their sample mean converges in probability to a finite constant . Bounded exponential tests give uniformly on bounded intervals: the error is at most on . Taking the continuous complex logarithm vanishing at zero shows uniformly; an integer-valued branch difference is continuous and therefore zero. For arbitrary , put and , so . Dividing the uniform limit by proves , and thus . No absolute first moment is assumed.
Weak law of large numbers Created 2026-09-24 Updated 2026-10-14
Let be real independent and identically distributed random variables with and expected value . The weak law of large numbers states that their sample mean has convergence in probability to : for every fixed ,
Thus a large sample is unlikely to give an average with a specified fixed-size error. The strong law of large numbers makes the stronger statement of almost sure convergence along an entire sequence. Under the displayed assumptions both laws apply; their names distinguish the conclusions, not two competing predictions.
When the variance is finite, variance additivity for independent random variables gives . The Chebyshev inequality immediately supplies a useful quantitative form and a brief proof:
For independent trials with a Bernoulli distribution of parameter , the expected value is and the variance is . At , the chance of an error of at least is therefore at most . The exact binomial distribution gives a much smaller probability, as the figure under the strong law of large numbers shows. The bound is conservative, but it is valid for every sample size under these assumptions and does not require a normal approximation.
The weak law of large numbers addresses a fixed tolerance . The central limit theorem instead resolves errors on the shrinking scale and gives their approximate normal distribution. In particular, the weak law of large numbers alone supplies neither a bell-shaped error law nor a universal rate of approach. For example, a Pareto distribution with minimum one and shape has expected value three but infinite variance: both the weak law of large numbers and strong law of large numbers apply, while the finite-variance statement of the central limit theorem does not.