Put and assume . For fixed and a fixed nonzero difference , the approximate statistical power of the Wald test increases as its noncentrality increases, where
Differentiating with respect to the continuous allocation gives
Hence the unique minimum and its associated minimum variance are
This is Neyman allocation. Integer allocations use a feasible adjacent integer to the continuous optimum, comparing the resulting variances; must still hold. It is a large-sample normal approximation argument, not an exact finite-sample power theorem for arbitrary response-adaptive randomization. Under the null , the approximate power is the significance level for any allocation, although the same allocation still minimizes the stated variance.
The pivotal quantity lies in and satisfies . Thus
Rearranging these inequalities yields the exact confidence interval
For every , its coverage probability is exactly ; the result uses the finite-sample probability distribution, with no normal approximation.
The independent uniform choices from the student list describe sampling with replacement. Under the stated independent normal distribution model for the heights, the population variance is unknown and the given cm is the sample standard deviation . The exact pivotal quantity is
Thus the exact 95% Student t confidence interval is
using . The supplied approximation instead gives a normal approximation for large sample size
This latter confidence interval is approximate even under normality because it substitutes the sample standard deviation for the unknown population value. There is no finite population correction under the specified independent selections. Interpreting the finite student list literally as a discrete population makes normality an idealized model; it does not justify changing the stated sampling design.
The number of successes has a binomial distribution. Each arrangement of successes and failures has probability by independence, and the binomial coefficient counts the arrangements. Therefore
The final equality is the binomial theorem. Writing as a sum of independent Bernoulli random variables gives its expectation and variance: , . Thus the matching normal distribution has
The normal approximation is appropriate when both expected counts and are sufficiently large; large alone is insufficient if is extremely close to zero or one.
For the guessing student, , , . Therefore the expected number of correct answers is , and , . The inclusive integer range becomes after the continuity correction. Standardizing the normal distribution gives
Here , and the last step uses the supplied bound. The approximate probability is . The normal approximation provides the requested conclusion; as a separate check, summing the five exact binomial probabilities gives approximately , also exceeding one half.
For , the central limit theorem gives
If is differentiable at , the delta method applies to the first-order expansion
where the remainder notation means that its product with tends to zero in probability. Hence
The useful nondegenerate normal approximation requires . When , the first-order limit is zero and a higher-order expansion may be needed.
For the independent statistical sample, write the likelihood function and log-likelihood function as
The expected Fisher information in the whole statistical sample is
Under the regularity conditions that permit differentiation under the integral sign, the score function has expected value zero and
For an interior statistical parameter, assuming identifiability and , the regular asymptotic normality of a maximum likelihood estimator states
Thus the large-sample normal approximation is . The inverse information is the leading sampling variance approximation; the displayed convergence specifies its precise asymptotic meaning.
Using the raw moments from part (i), the variance of one observation is
The central limit theorem for the independent statistical sample gives
For , its derivative at the mean is . The delta method therefore gives
Equivalently, the large-sample normal approximation is
Here denotes the leading asymptotic variance, rather than an assertion about an exact finite-sample variance.
Condition on the total of 400 complaints. Assume each complaint independently has the same probability of being received on Monday; in particular, repeated complaints from one incident must not create material dependence. The Monday count then has a binomial distribution with parameters . Test against , rejecting for large as suggested by the monotone likelihood ratio.
Under the null hypothesis, and . Both expected successes and expected failures are large, so the central limit theorem gives a suitable normal approximation:
Using the paper's supplied rounded table, the upper-tail p-value is approximately
A more accurate evaluation of the standard normal distribution cumulative distribution function gives about 0.0062. For example, choose significance level 0.05 before examining the data; the supplied upper 5% standard normal quantile is approximately 1.6, and . Reject at 5%, and also at 1%, using this approximation. The observed binomial proportion is , providing evidence that the Monday probability exceeds 0.2 under the sampling assumptions.
If applying a continuity correction, approximate by ; this gives the same 5% and 1% conclusions. The uncorrected value 0.005 is approximate, so a decision exactly at the 0.5% boundary is not warranted by the supplied rounded table.
Fix real population values . Define the finite population mean and two normalizations of the finite population variance by
The values are fixed; only the selected subset is random. For its sample mean , the exact design expectation and variance are
The sample mean is an unbiased estimator of the finite population mean. At , every unit is observed and exactly, so the variance is zero. The case is deterministic and is handled directly, since is undefined then.[ref]
The finite population correction depends on the baseline. With the normalization it is multiplying . With the normalization it is multiplying , the exact variance for independent uniform sampling with replacement. The standard error uses the square root of the relevant variance factor. Mixing the two normalizations gives a wrong answer even at , when replacement cannot matter. For the six-value example, , , and , reproducing without replacement and with replacement.
A short proof exposes the statistical dependence. Let be the value at position in uniform sequential sampling without replacement, so each has expected value and variance . Write . Every ordered pair of distinct labels is equally likely, and , hence for ,
Linearity of expectation proves unbiasedness without requiring independence. The variance of a sum includes all ordered covariance terms, giving
For the original population, each pair of distinct draw positions has covariance . Drawing a high value leaves a lower mean among the remaining values, balancing subsequent draws. Equal marginal probability distributions therefore coexist with negative covariance.
When , the sample variance is an unbiased estimator of . To check this independently, use : its expected value is . Thus unbiasedly estimates the variance of the sample mean; its square root estimates the standard error, but need not be unbiased.[ref]
Figure 1.
Exact mean variance and expected distinct-unit coverage as sample size grows in the six-value population
. Details.
The diagram compares variance with the expected fraction of distinct population labels observed. Without replacement this fraction is exactly ; with independent uniform sampling with replacement, a label is missed with probability , so linearity of expectation gives expected fraction . At six draws, replacement covers only about of labels on average and retains sample mean variance ; sampling all six distinct labels covers the population completely and removes selection uncertainty. This population coverage is distinct from confidence interval coverage probability.
The correction matters when the sampling fraction is appreciable. It calibrates uncertainty about this fixed population under the specified selection mechanism. It does not correct unequal selection weights, missing observations or measurement errors; observing every label also does not eliminate uncertainty about a larger unobserved population. Moreover, an exact variance alone does not guarantee the coverage probability of a proposed confidence interval: a small discrete sampling distribution can make a normal approximation inaccurate.
Weak law of large numbers Created 2026-09-24 Updated 2026-10-14
Let be real independent and identically distributed random variables with and expected value . The weak law of large numbers states that their sample mean has convergence in probability to : for every fixed ,
Thus a large sample is unlikely to give an average with a specified fixed-size error. The strong law of large numbers makes the stronger statement of almost sure convergence along an entire sequence. Under the displayed assumptions both laws apply; their names distinguish the conclusions, not two competing predictions.
When the variance is finite, variance additivity for independent random variables gives . The Chebyshev inequality immediately supplies a useful quantitative form and a brief proof:
For independent trials with a Bernoulli distribution of parameter , the expected value is and the variance is . At , the chance of an error of at least is therefore at most . The exact binomial distribution gives a much smaller probability, as the figure under the strong law of large numbers shows. The bound is conservative, but it is valid for every sample size under these assumptions and does not require a normal approximation.
The weak law of large numbers addresses a fixed tolerance . The central limit theorem instead resolves errors on the shrinking scale and gives their approximate normal distribution. In particular, the weak law of large numbers alone supplies neither a bell-shaped error law nor a universal rate of approach. For example, a Pareto distribution with minimum one and shape has expected value three but infinite variance: both the weak law of large numbers and strong law of large numbers apply, while the finite-variance statement of the central limit theorem does not.