Studentized normal sample mean

ID: studentized-normal-sample-mean

Suppose , , are independent and identically distributed with normal distribution , where the mean and standard deviation are unknown. Define the sample mean and sample variance by
Under these assumptions,
Substitution gives the exact ratio
The unknown cancels. The denominator estimates the standard error of the sample mean; its sampling variability is precisely why the Student's t-distribution has wider tails than the standard normal distribution.
The crucial independence has a geometric explanation. Apply an orthogonal transformation to the standardized observations , choosing its first coordinate along . That coordinate is ; the remaining coordinates are independent standard normal random variables whose squared sum is . Their joint probability density factorizes because the transformation preserves the squared length. This also explains the loss of one statistical degree of freedom when estimating the mean. Uncorrelatedness alone would not establish the required independence for arbitrary data.
The result is exact for every under the stated normal distribution model. A small sample size by itself does not justify it: a sample from an arbitrary probability distribution need not have the displayed chi-squared distribution or the necessary independence.

New to topics? Read the docs here!