Rayleigh radius from Gaussian components 2026-10-18
The joint probability density of isIn polar coordinates, , , and the absolute Jacobian determinant is . Thus the joint density of radius and angle factors asIntegrating over angle gives the Rayleigh distribution. The same factorization shows that the angle has uniform distribution and is independent of the radius. This is a short change of variables argument: an annulus of width has area to first order.
The assumptions are substantive. Unequal component variances give elliptical rather than circular density contours; a nonzero mean displaces the center. Even zero covariance and equal normal distributions do not suffice without independence. For an original counterexample, let and let be an independent Rademacher random variable. Put . Then has the same normal distribution as , and . Nevertheless, all points lie on or , and has densitywhich is positive at zero, unlike the Rayleigh distribution. This pair is not a Gaussian random vector.
Sample mean sufficiency depends on the model 2026-10-14
For the normal sample sum with known variance, assume independent and identically distributed with fixed known variance . The joint probability density factors asThe Fisher-Neyman factorization theorem proves that the sum, and hence the sample mean, is a sufficient statistic for . Its remaining deviations have a joint Gaussian law independent of and are independent of . If both and are unknown, the sample mean alone loses information about variance; the pair is sufficient for the full statistical parameter.
A discrete counterexample shows why a sample mean is not automatically sufficient for arbitrary statistical models. Let be independent and identically distributed on withEach observation has mean one. The arrangements all give sample mean one, yetThis conditional probability is at and at . The conditional distribution therefore still depends on the unknown statistical parameter: this sample mean is not a sufficient statistic. The useful reduction depends on the family of full-data laws, even when its mean stays fixed.
Studentized normal sample mean 2026-10-18
Suppose , , are independent and identically distributed with normal distribution , where the mean and standard deviation are unknown. Define the sample mean and sample variance byUnder these assumptions,Substitution gives the exact ratioThe unknown cancels. The denominator estimates the standard error of the sample mean; its sampling variability is precisely why the Student's t-distribution has wider tails than the standard normal distribution.
The crucial independence has a geometric explanation. Apply an orthogonal transformation to the standardized observations , choosing its first coordinate along . That coordinate is ; the remaining coordinates are independent standard normal random variables whose squared sum is . Their joint probability density factorizes because the transformation preserves the squared length. This also explains the loss of one statistical degree of freedom when estimating the mean. Uncorrelatedness alone would not establish the required independence for arbitrary data.
The result is exact for every under the stated normal distribution model. A small sample size by itself does not justify it: a sample from an arbitrary probability distribution need not have the displayed chi-squared distribution or the necessary independence.
Uniformized sample range Created 2026-10-14 Updated 2026-11-05
For an iid sample of size from a continuous cumulative distribution function, the probability integral transform makes the transformed sample uniform. Integrating the joint density of its minimum and maximum gives range density on . Its distribution function is . The result describes population content between the extreme order statistics, independently of the underlying continuous distribution.