Boundary likelihood-ratio test for two Gaussian means Created 2026-10-14 Updated 2026-11-05
For independent unit-variance Gaussian samples with means , testing against unrestricted means gives . The unrestricted maximum-likelihood estimators are the two sample means, while the null estimators are and zero. Under the null, write , , and , with independent standard Gaussian variables. Then decreases pointwise with , so the largest rejection probability occurs at the boundary . There its law is the chi-bar-squared distribution . The exact size- threshold is therefore determined by .
Chi-bar-squared distribution Created 2026-10-14 Updated 2026-11-05
A Chi-bar-squared distribution is a mixture distribution , where and , and denotes a point mass at zero. It arises when a Gaussian likelihood is optimized under inequality constraints: projection onto a constraint cone selects different dimensions according to which inequalities are active. For example, if are independent standard Gaussian random variables, then has distribution . On it is ; on it is . Symmetry makes the sign of independent of , proving the stated weights and component laws.
Chi-squared asymptotic approximation Created 2026-09-29 Updated 2026-11-05
A Chi-squared asymptotic approximation uses a Chi-squared distribution as the limiting null law of a statistic. In a regular identifiable fixed-dimensional model, Wilks theorem gives for smooth independent null restrictions, provided the true parameter is an interior point and the usual differentiability and information conditions hold. This is a limit as Sample size grows, not an exact finite-sample identity.
For a fully specified multinomial model with a fixed number of categories and probabilities , Pearson's statistic is
The constraint removes one Gaussian degree of freedom. Its usual fixed-category assumptions make all expected counts grow. Growing dimension or persistent rare counts require separate approximation analysis; merely choosing chi-squared critical values does not supply it.
Some Gaussian models instead yield an exact chi-squared law. If are iid with known , then for every . Parameter boundaries can lead to a Chi-bar-squared distribution or another limit rather than the regular Wilks law. The model and null geometry determine which calibration is justified.
The unrestricted maximum-likelihood estimators remain . Subject to the null constraint, minimizing on gives , while . Consequently
We must calibrate this likelihood-ratio test over the entire composite null. Under that null let and . Then with , while independently, and . Couple all null distributions by , with a fixed standard Gaussian . Increasing decreases pointwise, so the largest rejection probability occurs at , namely .
At this boundary the sign of is independent of , with each sign having probability one half. On , ; on , . Thus the least favourable null hypothesis law is the exact chi-bar-squared distribution . Choose by
The tail is a continuous function and strictly decreasing from one to zero, so this threshold is unique for . The null rejection probability is at most and equals at . This proves the required size, rather than using an interior chi-squared approximation.
To compare, put , the threshold in (i). Since is stochastically larger than (add an independent squared standard Gaussian), the mixture threshold obeys . When , test (ii) therefore requires stronger evidence from than test (i). When , test (ii) also responds to violation of the mean constraint and can reject even with . Neither critical region contains the other. In the coordinates , the acceptance region in (i) is the strip ; in (ii) it is the right half-strip , together with the left half-disk , . The extra constraint changes both the statistic and its correct null calibration.