Affine invariance of Hotelling's statistic 2026-10-14
Under a nonsingular affine transformation , transform the null mean by the same map. Then the centered sample mean becomes and the sample covariance matrix becomes . Since , the quadratic form in Hotelling's T-squared statistic is unchanged. Its value and test decision are consequently invariant under changes of units, origin and nonsingular coordinates.
Hotelling test of linear hypotheses 2026-10-14
For a fixed rank- constraint matrix , apply Hotelling's T-squared statistic to the transformed observations . Under , for . If the displayed contrasts are dependent, use a basis of their row space and replace by the rank.
Past exam of the mathematics course of the University of Cambridge 2005 iii Paper 46 4 i Solution Created 2026-10-03 Updated 2026-10-14
Multivariate analysis of variance extends analysis of variance to vector responses. For example, a treatment may affect several correlated physiological measurements jointly. Separate univariate tests do not use the correlation geometry and require adjustment if they are interpreted as one multiple-testing procedure. A joint test asks whether group mean vectors differ in any direction.
In a one-way model, take independent , , , with a common positive-definite covariance. Put , and let and be group and overall sample means. The within-group and between-group scatter matrices areExpanding around each group mean makes the cross terms vanish, giving total scatter . To test , use the Wilks lambda statisticwhere solve the generalized eigenvalue problem and is nonsingular. Under the alternative, maximize the normal likelihood at the group means and covariance ; under the null, use the overall mean and covariance . Their likelihood ratio is , so small rejects equal means. Under the null, orthogonal projections of the Gaussian data give independent and , supplying its null calibration. Here is nonsingular almost surely when . Merely having more total observations than responses is not enough if group fitting consumes too many statistical degrees of freedom.
The test is invariant under a nonsingular linear change of response coordinates: both determinants acquire the same factor . The directions associated with large identify mean separation relative to residual variability. With one response it becomes the ordinary ANOVA F-test. With two groups, writing and , the version using Hotelling's T-squared statistic iswith . This formula demonstrates explicitly how the covariance weights a group difference.
The sketch shows hypothetical groups with strongly positively correlated responses and mean separation along their low-variance contrast. Marginal comparisons can look weak even when the joint comparison is informative. The ellipses represent individual-response covariance, not confidence regions for the means. Independence of observations, approximate multivariate normality and common covariance are substantive assumptions; outliers and unequal covariance can invalidate the usual calibration. Follow-up contrasts can identify the affected responses or groups, with appropriate multiplicity control. MANOVA uses shared covariance to test a multivariate mean difference, rather than testing unrelated coordinates in isolation.
Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 46 1 c Solution Created 2026-10-03 Updated 2026-10-14
Assume an independent Gaussian sample, positive-definite population covariance, and . Define the sample mean and unbiased sample covariance matrix byThe standard test is based on Hotelling's T-squared statisticReject the null hypothesis for large values. Under the null its exact distribution isThe factor uses the unbiased, divisor- covariance convention. Normal-sample theory makes independent of the residual covariance, whose whitened version has a Wishart distribution; this yields the stated F-distribution. The condition gives invertibility of almost surely and positive denominator degrees of freedom.
This is also the likelihood-ratio test. To see the connection, put and . The maximized covariance estimates under the unrestricted and null models are and , respectively. The determinant identity for a rank-one update givesThus the likelihood ratio is , decreasing in . The term best is understood here as this standard likelihood-ratio, affine-invariant procedure; a two-sided multidimensional alternative does not specify a single direction to optimize power against.
For the transformed sample , with the prescribed nonsingular coordinate transformation, we haveConsequentlyThis proves the affine invariance of Hotelling's statistic. The statistic, its p-value and its test decision are unchanged by a nonsingular affine transformation, provided the null mean is transformed with the data. Changes of units and rotations are included.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 47 1 a Solution Created 2026-10-03 Updated 2026-10-14
Use the unbiased sample covariance matrixand assume is positive-definite and , so is invertible almost surely. For a nonzero fixed direction , the observations have mean and variance . Their squared Student t-test statistic for the projected null mean isPut . The Cauchy-Schwarz inequality giveswith equality when is proportional to , if . For every projected statistic is zero. Maximizing the squared discrepancy over directions therefore gives Hotelling's T-squared statistic:This uses the squared generalized Rayleigh quotient. The preliminary formula on the printed cover has an unsquared numerator and is not valid as written: setting makes that ratio for , so it is unbounded. The displayed Cauchy-Schwarz argument supplies the needed corrected identity independently.
Under the null, let and . Then , , and are independent. To see these sample properties, apply an orthogonal transformation to the observation indices with first row . Its first centered row is ; its other rows are independent residual contrasts, independent of the first. Their outer products sum to , establishing the Wishart distribution and independence.
Since , use the supplied Gaussian-Wishart quadratic-form law with to obtainThus a level- test rejects when this scaled statistic exceeds the quantile of the F-distribution. The Gaussian-Wishart law requires independence; it holds here because of the orthogonal sample decomposition. Its printed use of instead of the introduced is a notational slip. A fixed-direction Student law alone would not calibrate the maximized statistic, because its maximizing direction depends on the sample.
