Under a nonsingular affine transformation , transform the null mean by the same map. Then the centered sample mean becomes and the sample covariance matrix becomes . Since , the quadratic form in Hotelling's T-squared statistic is unchanged. Its value and test decision are consequently invariant under changes of units, origin and nonsingular coordinates.
For a fixed rank- constraint matrix , apply Hotelling's T-squared statistic to the transformed observations . Under , for . If the displayed contrasts are dependent, use a basis of their row space and replace by the rank.
Multivariate analysis of variance extends analysis of variance to vector responses. For example, a treatment may affect several correlated physiological measurements jointly. Separate univariate tests do not use the correlation geometry and require adjustment if they are interpreted as one multiple-testing procedure. A joint test asks whether group mean vectors differ in any direction.
In a one-way model, take independent , , , with a common positive-definite covariance. Put , and let and be group and overall sample means. The within-group and between-group scatter matrices are
Expanding around each group mean makes the cross terms vanish, giving total scatter . To test , use the Wilks lambda statistic
where solve the generalized eigenvalue problem and is nonsingular. Under the alternative, maximize the normal likelihood at the group means and covariance ; under the null, use the overall mean and covariance . Their likelihood ratio is , so small rejects equal means. Under the null, orthogonal projections of the Gaussian data give independent and , supplying its null calibration. Here is nonsingular almost surely when . Merely having more total observations than responses is not enough if group fitting consumes too many statistical degrees of freedom.
The test is invariant under a nonsingular linear change of response coordinates: both determinants acquire the same factor . The directions associated with large identify mean separation relative to residual variability. With one response it becomes the ordinary ANOVA F-test. With two groups, writing and , the version using Hotelling's T-squared statistic is
with . This formula demonstrates explicitly how the covariance weights a group difference.
Figure 1.
Correlated response clouds can overlap marginally yet separate along a low-variance contrast
. Details.
The sketch shows hypothetical groups with strongly positively correlated responses and mean separation along their low-variance contrast. Marginal comparisons can look weak even when the joint comparison is informative. The ellipses represent individual-response covariance, not confidence regions for the means. Independence of observations, approximate multivariate normality and common covariance are substantive assumptions; outliers and unequal covariance can invalidate the usual calibration. Follow-up contrasts can identify the affected responses or groups, with appropriate multiplicity control. MANOVA uses shared covariance to test a multivariate mean difference, rather than testing unrelated coordinates in isolation.
Assume an independent Gaussian sample, positive-definite population covariance, and . Define the sample mean and unbiased sample covariance matrix by
The standard test is based on Hotelling's T-squared statistic
Reject the null hypothesis for large values. Under the null its exact distribution is
The factor uses the unbiased, divisor- covariance convention. Normal-sample theory makes independent of the residual covariance, whose whitened version has a Wishart distribution; this yields the stated F-distribution. The condition gives invertibility of almost surely and positive denominator degrees of freedom.
This is also the likelihood-ratio test. To see the connection, put and . The maximized covariance estimates under the unrestricted and null models are and , respectively. The determinant identity for a rank-one update gives
Thus the likelihood ratio is , decreasing in . The term best is understood here as this standard likelihood-ratio, affine-invariant procedure; a two-sided multidimensional alternative does not specify a single direction to optimize power against.
For the transformed sample , with the prescribed nonsingular coordinate transformation, we have
Consequently
This proves the affine invariance of Hotelling's statistic. The statistic, its p-value and its test decision are unchanged by a nonsingular affine transformation, provided the null mean is transformed with the data. Changes of units and rotations are included.
Use the unbiased sample covariance matrix
and assume is positive-definite and , so is invertible almost surely. For a nonzero fixed direction , the observations have mean and variance . Their squared Student t-test statistic for the projected null mean is
Put . The Cauchy-Schwarz inequality gives
with equality when is proportional to , if . For every projected statistic is zero. Maximizing the squared discrepancy over directions therefore gives Hotelling's T-squared statistic:
This uses the squared generalized Rayleigh quotient. The preliminary formula on the printed cover has an unsquared numerator and is not valid as written: setting makes that ratio for , so it is unbounded. The displayed Cauchy-Schwarz argument supplies the needed corrected identity independently.
Under the null, let and . Then , , and are independent. To see these sample properties, apply an orthogonal transformation to the observation indices with first row . Its first centered row is ; its other rows are independent residual contrasts, independent of the first. Their outer products sum to , establishing the Wishart distribution and independence.
Since , use the supplied Gaussian-Wishart quadratic-form law with to obtain
Thus a level- test rejects when this scaled statistic exceeds the quantile of the F-distribution. The Gaussian-Wishart law requires independence; it holds here because of the orthogonal sample decomposition. Its printed use of instead of the introduced is a notational slip. A fixed-direction Student law alone would not calibrate the maximized statistic, because its maximizing direction depends on the sample.