Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2001/iii/paper-30/1/i/solution

Let each observation have dimension , and define the sample mean and the divisor- sample covariance matrix by
The multivariate normal distribution gives the log-likelihood
Writing makes the cross terms vanish, and the last sum becomes . Since is a positive-definite matrix, its minimum over the mean is at . Consequently
When is a positive-definite matrix, . Thus
where depends on the data but not on .
For the maximum-likelihood estimator, consider the positive-definite matrix , with positive eigenvalues . The part of the profile likelihood depending on is . The elementary inequality , with equality exactly at , shows that the unique maximizing matrix is . Hence
The divisor is , not the unbiased covariance divisor . The regularity qualification matters: if is singular, the displayed logarithm of its determinant is not finite, and no positive-definite covariance maximizes the likelihood. Sending the fitted variance in a null direction of to zero makes the likelihood unbounded. For a nonsingular normal population, is positive definite almost surely when , which is the setting of the large-sample test.

New to topics? Read the docs here!