Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2005/ii/paper-3/5i/b/solution

Define the hat matrix . It is symmetric and idempotent, the orthogonal projection onto the column space of . Since ,
The covariance is . This normal distribution can be singular when , since all fitted vectors lie in the -dimensional model subspace.

New to topics? Read the docs here!