Fitted-residual orthogonality

ID: fitted-residual-orthogonality

For a full-rank ordinary least squares design matrix, the hat matrix and residual projection satisfy . Hence fitted values and regression residuals are perpendicular as observed vectors. Under isotropic errors their cross-covariance matrix is zero, and under a normal linear model the two vectors are independent.

New to topics? Read the docs here!