Joint distribution of least-squares and variance estimators

ID: joint-distribution-of-least-squares-and-variance-estimators

With a full-column-rank design and isotropic normal errors, ordinary least squares gives , independent of the residual squared length. Orthogonal design and residual projections of the multivariate normal distribution are independent, and . The maximum likelihood variance estimate is , not the unbiased estimate .

New to topics? Read the docs here!