A Gaussian error is a random error term with a Normal distribution. The exact least-squares conclusions require a specified model: for fixed-design linear regression, let
where the design matrix has full column rank. The error vector thus has independent zero-mean Gaussian coordinates of common variance. For fixed , maximizing the likelihood over is equivalent to minimizing .
The least-squares estimator and its exact sampling law are
This follows because a linear transformation of a Gaussian vector is Gaussian. It is an exact finite-sample law, rather than merely Asymptotic normality.
Zero mean and common variance alone do not imply Gaussian errors or exact normal coefficient estimates. Even with Gaussian errors, fitted residuals are not independent copies of them: with , the residual vector is and has covariance , usually with correlated coordinates and reduced rank. A Normality assumption must identify whether it concerns errors, responses or another latent variable.

Articles by others on the same topic (0)

There are currently no matching articles.