Distribution of the Akaike information criterion in a normal linear model

ID: distribution-of-the-akaike-information-criterion-in-a-normal-linear-model

Consider the correctly specified fixed-design normal linear model , with an full-column-rank design matrix, , and with . Both and are unknown, so the Akaike information criterion counts fitted parameters. If is the residual sum of squares, then
The orthogonal-projection decomposition of a random variable with a multivariate normal distribution gives . Substituting into yields
Here denotes a random variable, not a quantile. The maximum-likelihood estimator of the error variance uses divisor ; the unbiased residual variance estimator with divisor cannot be substituted into the maximized likelihood. If and is invertible, the fit has zero residual sum of squares, and the Gaussian likelihood is unbounded as decreases to zero. There is then no finite positive-variance maximum-likelihood estimator to which the displayed Akaike information criterion law applies.

New to topics? Read the docs here!