Nested linear model

ID: nested-linear-model

Two linear regression models are nested when the possible mean vectors of the smaller model form a linear subspace of those of the larger one. With design matrices , this is . Adding a quadratic predictor to an intercept-and-linear model is an example when both use the same observations.
Orthogonal projection then gives . If , , and , independent errors with a normal distribution and common positive variance yield
under the smaller model. The F-test compares a gain in fit with its extra degrees of freedom; simply obtaining a smaller residual sum of squares is automatic and is not itself evidence that the larger model generalizes better.

New to topics? Read the docs here!