Past exam of the mathematics course of the University of Cambridge / 2001 / iii / Paper 28 / 3

The output must first identify the response scale and the formula. If the initial fit is ordinary least squares to the untransformed response with all fifteen predictors and an intercept, its normal linear model isFor full rank $p=16$, the residual degrees of freedom are $47-16=31$. The residual standard error is $s=\sqrt{\mathrm{RSS}/31}$ and estimated coefficient covariance is $s^2(X^{T}X{)}^{-1}$. A coefficient test divides the estimate by its standard error and compares with a $t_{31}$ reference distribution; the overall test of all fifteen slopes compareswith $F_{15,31}$. The intercept-only residual sum is ${\mathrm{RSS}}_0$. Adjusted R-squared penalizes the loss of residual degrees of freedom, unlike ordinary $R^2$.

Each regression coefficient measures a conditional association holding the other columns fixed. The southern-state indicator compares two state categories at equal values of all other predictors. Rescaling changes the units of a coefficient, so one cannot infer effects per original currency unit or per original percentage unit without the scaling information. If the actual formula uses $\log y$, exponentiating a coefficient gives a multiplicative response change rather than an additive change; if both response and a predictor are logged, the slope is an elasticity. These interpretations cannot be interchanged.

The two police-expenditure variables are likely strongly associated and need a multicollinearity check: individual coefficients can be unstable even when their joint contribution predicts well. Their actual correlation should be calculated, not presumed numerically. Similar considerations apply to age-specific unemployment. With only 47 observations and up to 16 mean parameters, examine regression leverage, Cook's distance, residual distribution, variance versus fitted values, nonlinear effects and predictive cross-validation. State-level geographical dependence may also violate the independent-error model.

The observations are aggregate states. An association between a state covariate and crime rate is not an individual causal effect: ecological fallacy, confounding and reverse causation are relevant. For example, greater recorded crime can induce greater police expenditure. The absent coefficient table and model call prevent deciding which predictors were significant or even whether the fitted response was transformed. The preceding degrees of freedom and formula interpretations are conditional on the explicitly stated full linear-model specification.

For a normal linear model with $n$ fixed observations and $p$ mean coefficients, maximizing over the error variance gives ${\hat{\sigma }}^2=\mathrm{RSS}/n$. The maximized negative twice log-likelihood is $n\log (\mathrm{RSS}/n)$ plus a constant common to the candidate models. Counting the variance as another parameter adds the same penalty two to every model, so the stated criterion is equivalent for comparing them:The Akaike information criterion balances fit against parameter count; smaller values are preferred. It does not compare models using different response scales or different sets of observations without further adjustment.

Stepwise selection by the Akaike information criterion compares allowed one-term additions and deletions, takes a change lowering the criterion, and repeats until no allowed change improves it. The search direction, initial fit and lower/upper scopes matter. A displayed no-change row represents the current model. The term degrees of freedom show how many coefficients a change removes, the residual sum reflects its fit, and the AIC column determines the selected move. The search is greedy, not a guarantee of the best subset over the entire model space. The software's scope and direction conventions are documented in stat.ethz.ch/R-manual/R-devel/library/MASS/html/stepAIC.html .

Deleting $q$ coefficients changes the criterion byThus the AIC deletion threshold in a normal linear model isFor a single coefficient, its partial F-test statistic must be below $(n-p)(e^{2/n}-1)$ for AIC to favor deletion. At the full 47-observation, 16-coefficient fit this is approximately $1.348$, corresponding to $|t|<1.161$. Therefore AIC selection is not equivalent to retaining only coefficients with a conventional five-percent p-value.

The final model should be described by its retained terms, signs, conditional effect sizes, uncertainty, residual diagnostics and prediction behavior. A coefficient that survives selection need not identify a causal mechanism, and its ordinary final-model p-value ignores the preceding search. Stability under bootstrap resampling and predictive cross-validation are useful. The absent search trace and final model prevent identifying the actual deletion sequence, final predictors, coefficients, RSS or AIC. The given starting name does not specify any of those facts.