Write . In this normal linear model, the ordinary least squares criterion is . Differentiating with respect to gives the normal equations for linear least squares, . Full column rank of the design matrix makes invertible, and completing the square proves that the unique minimum is
Since , its sampling distribution is the multivariate normal distribution
Let be the hat matrix. It is symmetric and idempotent with rank , and . The regression residual vector is , so
An orthogonal projection of a Gaussian vector onto the residual space gives . The residual projection and fitted projection have zero cross-covariance, hence are independent because they are jointly normal. In particular, is an unbiased estimator of and is independent of . The maximum-likelihood estimator of instead divides by and is not unbiased.
For the null hypothesis , put . Under that null hypothesis, is standard normal and independent of . Therefore the Student t-test uses
A two-sided level- test rejects when . The denominator is the estimated standard error of the regression coefficient.
The fitted linear regression includes an intercept and three covariates:
Thus , and the residual degrees of freedom are . The fitted conditional mean is
Each slope measures a conditional association with the response while the other two covariates are held fixed. Increasing wind speed by one mile per hour corresponds to a fitted decrease of in the concentration units used. Its standard error is , giving and a two-sided p-value of : evidence of a negative conditional association at the 5% level. The temperature slope is per degree Fahrenheit, with standard error , and p-value . The insolation slope is per langley per day, with standard error , and p-value . Neither of these last two conditional effects is significant at 5%; that does not establish that either true slope is zero. These are associations, not a demonstration of causal effects.
The intercept estimates the mean at zero values of all three covariates. Its value has a large standard error , giving and p-value . The zero-covariate combination may be outside the observed range, so this test may have little practical relevance. Every coefficient test uses a Student t-distribution with degrees of freedom.
The reported residual standard deviation measures unexplained variation in concentration units; the subsequent table gives , consistent with after rounding. The five-number residual summary describes the spread, from to , with median . An intercept forces the residual sum to zero, not the residual median. These five numbers alone cannot establish normal errors, constant variance or independence; residual-versus-fitted and quantile-quantile plots would be more informative, and successive days also warrant checking serial dependence. The coefficient of determination means that 65.33% of the sample response sum of squares about its mean is explained by this fit. Its adjusted version is
which accounts for the number of estimated regression coefficients.
The stepwise selection by the Akaike information criterion searches between the intercept-only model and the specified model with all three main effects. For these Gaussian fits, the printed Akaike information criterion is, up to a constant common to the candidates,
The full model has and AIC . Removing insolation increases the residual sum of squares by but decreases AIC to , so that removal is chosen. Removing temperature or wind instead would give AIC or and is worse. In the next step the candidate models include deletions and restoration of insolation. Keeping wind and temperature has the smallest AIC: removing temperature gives , restoring insolation gives , and removing wind gives . Hence the search stops, giving
The accompanying F-tests compare a larger model with a one-parameter reduction: , where is estimated from the larger model. For example, removing insolation gives , equal to the corresponding squared test statistic. Deletions from the second-stage model use in the denominator, whereas restoring insolation uses the full-model denominator. These tests describe the comparisons; they do not determine the AIC choice. In particular, temperature is retained despite its deletion-test p-value . AIC balances fit and complexity, and a stepwise optimum need not be a global optimum over a richer model class. Ordinary coefficient inference after choosing a model does not account for the selection itself.
For positive responses, the Box–Cox transformation is for , and . Its profile likelihood refits the linear regression and variance at each and includes the transformation Jacobian. The graph peaks at roughly –. The approximate 95% likelihood-ratio confidence interval contains values a little below zero through approximately one, using the cutoff . Thus a logarithmic transformation () and a square-root transformation () are plausible, while leaving the response on its original scale () is at or very near the upper confidence boundary. The broad profile supports considering a mild power transformation; it does not determine a sharply estimated power. The raster does not justify more precise endpoints or a decisive assertion about which side of the boundary lies.
If a department has population , crimes against persons and crimes against property, cancellation of the common numerator gives
Thus is a property-to-person crime count ratio, not its reciprocal. Both counts must be positive for the printed ratio to be defined.
For the reconstructed 85-row data, fit a normal linear model for the Box–Cox transformation , including four region contrasts plus Literacy, Donations and Wealth. With and , the profile likelihood, up to constants, is
The second term is the transformation's Jacobian determinant; omitting it would incorrectly compare different response scales. Maximization gives , with approximate 95% likelihood-ratio confidence interval . The logarithmic transformation is inside this interval, whereas the raw-scale choice is far outside: the twice-log-likelihood drops at zero and one are and , respectively. A log-response model is therefore a simple supported choice.
In the full log model, partial F-tests give for Region (), for Wealth (), and for Literacy and Donations. Dropping Literacy and Donations together gives and . A parsimonious final normal linear model, with C as reference and , is
The standard errors in that order are ; residual standard deviation is on 79 degrees of freedom and . Use residual-versus-fitted and quantile-quantile plots, influence diagnostics and checks for remaining curvature to assess the working Gaussian model; the small p-values alone do not validate its assumptions.
Holding Region fixed, worsening wealth rank by ten positions multiplies the fitted conditional median ratio by . Relative to C at the same wealth rank, the fitted median multipliers are for E, for N, for S and for W. Region and wealth rank explain much of the variation; Literacy and Donations add little once those terms are included. These are associations in the reconstructed dataset. Back-transforming the fitted log mean gives a conditional median under lognormal errors; estimating an original-scale mean requires bias correction after an inverse transformation. Also, the public archive's metadata describe some historical measures differently from the exam wording, so the fitted Donations effect is interpreted only on its recorded scale.
The least-squares estimator minimizes . Differentiation gives , and the full column rank of makes positive definite. Hence
The fitted values are , where the hat matrix is . The regression residuals are . Since is the orthogonal projection matrix onto the column space of , and
This is a singular multivariate normal distribution supported on the -dimensional orthogonal complement of the column space: its components are generally correlated. The equality puts the fitted vector in that column space, while expresses fitted-residual orthogonality. No residual component lies in an explanatory direction that could improve the least-squares fit.
For the calibration model, write for a reading and for the known amount. The first fit assumes with independent errors. Its residual-versus-fitted plot has systematic changes in group means and an increasing within-group spread. These suggest both a nonlinear mean relationship and heteroscedasticity, rather than the random scatter expected from a satisfactory normal linear model.
The Box–Cox transformation plot is a profile log-likelihood for the power parameter . Its maximum is near ; the horizontal line gives an approximate 95% likelihood-ratio confidence interval, which excludes the untransformed value . Since affine rescaling of the response does not change the fitted mean space, fitting the raw power is equivalent to using with an intercept. The second model is
Its residual spread is more even, but observation 17 has a conspicuously negative residual near . This motivates checking for an outlier or recording error. The third fit omits that observation; omission should be justified by that investigation, since choosing exclusions from residuals can affect inference. Some group pattern still remains, so the transformation alone does not certify a perfect model.
At an amount of nanograms, the third fit predicts the transformed mean
Simply applying the inverse power gives . The requested expected reading needs bias correction after an inverse transformation, since for nonlinear . With and , a second-order Taylor expansion gives
Here the correction uses the residual variance, rather than the variance of the estimated fitted mean. The power-transformed Gaussian model is an approximation for positive readings; the fitted mean is over 31 residual standard deviations above zero, so the negative tail has negligible effect on this local approximation. The ordinary inverse-transformed prediction is therefore essentially at the displayed precision.