In a normal linear model with an intercept, observations and independent mean coefficients, adjusted is
It compares the residual variance estimate with the unmodelled sample variance, adjusting the raw coefficient of determination for fitted dimension. It can be negative and is not guaranteed to increase when another regressor is added. In penalized regression a related convention uses the fit's effective degrees of freedom instead of ; the precise smoothing-software variance convention should be specified.
A likelihood-based analogue of the coefficient of determination compares the fitted and intercept-only log-likelihoods and :
For a Cox proportional-hazards model, these are maximized partial likelihood logarithms with and without the covariates. The expression measures improvement in fit, rather than the fraction of variation in event times explained. Its attainable maximum can be below one. It does not test the proportional hazards assumption or establish predictive calibration.
Multiple linear regression Created 2026-10-14 Updated 2026-10-18
Multiple linear regression models a scalar response by an intercept and several predictors. It is linear in the regression coefficients, even when predictors include transformed variables or interactions. In an observational study, adjustment can address measured confounding, but does not automatically identify a causal effect. Improvements in fitted coefficient of determination require external predictive assessment rather than being treated as proof of improved future prediction.
The fitted age slope is very small and negative, about efficacy points per year, with no conventional evidence against a zero linear slope: , . The model explains only about 0.0367% of the observed efficacy variation. These results concern a linear association, not proof of no possible age relationship or a causal effect of ageing.
The descriptive statistics report 2466 observed ages and efficacy scores, with no missing values for either variable. Age ranges from 14 to 97 years, with sample mean 52.689 years and sample standard deviation 19.064 years. Efficacy ranges from 0 to 16, with sample mean 9.348 and sample standard deviation 3.176 scale points. The standard deviations use different units and should not be compared as though their numerical ratio measured relative substantive variability. The efficacy mean retains the conflict with Question 1's group summaries; that conflict is not resolved by this separate regression output.
A simple linear regression models , where is efficacy and is age in years. Ordinary least squares chooses the coefficients to minimize the residual sum of squares. From the printed coefficients the fitted line is
Holding to this model, ten additional years correspond to fitted scale points. For example, the fitted mean is about 9.453 at age 20 and 9.261 at age 80, a difference of about points. These are fitted means, not exact predictions of individual scores. The line does not imply that every person's efficacy falls at that rate, nor that cross-sectional age differences identify within-person changes over time.
The intercept is the predicted mean at age zero, about 9.517. Since zero is outside the observed 14–97 age range, its direct interpretation requires extrapolation. The printed standard error of 0.188043 and yield the extremely small displayed p-value for a zero intercept. That test does not test whether age is a useful predictor. Recentring age at its observed sample mean would put the intercept near , the fitted mean at a substantively relevant reference age. This agrees with the rounded overall efficacy mean.
The age standard error is 0.003356 points per year. The coefficient divided by this standard error gives , agreeing with the printed t value. Estimating an intercept and one regression slope from 2466 observations leaves residual statistical degrees of freedom. Under a correctly specified normal linear model, the Student t-distribution provides the stated two-sided p-value. At 5%, or 1%, it does not reject . The p-value is not a 34.2% probability that age has no effect, and nonrejection does not establish a practically negligible effect size.[ref]
A 95% confidence interval calculated from the printed estimate and standard error is approximately
or about points per decade. It includes zero and gives the scale of slopes compatible with these summaries and assumptions. Assessing a practically negligible effect would require an explicit substantive tolerance and an appropriate equivalence test, not simply the fact that . A nonlinear association could also coexist with a near-zero overall linear slope.
The coefficient of determination is , meaning that the fitted line explains about of the sample's centred efficacy sum of squares compared with an intercept-only fit. This is not 36.7%, a fraction of people whose efficacy is predicted correctly, or the proportion of efficacy caused by age. The adjusted coefficient of determination, approximately , is slightly negative because its penalty for estimating the extra coefficient exceeds the tiny improvement in fit. It need not be constrained to be nonnegative and does not mean a negative amount of explained variation.
The overall on 1 and 2464 statistical degrees of freedom, with , tests the same zero-slope hypothesis as the age t test because there is only one predictor. The simple-regression output identities give and ; the printed numbers agree allowing their displayed precision. The signed Pearson correlation coefficient is consequently about . These are related summaries of the same weak linear association, not independent corroborating tests.
The residual standard error of 3.177 points estimates the typical unexplained error scale under the fitted model. It is close to the efficacy sample standard deviation, as expected when the line explains almost none of the variation. It is not a standard error of the slope or a guarantee that each individual's prediction error lies within 3.177 points. The residual summary spans roughly to , with sample median about 0.573 and central quartiles about and . An ordinary least-squares fit with an intercept has zero mean residual, not necessarily zero median residual. These few quantiles cannot establish normality, constant conditional spread, absence of outliers or linearity. The apparent last-decimal discrepancies among rounded error scales and other summary fields do not force an additional contradiction: their rounding intervals admit compatible regression summaries.
The conventional uncertainty calculations assume independent, mean-zero errors conditional on age, an appropriate linear mean, and homoscedasticity; normal errors give the usual exact finite-sample t and F calibration. Large samples can relax some distributional requirements but do not remove confounding, selection bias or dependence. A residual-versus-fitted plot could reveal curvature or changing spread, and a normal probability plot could assess error shape; neither plot can be reconstructed from the printed residual quantiles. A prediction interval for an individual includes residual variation and is wider than a confidence interval for the mean response. The supplied output supports a very weak, imprecisely signed linear association with little predictive gain from age alone, while leaving nonlinear, causal and design-based questions unresolved.
Read conditionally, the fitted slope says that a one-point higher skill score is associated with about 0.209 more household devices in the fitted conditional expectation. The printed summary also claims a significant slope and about 28.93% explained sample variation. Those claims cannot be assembled into one valid fitted model: several regression identities fail, so a single verified coefficient-and-uncertainty report is unavailable.
The response is a device count, while the predictor is a skill score. A simple linear regression models , where is the device count and the skill score. Ordinary least squares chooses the intercept and regression slope to minimize the residual sum of squares. The regression slope describes a conditional association, not the causal effect of training or acquiring a device.
The descriptive statistics put the device count between and , with sample mean about and sample standard deviation about among records. Skill scores range from to , with sample mean about and sample standard deviation about among records. Two missing skill values account for the stated two deleted records; because device counts have no missing values, the regression complete-case sample has observations. Estimating two regression coefficients leaves residual statistical degrees of freedom, matching that part of the output. The units of the two standard deviations differ, so comparing with does not establish that skill is more variable in a substantive sense.
If the coefficient estimates are trusted, the fitted values follow . The intercept predicts about devices at a skill score of zero; zero is within the stated score range, but precision and the number of observations near zero are not shown. A five-point increase in score corresponds to about additional fitted devices and a ten-point increase to about . At a score of ten the fitted value is about , and at 24 it is about . Expected counts may be fractional even though individual counts are integers. These are conditional interpretations of the coefficient fields, not reconstructed raw observations or validated individual predictions.
A coefficient's standard error estimates its sampling uncertainty, whereas the residual standard error describes unexplained response variation. For the intercept, , agreeing with the printed and rounded . Conditional on the model assumptions, this would reject a zero intercept at conventional significance levels. The intercept test is not a test of whether skills predict devices. For the slope, the printed would reject at 5% but not 1%; it does not assign a probability to the null hypothesis or measure the usefulness of prediction. The significance stars simply encode thresholds and add no independent evidence.[ref]
The slope row fails its own arithmetic check:
At statistical degrees of freedom the ratio gives a two-sided p-value about , while the printed gives about ; neither is . Thus the choice of which source field is trusted changes the apparent strength of evidence, including the 1% decision. A 95% confidence interval built conditionally from the printed estimate and standard error would be about , but it is not a verified interval from a coherent fitted model. In fact, using the printed residual standard error , the complete predictor sample size and predictor standard deviation gives a slope standard error near , not .
The printed coefficient of determination would mean that the fitted line explains of the complete-case sample's centred device-count sum of squares relative to an intercept-only fit; remains unexplained by that comparison. It is not the percentage of devices caused by skill, the fraction of correctly predicted households, or a measure of future predictive accuracy. The adjusted coefficient of determination is consistent with that and the given sample size, allowing rounding. The small adjustment reflects fitting one slope among many cases; it does not validate the model.
For a one-predictor ordinary least squares fit with an intercept and the usual common-variance standard errors, the simple-regression output identities require
Here the printed slope t gives , the printed F field says , and the printed instead implies . These cannot all hold. Moreover, on and statistical degrees of freedom has p-value about , not . Reading the printed F p-value alone would give a 1% significant test of the zero-slope model, but its reported calibration is incompatible with its statistic. No significance label resolves these identities.
There is also a contradiction that does not depend on tail probabilities. Ordinary least squares with an intercept makes the arithmetic mean of fitted values equal the arithmetic mean of observed responses on the analysed records. The printed coefficients and predictor mean give . Deleting two device counts anywhere in the printed range , and allowing the reported overall mean to be rounded, would leave the complete-case device mean between approximately and . The mean bounds after deleting bounded observations therefore rule out reconciling with the response summary merely by citing those two missing predictor values. This is not the mistaken assumption that full-sample and complete-case sample means must always be identical.
If its own field were trusted, residual standard error estimates the unexplained response standard deviation, in device-count units. It is neither the standard error of the slope nor a guarantee that every prediction is accurate to devices. The residual five-number summary has extremes near and and median near , with central quartiles near and . The roughly central median does not establish normally distributed errors, homoscedasticity, independence or a linear conditional expectation. A residual-versus-fitted plot could check curvature and spread; a normal probability plot could assess an error-shape approximation. Neither diagnostic can be recovered from five residual quantiles alone. Individual prediction intervals include response variation as well as coefficient uncertainty and are wider than confidence intervals for the conditional expectation.
For conventional finite-sample t and F calibration, a normal linear model assumes independent mean-zero normal errors of common variance with an appropriate predictor specification. Mean-zero errors conditional on skill and adequate sampling remain essential even when large-sample approximations relax normality. A bounded count response can have nonconstant conditional variance, so residual diagnostics and a scientifically suitable response model matter; count data do not become normally distributed just because the sample is large. Poisson regression is one possible alternative to investigate, but its own conditional mean–variance assumptions and the bounded device range require assessment, not automatic substitution. Complete-case selection can also bias the fitted association if it depends on the response in a relevant way. The only safe summary is conditional: the printed slope is positive, but the numerical effect, its standard error, t/F evidence and explanatory fit require a corrected, coherent output before a single definitive regression claim is made.
The fitted simple linear regression for the numerical vaccination intention scale is
Here age is measured in years. The fitted mean increases by about 0.01649 score points per year, or 0.16489 points per decade. The regression coefficient is an association across respondents, not an estimate of how an individual would change on ageing or of a causal effect of age.
The standard error of the age regression coefficient is . Dividing gives , with 2,133 residual statistical degrees of freedom, corresponding to fitted residual degrees. The reported two-sided p-value is , so the zero-slope null hypothesis is rejected at a prespecified 5% level, but not at 1%. An approximate 95% confidence interval is
Its positive endpoints are consistent with the test decision; they do not make the slope large.
The coefficient of determination is , so the fitted age trend accounts for only 0.2744% of the observed score variation, compared with an intercept-only prediction. Its adjusted value is . In an intercept-containing simple linear regression, the positive slope implies a positive Pearson correlation coefficient . The reported overall statistic, on one and 2,133 degrees of freedom, agrees with the squared slope test statistic up to printed rounding.
The residual standard deviation estimate is score points, much larger than the fitted decade contrast. At age 50 the fitted value is about , and at 60 it is about . Across the observed ages 19 to 91, the fitted mean changes by only points. Statistical detection with 2,135 observations therefore coexists with weak individual prediction.
The intercept predicts at age zero, outside the observed age range; it should not be given a substantive infant interpretation. Centring age at its observed sample mean, , gives
which agrees with the reported score sample mean of after rounding. The bounded scale and upper quartile at its maximum motivate attention to a possible ceiling effect; they do not establish homoskedasticity, a normal error distribution or a satisfactory linear conditional mean. Five residual quantiles cannot replace a residual plot or checks of the sampling assumptions.
There is also a source consistency problem. The output reports that all 2,135 records have age and score present, that the attained minimum score is one, and that ages lie between 19 and 91. The positive fitted slope therefore places every fitted value between and . By residual extrema when response extrema are attained, the minimum regression residual must satisfy
At the observation with score one, its residual is already at most . The printed minimum residual, , lies outside this necessary interval. Those summaries cannot all describe the same complete sample and fitted model. The discrepancy is too large to be explained by the displayed rounding. It is present in the original PDF; the individual records would be needed to establish which printed item is wrong.
Figure 1. . The left panel uses the reported fitted coefficients over the observed age range, with the numerical response scale shown for context. It contains no reconstructed individual observations. The right panel compares the printed minimum regression residual with necessary algebraic bounds derived from the attained response minimum. That interval is a consistency constraint, not a confidence interval. Details.
The fitted simple linear regression is
Its regression slope is a predicted decrease of approximately 0.006314 trust-score units per extra year, or 0.06314 units per decade. This is an estimated statistical association between age and the score. A cross-sectional study does not establish that the same person's trust decreases at this rate as they age.
The estimated standard error of the slope is 0.005427. Testing a zero regression slope gives on 746 residual degrees of freedom and . An approximate 95% confidence interval is
There is insufficient evidence of a nonzero linear age association at the 5% level. The interval includes both small negative and small positive slopes; failure to reject does not establish an exactly zero relationship or rule out a nonlinear one.
The regression intercept 6.388920 predicts the score at age zero. That age is outside the observed 19–89 range, so interpreting it substantively would be extrapolation. Its very small reported p-value tests a zero intercept, rather than the age hypothesis. The 746 residual degrees of freedom correspond to 748 observations minus the intercept and slope.
The coefficient of determination is , so the fitted line explains approximately 0.1811% of the observed centered variation, rather than 18.11%. The adjusted coefficient of determination is approximately 0.0004732. The residual standard error is 2.602 score units, close to the reported response standard deviation; most variation remains unexplained by the fitted line. With one predictor and an intercept, the slope's F-test is the square of its Student's t-test statistic, up to printed rounding, so and agree with the slope test.
Output 6 is a residual-versus-fitted plot: its vertical coordinates should be regression residuals . The fitted values range over only approximately 5.83–6.27, as the weak slope predicts over ages 19–89. The printed scatter shows no obvious strong mean curvature or clear widening funnel, but it has marked horizontal concentrations near its extreme residual levels. An absence of obvious curvature does not prove a correct linear conditional mean, and the plot alone cannot establish homoscedasticity, independent errors or a normal distribution. A normal probability plot and residuals against observation order address different aspects. Large residuals also do not by themselves establish influential observations; regression leverage and Cook's distance matter.
There is an additional inconsistency in the original figure. The descriptive output reports observed responses between zero and ten, so residual constraints from a bounded response require
Yet the printed graphic contains points around , which would imply , above the stated observed maximum. Some lower-edge points likewise imply negative responses. This is present in the original PDF, rather than introduced by the transcription. The graphic therefore cannot be treated as a fully consistent diagnostic of the reported dataset. The observations about its visible shape above describe the supplied picture; reliable model checking would require the actual fitted values and residuals.
The printed code has separate typographical problems. The displayed model call supports the intended formula with ~, and the plot needs one closing parenthesis:
model1 <- lm(t_guard ~ age, data = exam)
plot(fitted(model1), residuals(model1),
     xlab = "Fitted values", ylab = "Residuals")
abline(h = 0)
These calls correct the syntax; they cannot be rerun on the original observations because the individual-level dataset is not supplied. The regression interpretation above uses the available numerical summaries and states the diagnostic limitation explicitly.
The ordinary least squares fit estimates the conditional mean of the continuous safety response as a linear function of the income coding:
The regression coefficient for income is positive. Since larger response values mean greater safety, one additional coded income unit corresponds to an estimated increase of safety-scale units in the fitted mean. Following the question's stated units, a unit is a £10,000 income step. The observed coding also uses income bands with open end categories, so this is a linear trend per coded band step; it is not evidence of a known constant effect for every extra pound, especially within the open top band. The output's abbreviated variable label does not override the stated units.
The intercept is the fitted mean at income code zero. It is estimated as , but zero is outside the observed income codes, so that value is an extrapolated model baseline, not an observed estimate for a particular income category. Its small p-value tests a zero intercept; it is not the main test of the income association.
For the income coefficient, the standard error is . The reported test statistic and two-sided test give
providing strong evidence against the null hypothesis of zero linear slope under the stated model assumptions. A Student t confidence interval, using residual statistical degrees of freedom, is
This is an interval for the population linear coefficient under the model, not an interval containing of individual safety scores. The large-sample estimate is precise enough to detect a positive association, but that does not establish substantial individual predictive power.
The coefficient of determination is : the fitted line accounts for about of the in-sample variation about the response sample mean. The adjusted coefficient of determination is about . Thus income alone explains very little of the observed variation, despite the small slope p-value. The residual standard error of response units describes substantial scatter about the fitted line. This is an estimated residual standard deviation, rather than the standard error of the slope or a complete individual prediction interval.
The overall F-test has on statistical degrees of freedom and . With one predictor and an intercept, it tests the same zero-slope hypothesis as the coefficient Student's t-test; , up to rounding. It is not an additional independent confirmation. In this simple linear regression, the Pearson correlation coefficient has the slope's sign and magnitude , another description of the weak linear association.
The regression uses complete observations and estimates two coefficients, giving residual statistical degrees of freedom. The deletion of observations is complete-case analysis; extending its conclusions to the full target population requires suitable assumptions about the missing-data mechanism. Classical reported standard errors also rely on an adequate linear conditional mean, independent errors and homoscedasticity; a normal linear model gives the finite-sample Student t-distribution and F-test calibration, while large-sample approximations can justify similar tests under weaker distributional assumptions. The printed summary alone does not establish these assumptions. Regression diagnostics and, where appropriate, heteroskedasticity-consistent standard errors address different parts of that assessment.
Finally, this unadjusted observational study estimates an association. Other covariates, such as age or experience status, may be related to both income and reported safety. Without additional design or causal identification assumptions, the positive fitted slope does not establish that increasing income would cause an increase in safety.
TODO: the model's explained-variance value is absent. For an ordinary least-squares linear regression with an intercept, the coefficient of determination is . Its value multiplied by one hundred is the corresponding percentage of sample variation explained by that fitted model. Read the actual reported and distinguish it from the adjusted coefficient of determination; neither is a verified prediction-performance estimate on new data. Without the missing summary or sums of squares, no numerical percentage can be recovered.
The S-Plus input and the data table differ in one entry: the former uses for the first year in the second male age group, whereas the table has . The displayed coefficients are reproduced by the software vector with , so that is the input analysed here. Using instead would give a different fit, including an intercept of rather than .
The factor grid has rows. Its first factor varies fastest, so the five years run within each age group, and the age groups run within each sex. All three predictors are regression factors: in particular the year coefficients are category contrasts, not a fitted linear slope in calendar time. Under reference-level coding, take the first year, youngest age group and men as the reference levels in a regression factor. Write for women and for men, and for the other year and age indicators. The normal linear model is
The star in the formula includes both main effects and their statistical interaction. There are twelve coefficients: an intercept, four year contrasts, one sex contrast, three age contrasts and three sex-by-age contrasts. Year effects are assumed common across all sex-age combinations; there is no year interaction term. Independent errors with common variance are additional assumptions of the reported exact tests.
The least-squares estimator is , where has rank twelve. Under the normal linear model,
and these quantities are independent. This standard normal-projection theorem gives and estimated coefficient standard errors . A coefficient estimate divided by its standard error has a Student t-distribution with 28 degrees of freedom under its zero-coefficient null. These are the printed t statistics and two-sided p-values; a printed zero is rounding, not a probability of exactly zero. The option suppresses the coefficient-correlation display.
The fitted intercept is the expected percentage for the reference sex, age and year. Relative to that year, the year changes are percentage points. The last two are individually significant at the conventional five-percent level; the first two are not. The sex coefficient is the female-minus-male difference in the youngest group. The male age changes are points. Adding the three interaction term coefficients gives the female age changes . Thus the sex gap shrinks with age. An individual insignificant interaction term coefficient does not justify deleting the whole interaction: the joint partial F-test for the three interaction terms gives on degrees of freedom, with .
The regression residuals are observed minus fitted percentages; their printed five-number summary describes their spread. Direct calculation gives , so the residual standard error is
The coefficient of determination is . The overall F-test compares all eleven non-intercept coefficients with zero:
Under the null it has an F-distribution on degrees of freedom; its very small p-value shows substantial explained variation. This does not independently validate the Gaussian error assumptions. Survey percentages can have different sampling variances and correlations, and the survey denominators and design are not supplied. The output's exact inferential interpretation is conditional on the stated normal linear model.
The final command makes an interaction plot, not another regression fit. Its points are arithmetic averages over the five years for each sex-age combination. It draws two decreasing, nonparallel lines, with coordinates
Their gaps are percentage points, illustrating the sex-by-age statistical interaction. The average uses the software vector's disputed entry, consistently with the displayed fit. These are means of percentages, not denominator-weighted pooled prevalence estimates.
Figure 1.
Sex-by-age interaction plot averaged over years, using the printed software input
. Details.
The commands read the 52 cell values into a vector and build the matching two-factor layout. In expand.grid(country, goods) the first factor varies fastest, so the four countries are listed successively within each goods category. This matches row-by-row reading of the displayed table. Converting Goods to a factor is essential: its labels identify 13 categories and are not a quantitative trend. Country supplies the other categorical factor. The summaries suppress coefficient correlations, not coefficient standard errors.
The first fit is the additive two-factor normal linear model
There are free coefficients and residual statistical degrees of freedom. This is two-way analysis of variance without an interaction term. For this complete balanced layout, ordinary least squares gives
These formulas follow from the row- and column-sum normal equations: fitted row and column totals equal their observed totals. The balanced-design coefficient standard errors are for a goods contrast, for a country contrast, and for the reference-cell intercept. These yield the common contrast standard errors and the different intercept standard error in each summary. In particular the intercept is the fitted Software–UK value, not the grand mean or the observed Software–UK entry.
Thus the first intercept predicts million euros for Software in the UK. The Books coefficient adds million euros to the fitted value in any country, relative to Software; every other goods coefficient has this same arithmetic-difference interpretation. The country coefficients subtract , and million euros from the UK prediction for France, Germany and the rest of Europe respectively, regardless of goods. The model therefore assumes common absolute country differences across goods categories. For Software–France its prediction is
which is impossible for positive spending and indicates a limitation of this additive original-scale specification.
The residual standard error is million euros, obtained from ; direct calculation gives . Each coefficient's printed statistic is , with a reference distribution under this normal linear model. The two-sided p-values compare each goods category with Software, or each other country with the UK, after adjustment for the other factor. For example France and the rest of Europe differ significantly from the UK at 5%, but Germany does not. The raw-scale significant goods differences are Books, Clothing, Electronic Goods, Groceries and Leisure Travel; these are individual reference-level comparisons, not an overall test of the goods factor.
The coefficient of determination is . The omnibus F-test compares all 15 nonintercept coefficients with zero:
with reference and . This says at least one factor contrast is nonzero under the assumed error model. There is one observation per cell, so an unrestricted goods-country interaction would saturate the model, leaving zero residual degrees of freedom. Without replication or a specified interaction structure, the residual variation cannot be separated into interaction and independent error.
The second fit applies a logarithmic transformation and fits the same factor design to . The Gaussian log-response model is
Its intercept exponentiates to a fitted Software–UK conditional median of million euros. Goods coefficients now give multiplicative ratios to Software, and country coefficients give multiplicative ratios to the UK. The estimated country ratios are
For example the Books ratio is and the Sports Equipment ratio is , consistently across countries. The model assumes common relative, rather than common absolute, country effects. It also guarantees positive retransformed fitted values. Under normal log errors, the original-scale conditional mean is , whereas is the conditional median and geometric mean. Correcting the retransformation bias here multiplies the naive predictions by approximately .
The log-scale residual standard error is , with the same 36 residual degrees of freedom, corresponding to a typical multiplicative error multiplier . France and the rest remain significant reference-country contrasts; Germany remains nonsignificant at 5%. The log-scale significant reference-goods contrasts are Books, Music, Videos/DVDs, Clothing, Sports Equipment, Electronic Goods, Groceries and Leisure Travel. Event Tickets, Toys, Video Games and Housewares do not individually differ significantly from Software at that level. These p-values remain subject to the usual multiple testing qualification.
The log-scale is computed using variation in the logarithms, so it cannot by itself establish better fit on the original response scale. The change is plausible because spending varies widely in magnitude and relative discrepancies are more meaningful than constant absolute discrepancies, but it should be assessed with regression diagnostics, especially a residual-versus-fitted plot and a normal Q-Q plot. The minimum residual near merits inspection; the command summaries alone do not verify independent normal errors. Moreover these responses are forecasts, so the inferential p-values have a literal sampling interpretation only if an appropriate stochastic model for their uncertainty is justified.
The log-scale analysis of variance adds Goods and then Country. In this balanced design their effect spaces are orthogonal after removing the intercept, so the sequential sums of squares equal the corresponding adjusted factor sums and are unchanged by reversing the two factors:
The residual sum of squares is , giving . Thus
Their tiny upper-tail p-values show strong overall goods and country effects under the log-error model; a globally significant country factor is compatible with the nonsignificant individual Germany contrast. The omnibus fit statistic is on degrees of freedom, whose p-value is approximately . The printed zero reflects numerical formatting, not an exactly zero probability.
If two cell entries were missing, retain their correct factor labels and mark those responses unavailable, rather than shifting the remaining scan values into different cells. Fit the additive models to the 50 observed cells, assuming the missingness mechanism permits those observations to be analyzed without selection bias. All factor levels remain represented, and the row-column incidence graph remains connected: any two goods rows still share an observed country, since only two edges of the complete layout have been removed, and every country still has many observed goods. By identifiability of an incomplete two-factor additive design, the design therefore still has rank . Hence
The coefficients and their covariance must be recomputed by the observed-cell ordinary least squares equations. The balanced row-mean-plus-column-mean formulas and common within-factor standard errors no longer apply. Goods and Country effects are generally no longer orthogonal, so sequential ANOVA sums can depend on order; factor tests adjusted for the other factor should use nested model comparisons. Missing cells do not restore replication or make an unrestricted interaction test possible: that larger model still fits every observed cell exactly. If missingness depends on the unavailable spending values, additional modelling of that mechanism would be needed.
scan reads the numerical prices, including the three missing-value markers, into a vector. The data must be read row by row for the subsequent factor construction to match them. The sample size available for analysis is therefore , rather than . The numerical summary describes the observed prices: the sample median is £43.54 and the sample mean is £46.94. The upper tail, particularly the boots, raises the sample mean above the sample median. These summaries mix very different products and are not adjusted country comparisons.
The two character scans create labels. gl(8,5,length=40,labels=item) makes a regression factor with each of eight item labels repeated five times. gl(5,1,length=40,labels=country) cycles through the five country labels once for each item. For a regression factor and numerical response, the two plot commands produce grouped box plots. The country box plots suggest lower US prices, while the item box plots show particularly expensive boots and inexpensive cardigans. They are descriptive displays of this small basket, with different item compositions where prices are missing; they cannot separate country effects from item effects.
The first lm fits an additive two-way analysis of variance:
The constraints are R's usual treatment coding. The normal linear model used for the printed tests assumes independent errors with common variance and approximately a normal distribution, and no item-by-country interaction in the mean. Missing prices are omitted, leaving responses and independent mean coefficients. Thus the residual degrees of freedom are . This deletion is defensible for the conditional price model when missingness does not depend on the unobserved error after conditioning on the two factors; the output itself does not establish such a missing-data mechanism.
The anova tables report sequential sums of squares, rather than order-independent adjusted effects. If are the residual sums of squares from the intercept-only, country-only, item-only and additive fits, the first order allocates to country and to item. The second order allocates to item and to country. Both allocations sum to the same total explained sum of squares, and both end with the same residual sum of squares . The three missing combinations destroy balanced factorial orthogonality, so the allocation changes with order. To test country after allowing for items, use the country row in the second table; to test item after allowing for countries, use the item row in the first table. The first-entered rows do not supply those adjusted tests.
Each mean square in ANOVA divides its sum of squares in ANOVA by its statistical degrees of freedom, and each printed F-statistic divides that mean square in ANOVA by . In particular, the adjusted country partial F-test has
with an reference F-distribution and p-value approximately . The adjusted item partial F-test gives on statistical degrees of freedom. Both factors contribute strongly under the additive normal linear model. The larger item sum of squares in ANOVA measures the much greater differences between these products, but is not evidence that every pair of items differs significantly.
The intercept is the fitted UK price for the reference jeans, not their observed price and not the overall sample mean. Each country regression coefficient is its adjusted price difference from the UK, assumed common across items: Sweden is £5.224 lower, France £10.708 lower, Germany £7.676 lower and the US £21.328 lower. Each item regression coefficient is its adjusted difference from the reference jeans, assumed common across countries. Thus the fitted UK boots price is , and the fitted US boots price is .
The coefficient standard errors come from , where and is the design matrix. Dividing each estimate by its standard error gives the displayed Student t-test statistic, with statistical degrees of freedom. The stars summarize the corresponding two-sided p-values. The individual tests compare each indicated country or item with its reference level, conditional on all other additive terms; they are neither tests of every pairwise comparison nor a simultaneous confidence interval procedure. In particular, Sweden's p-value provides weaker evidence than the other country contrasts, and does not establish equality with the UK. The intercept test has little substantive relevance, and interpreting many individual stars also raises multiple hypothesis testing issues.
The residual standard error measures unexplained prices in pounds. With total corrected sum of squares , the coefficient of determination and adjusted coefficient of determination are
Much of this impressive fit is due to the large differences between items. The overall F-test compares the additive fit with a constant mean: on statistical degrees of freedom. It tests that all eleven non-intercept coefficients vanish, not that the additive model is adequate. Regression diagnostics should examine regression residuals, changing price variability across items and possible interaction. Percentage differences may be more plausible than common pound differences, motivating a natural logarithm of price. No random sample of countries or products, and no independent replication of a price within a cell, is supplied; broad claims about all designer goods or the causes of country differences require more than these conditional tests.
Finally, Item*Country expands to both main effects and their full interaction. A cell-means parameterization has one separate fitted mean for every observed cell. With one response per cell its design matrix has row matrix rank , while the full layout nominally has coefficients. Three coefficient combinations are aliased because their cells are missing. This is saturation of an unreplicated two-factor regression: every observed price is fitted exactly and the residual degrees of freedom are zero. The final fit has zero residuals, and no residual-based estimate of the error variance or ordinary interaction significance test. The printed numerical summary will mark three coefficients unestimable; coefficient standard errors, tests and adjusted involve undefined division by zero, potentially appearing as NaN or Inf according to numerical roundoff. Perfect interpolation here is a consequence of a saturated statistical model, not evidence for a superior predictive model.
The association is strongly statistically significant under the reported regression assumptions, but age alone has only moderate predictive ability. The reported confidence interval for the age regression coefficient excludes zero by a wide margin. If it is the usual two-sided 95% interval from a normal linear model with an intercept and one predictor, there are degrees of freedom. Taking gives
Thus the two-sided p-value against zero slope is far below . This conclusion concerns a statistical association in the sampled population; it does not establish an individual growth rate. Clustering by practitioner, nonconstant variance or nonindependent observations would require an appropriate standard error rather than blind reliance on this calculation.
The scatter plot has substantial vertical spread at each age. A narrow slope confidence interval describes uncertainty about the average trend, whereas a prediction interval for a new person's ear length must also include the residual variance. The reported interval even permits an approximate numerical assessment: write and let . In simple linear regression, , while the fitted and residual sums of squares are and . Hence the coefficient of determination is
Under these assumptions, age explains only about 27% of the sample variation; roughly 73% remains unexplained. The calculation is approximate because the printed slope and interval are rounded. For a new individual aged , the usual prediction interval is based on
The leading one represents individual residual variation. The provided summaries do not determine and separately, so they do not supply a numerical prediction interval.
Record sex, height or another measure of body size, ancestry, family characteristics and practitioner or measurement method. Use these covariates in a multiple linear regression, allowing scientifically justified nonlinear age effects or interactions, and assess prediction error on held-out observations. A guessed overall sex proportion cannot replace individual sex measurements or identify sex-adjusted effects.
There is a source inconsistency: the PDF's numerical ear-length summary is ten times the scale of its plotted measurements and fitted line. Indeed, the fitted line at the reported mean age gives about mm, whereas the printed mean is about ten times larger. Missing decimal points in the summary are a plausible explanation. The significance and approximate above use the mutually consistent slope, interval and graph; they do not treat the inconsistent summary as valid data.
This is an analysis of covariance: achievement is the response, aptitude is a quantitative covariate, and teaching method is a categorical explanatory variable. The usual normal linear model assumes independent errors with common variance .
read.table reads the data with a header row; attach makes its columns directly accessible, and the two printed vectors confirm their ordering. rep(1:3, each=7) supplies the three group labels, and factor makes them categorical. The contrast option selects treatment coding for unordered factors, with method A as the first-level reference. The polynomial option would apply to ordered factors and has no role here.
The formula using aptitude * Group includes both main effects and their interaction. Writing for the method indicators, its fitted mean has the form
Thus A, B and C have separate intercepts and slopes. There are six coefficients and residual statistical degrees of freedom. The analysis of variance table uses sequential sums of squares: adding aptitude to an intercept-only model removes from the residual sum of squares; subsequently adding the two group indicators removes ; adding the two slope interactions removes only . The remaining sum of squares is , giving mean square .
Each displayed F-test divides the added term's sum of squares by its statistical degrees of freedom and then by this full-model residual mean square. In particular the interaction test is
There is no evidence that the slopes differ, so the common-slope model is preferable among the fitted models. The small group -value concerns differences after including aptitude, whereas the first aptitude row is sequential and does not adjust for Group. It should not be interpreted as the covariate test after treatment adjustment.
The additive formula gives the parallel-lines model
It has four coefficients and residual statistical degrees of freedom. Removing the interaction raises the residual sum of squares to , but lowers the residual mean square to . The sequential aptitude and group sums of squares are unchanged. The adjusted group test is now on statistical degrees of freedom, with : after allowing for initial aptitude, the methods are not all equally effective.
summary(..., cor=F) displays the fitted coefficients, their standard errors, the individual statistics, and two-sided -values; it omits the coefficient-correlation matrix. The intercept is the fitted A mean at aptitude zero, which is outside the observed range and is mainly a parametrization device. The common slope predicts about extra achievement units per aptitude unit, holding method fixed. Its adjusted test is on statistical degrees of freedom, with about . The method coefficients are adjusted differences from A, not the B and C intercepts themselves. The three fitted lines are
The B-minus-A estimate is with standard error and ; the C-minus-A estimate is with standard error and . Both comparisons are strongly significant.
The B-minus-C comparison needs its own treatment contrast; its significance cannot be read off either comparison with A. Reconstructing the coefficient covariance from the design gives
Thus there is no detectable difference between B and C. This is consistent with pooling their effects in a further reduced model, but does not establish exact equality.
The residual standard error is . The five-number residual summary shows deviations on both sides of zero, with the largest magnitude about ; it does not by itself verify constant variance or normality. The coefficient of determination means about of the achievement variation about its overall mean is explained. The overall compares all three nonintercept coefficients with zero, on statistical degrees of freedom; its -value is . Printed coefficient -values rounded to 0.0000 are small, not literally zero.
The following original sketch shows the separate-slope model and the preferred parallel-line fit.
Figure 1.
Observed teaching scores and separate-slope versus common-slope fitted models
. Details.
At the same initial aptitude, B and C give higher predicted achievement than A, with no convincing difference between B and C. Interpreting this adjusted association as a causal teaching effect additionally relies on the experimental allocation and error assumptions.
Write . In this normal linear model, the ordinary least squares criterion is . Differentiating with respect to gives the normal equations for linear least squares, . Full column rank of the design matrix makes invertible, and completing the square proves that the unique minimum is
Since , its sampling distribution is the multivariate normal distribution
Let be the hat matrix. It is symmetric and idempotent with rank , and . The regression residual vector is , so
An orthogonal projection of a Gaussian vector onto the residual space gives . The residual projection and fitted projection have zero cross-covariance, hence are independent because they are jointly normal. In particular, is an unbiased estimator of and is independent of . The maximum-likelihood estimator of instead divides by and is not unbiased.
For the null hypothesis , put . Under that null hypothesis, is standard normal and independent of . Therefore the Student t-test uses
A two-sided level- test rejects when . The denominator is the estimated standard error of the regression coefficient.
The fitted linear regression includes an intercept and three covariates:
Thus , and the residual degrees of freedom are . The fitted conditional mean is
Each slope measures a conditional association with the response while the other two covariates are held fixed. Increasing wind speed by one mile per hour corresponds to a fitted decrease of in the concentration units used. Its standard error is , giving and a two-sided p-value of : evidence of a negative conditional association at the 5% level. The temperature slope is per degree Fahrenheit, with standard error , and p-value . The insolation slope is per langley per day, with standard error , and p-value . Neither of these last two conditional effects is significant at 5%; that does not establish that either true slope is zero. These are associations, not a demonstration of causal effects.
The intercept estimates the mean at zero values of all three covariates. Its value has a large standard error , giving and p-value . The zero-covariate combination may be outside the observed range, so this test may have little practical relevance. Every coefficient test uses a Student t-distribution with degrees of freedom.
The reported residual standard deviation measures unexplained variation in concentration units; the subsequent table gives , consistent with after rounding. The five-number residual summary describes the spread, from to , with median . An intercept forces the residual sum to zero, not the residual median. These five numbers alone cannot establish normal errors, constant variance or independence; residual-versus-fitted and quantile-quantile plots would be more informative, and successive days also warrant checking serial dependence. The coefficient of determination means that 65.33% of the sample response sum of squares about its mean is explained by this fit. Its adjusted version is
which accounts for the number of estimated regression coefficients.
The stepwise selection by the Akaike information criterion searches between the intercept-only model and the specified model with all three main effects. For these Gaussian fits, the printed Akaike information criterion is, up to a constant common to the candidates,
The full model has and AIC . Removing insolation increases the residual sum of squares by but decreases AIC to , so that removal is chosen. Removing temperature or wind instead would give AIC or and is worse. In the next step the candidate models include deletions and restoration of insolation. Keeping wind and temperature has the smallest AIC: removing temperature gives , restoring insolation gives , and removing wind gives . Hence the search stops, giving
The accompanying F-tests compare a larger model with a one-parameter reduction: , where is estimated from the larger model. For example, removing insolation gives , equal to the corresponding squared test statistic. Deletions from the second-stage model use in the denominator, whereas restoring insolation uses the full-model denominator. These tests describe the comparisons; they do not determine the AIC choice. In particular, temperature is retained despite its deletion-test p-value . AIC balances fit and complexity, and a stepwise optimum need not be a global optimum over a richer model class. Ordinary coefficient inference after choosing a model does not account for the selection itself.
For positive responses, the Box–Cox transformation is for , and . Its profile likelihood refits the linear regression and variance at each and includes the transformation Jacobian. The graph peaks at roughly –. The approximate 95% likelihood-ratio confidence interval contains values a little below zero through approximately one, using the cutoff . Thus a logarithmic transformation () and a square-root transformation () are plausible, while leaving the response on its original scale () is at or very near the upper confidence boundary. The broad profile supports considering a mild power transformation; it does not determine a sharply estimated power. The raster does not justify more precise endpoints or a decisive assertion about which side of the boundary lies.
Let be the flight distance in millimetres for paper level , launch-angle level , design level and replicate , where and . The full factorial design is fitted by the normal linear model
The assumptions are independent errors with a common variance and normal distribution, and the displayed factor-combination mean structure. The corner-point constraints are
and whenever at least one index equals . Thus the eight free mean coefficients are . These treatment coding coefficients are comparisons at the other factors' reference levels, rather than necessarily averaged main effects.
To test the three-factor interaction term, compare the full model with the model retaining all main effects and all two-factor interactions. The null hypothesis is , against a nonzero value. Removing it increases the residual sum of squares by and removes one parameter. With eight residual degrees of freedom, the nested-model F-test gives
There is no evidence that this three-factor interaction is needed. This does not establish that all two-factor interactions vanish: the paper-design interaction is substantial.
The stepAIC command performs stepwise selection by the Akaike information criterion. Its upper scope is the full factorial model and its lower scope is the intercept-only model. Starting from the full model, it compares admissible additions and deletions, preserving the hierarchy of interaction terms, and chooses changes that reduce the Akaike information criterion. With the supplied scope its default search permits both directions. For these Gaussian fits the displayed criterion, up to constants common to all models, is , where counts mean coefficients. The first deletion changes it from to : the small increase in residual sum of squares is outweighed by removing a parameter. This is a greedy model selection procedure, not an exhaustive search or a sequence of fixed-level hypothesis tests. The command's arguments are described in the MASS documentation.
For the selected model, let and . Then
independently between flights. It has no angle term. The maximum-likelihood estimates of its mean coefficients are also obtained by ordinary least squares:
For example, the four fitted means are just the four paper-design cell means, each averaging four flights over the angle levels. With , the variance-covariance matrix of the coefficient estimates is . Its diagonal gives the displayed standard errors; their ratios are , with mm.
The final line of summary(model2.lm) is the joint nested-model F-test of , comparing this four-parameter model with a common mean. Its statistic is
with F-distribution under the fixed-model null and P-value . Thus the selected paper-design terms jointly improve the fit substantially. The coefficient of determination means they account for about of the observed centred variation. These nominal inferential summaries do not adjust for the preceding model selection on the same data.
Using the unrounded fitted means gives
in millimetres. Hence choose the high-performance design with the lighter paper; the fitted model leaves both launch angles tied, with expected distance about mm. A preference for one angle is not supported by this selected model. The strong paper-design interaction reverses the design comparison: the simple design is better on heavy paper, whereas the high-performance design is better on light paper. Consequently a single design effect averaged over paper types would conceal the main result. There is little evidence here for an angle effect, and considerable flight-to-flight variability remains.
Before fitting, inspect raw-distance dot plots for all eight factor combinations, and interaction plots of cell means against design, with separate lines for paper and panels for angle. With only two replicates per cell, showing individual observations is more informative than elaborate box plots. These reveal reversals, spread and possible unusual flights. Afterwards inspect a residual-versus-fitted plot, a Q-Q plot of residuals, a scale-location plot, residuals against each factor and, if recorded, flight order, and Cook's distance for influential observations. Residual patterns by angle would question its deletion, while unequal spread or departures from the normal distribution would question the error assumptions rather than merely demand another mean term.
The additive model gives useful evidence for both predictors. To test for no adjusted sex effect, use against . The statistic has a Student t-distribution with 97 statistical degrees of freedom under the normal linear model and the null hypothesis. Here and . Similarly, against a nonzero common slope gives under the null hypothesis, with . Thus, at a fixed height males have a higher fitted mean weight, and within sex greater height is associated with greater weight.
The interaction model adds . Its female height slope is and its male height slope is . Test against using under the null hypothesis, or equivalently . The -value is 0.73139. The additive model is a reasonable parsimonious choice; the data give no evidence for different height slopes between sexes. This does not establish exact equality of population slopes. The additive model also has the higher adjusted coefficient of determination, 0.405 versus 0.3996, and a slightly smaller residual standard error.
Ignoring sex gives a height slope of 0.8769, appreciably above the adjusted slope 0.6211. This is omitted-variable bias in the descriptive regression: a taller group with a larger intercept makes the pooled height association steeper. Algebraically, with ,
The printed estimates imply a positive height-sex covariance. Pooled and adjusted slopes therefore describe different comparisons; the difference is not evidence that adding sex changed a physical effect of height. For predictions, retain both sex and height, check regression diagnostics, and assess performance on new students. The residual standard error near 5.7 remains substantial and the coefficient of determination near 0.42 does not promise precise individual prediction.
For the normal linear model, the log-likelihood is
The full column rank of the design matrix makes invertible. Differentiating in gives the normal equations . With the minimized residual sum of squares substituted, differentiation in gives
These are the maximum-likelihood estimators almost surely; almost surely when and . The linear transformation of the multivariate normal distribution yields
Define the hat matrix . The fitted values are , the regression residuals are , and . The orthogonal projection has rank and annihilates . By Cochran's theorem,
Consequently , with bias . The unbiased estimator is
Its square root, the reported residual standard error, estimates ; the assertion of unbiasedness applies to the variance, not generally to its square root.
For the paper-strength analysis, let be the measured percentage and . Both normal linear models use independent errors of common variance . Their mean functions are for lm1, and for lm2, with separately fitted coefficients. The reported residual standard errors are and , respectively.
For lm1, the estimated conditional expectation at a new percentage is
The original data mean must be used for centering the new percentage; its numerical value is not supplied in the excerpt. Because , the two columns of this design matrix are orthogonal, and . Hence the coefficient standard errors in the output give
This estimates uncertainty in the mean. Predicting an individual future batch would additionally require the new-error variance, estimated by .
To compare the nested normal linear models, test against within the quadratic model. The Student t-test statistic is
Its two-sided p-value is . Equivalently is a partial F-test statistic with null distribution . Reject the linear restriction and prefer lm2 at the 5% level. Its residual spread is much smaller; the increase in the coefficient of determination from to supports the same conclusion, although the test is the relevant complexity-adjusted comparison.
For regression diagnostics, inspect regression residuals against fitted means and hardwood percentage for omitted curvature, a scale-location plot for nonconstant variance, and a quantile-quantile plot against the normal distribution for departures from the error assumption. Check unusual observations using regression leverage and Cook's distance, and examine residuals in collection or batch order if dependence is plausible. Independence and a common variance require substantive justification as well as these plots; a small p-value for a polynomial term does not itself check the error model.
Let be speed and the tool type. Each fit is a normal linear model with independent errors. The three mean specifications are
The constraints are treatment coding with type 1 as reference. The parameter counts are , respectively. Model 2 gives parallel lines; model 3 allows interaction terms and distinct slopes.
In the analysis of variance interaction row, adding three independent slope differences costs three degrees of freedom. Its extra sum of squares is the reduction in residual sum of squares, . Its mean square is , and its F-test statistic is
Thus the four missing entries are , , , and , to the precision allowed by the rounded output. This tests against the alternative that at least one slope difference is nonzero. Under and the normal linear model assumptions, the statistic has distribution . Its p-value gives no reason to reject at 5%.
The simpler common-line model is inadequate compared with the parallel-line model. Testing against at least one nonzero type effect, while retaining speed, gives the partial F-test
Its p-value is far below , so reject the common-line restriction. This reduction differs from the sequential type sum of squares in the displayed table, because that table adds type before speed. Recommend model 2: different intercepts and a common decreasing slope.
The selected coefficient estimates give
The intercept estimates the expected lifetime of type 1 at speed zero; if zero speed is outside the data range, it is only an extrapolated intercept. Its standard error is , and its Student t-test ratio is , with two-sided p-value . At any fixed speed, type 2 differs from type 1 by hours, with standard error , and p-value , giving little evidence of a difference. Types 3 and 4 exceed type 1 by and hours, with standard errors and ; their test ratios and and p-values and support positive differences. Each of these individual coefficient tests has null value zero, alternative nonzero, and null distribution .
The speed coefficient means a reduction of hours per extra revolution per minute, or hours per additional 100 rpm, for every type. Its standard error is ; the ratio has null distribution when the common slope is zero, and two-sided p-value .
The residual standard error estimates the common noise standard deviation in hours using 15 residual degrees of freedom, since . The coefficient of determination means that about of the corrected lifetime variation is explained by this fit. The overall F-test statistic tests the simultaneous restriction against at least one nonzero coefficient; its null distribution is and its p-value rejects an intercept-only mean. These conclusions remain conditional on suitable regression diagnostics for independent, homoscedastic, approximately normal errors.
The required sketch plots the four fitted lines. Its speed interval is illustrative because the observed speeds are not supplied; the ordering and vertical gaps are determined by the fitted coefficients.
Figure 1.
Parallel fitted tool-lifetime lines for the four tool types
. Details.
The ordinary least squares objective has gradient . The normal equation therefore gives
The Gram matrix is a positive-definite matrix because has full column rank. More explicitly, for any ,
since . This proves that the displayed solution is the unique global minimum.
The fitted values are , where the hat matrix is
The inverse of the symmetric matrix is symmetric, so . Multiplication gives . Thus is the orthogonal projection onto the column space of the design matrix.
The regression residual vector is with . Consequently , , and the residual sum of squares is
By fitted-residual orthogonality, . Using , the cross-covariance matrix is
Both vectors are jointly normal, so they are also independent by independence of uncorrelated jointly normal variables. The zero covariance calculation itself only needs the common error variance and lack of error correlations.
For the first wind fit, let be wind velocity and electrical output. The simple linear regression is , with independent . It has two fitted mean parameters and residual degrees of freedom. The missing analysis of variance entries are therefore velocity degrees of freedom , velocity mean square , and residual degrees of freedom . The residual mean square is , and , consistent with the printed value after rounding.
Because the model includes a regression intercept, the coefficient of determination is the explained sum of squares divided by the total centered sum of squares:
A large coefficient of determination does not rule out a wrong mean function. In the PDF's first residual-versus-fitted plot, residuals are negative at both ends and positive in the middle. This curved pattern agrees with the visibly flattening output-versus-velocity relationship and motivates a polynomial regression with a quadratic term.
The second wind model is , again with independent common-variance normal errors. Its fitted mean is . The line marked (A) is a two-sided Student t-test of against , conditional on retaining the intercept and linear term. Under the null hypothesis,
Its two-sided p-value is . This is far below , so reject a purely linear mean in favour of the quadratic fit. Equivalently, the extra-term nested-model F-test has and null law .
The third fit is a reciprocal-predictor regression, , with estimated mean . It has two mean parameters rather than the quadratic model's three. Its residual standard error is smaller, versus , and its coefficient of determination is larger, versus . The corresponding residual sums of squares are approximately and . The reciprocal fit is preferable on both these fit measures and parsimony. The two models are not nested, so an ordinary extra-term F-test between them is inappropriate. On the common normal-error likelihood, the difference also favours the third model.
Neither lower residual sum of squares nor a higher coefficient of determination establishes adequate assumptions. The quadratic residual-versus-fitted plot removes the original pronounced curvature; the reciprocal plot also has no comparably obvious mean trend. The low-output residuals appear somewhat more spread out, so check scale-location plots and residuals against velocity for heteroscedasticity. Q-Q plots assess normality; residuals against observation order assess serial dependence; regression leverage and Cook's distance identify influential observations. Further cross-validation, replicate observations at comparable velocities, and prediction errors would help choose between their extrapolation behaviours. Both fitted shapes should be judged principally over the observed positive-velocity range.