Let be speed and the tool type. Each fit is a normal linear model with independent errors. The three mean specifications are
The constraints are treatment coding with type 1 as reference. The parameter counts are , respectively. Model 2 gives parallel lines; model 3 allows interaction terms and distinct slopes.
In the analysis of variance interaction row, adding three independent slope differences costs three degrees of freedom. Its extra sum of squares is the reduction in residual sum of squares, . Its mean square is , and its F-test statistic is
Thus the four missing entries are , , , and , to the precision allowed by the rounded output. This tests against the alternative that at least one slope difference is nonzero. Under and the normal linear model assumptions, the statistic has distribution . Its p-value gives no reason to reject at 5%.
The simpler common-line model is inadequate compared with the parallel-line model. Testing against at least one nonzero type effect, while retaining speed, gives the partial F-test
Its p-value is far below , so reject the common-line restriction. This reduction differs from the sequential type sum of squares in the displayed table, because that table adds type before speed. Recommend model 2: different intercepts and a common decreasing slope.
The selected coefficient estimates give
The intercept estimates the expected lifetime of type 1 at speed zero; if zero speed is outside the data range, it is only an extrapolated intercept. Its standard error is , and its Student t-test ratio is , with two-sided p-value . At any fixed speed, type 2 differs from type 1 by hours, with standard error , and p-value , giving little evidence of a difference. Types 3 and 4 exceed type 1 by and hours, with standard errors and ; their test ratios and and p-values and support positive differences. Each of these individual coefficient tests has null value zero, alternative nonzero, and null distribution .
The speed coefficient means a reduction of hours per extra revolution per minute, or hours per additional 100 rpm, for every type. Its standard error is ; the ratio has null distribution when the common slope is zero, and two-sided p-value .
The residual standard error estimates the common noise standard deviation in hours using 15 residual degrees of freedom, since . The coefficient of determination means that about of the corrected lifetime variation is explained by this fit. The overall F-test statistic tests the simultaneous restriction against at least one nonzero coefficient; its null distribution is and its p-value rejects an intercept-only mean. These conclusions remain conditional on suitable regression diagnostics for independent, homoscedastic, approximately normal errors.
The required sketch plots the four fitted lines. Its speed interval is illustrative because the observed speeds are not supplied; the ordering and vertical gaps are determined by the fitted coefficients.
Figure 1.
Parallel fitted tool-lifetime lines for the four tool types
.
Both fits use the same Gamma distribution mean model and inverse link function. Their coefficient estimates, fitted means and hence their weight matrices coincide: the common dispersion parameter only multiplies the likelihood score by a scalar and therefore does not change its zero. The displayed calls likewise show the same family and formula; fixing dispersion in a summary changes the uncertainty calculation, not these coefficient estimates.
For and , the Fisher information weights are
Thus the common matrix is multiplied by dispersion in the exponential case and by in the fitted gamma case. Taking square roots of the diagonal covariances gives
For instance for the intercept, and the same factor applies to all the coefficients. The standard errors are smaller because the fitted dispersion parameter is below one, not because a different mean function was fitted.
Let be recall for age level , processing level , and replicate . Write for Younger and for Older. With Older and A as the reference levels in a regression factor, the additive two-factor normal linear model under treatment coding is
where the errors are independent , with common positive variance. The design matrix is fixed; subjects supply independent observations; the specified conditional mean is correct; and the absence of an interaction term means the age difference is constant across processing levels. These are model assumptions, not consequences of random assignment. The treatment allocation supports independence between processing assignment and background characteristics, but age itself was not randomized.
An older subject in A has and , so the estimated mean is words. Its standard error is the intercept's . There are residual degrees of freedom, giving the 95% confidence interval for this mean:
This is a mean-response confidence interval, not a prediction interval for a new individual's recall; the latter also includes the new observation's error variance.
The second two-factor normal linear model adds age-by-processing interaction terms:
Its ten free mean parameters are equivalent to one mean for each of the ten cells. To compare the fits, the null hypothesis is . The full residual sum of squares is on degrees of freedom. Adding interaction reduces the additive model's residual sum of squares by , so the reduced value is . The nested-model F-test statistic is
Its p-value is . Reject additivity and retain the interaction model. The significant interaction means that a single age effect averaged over all processing methods does not adequately summarize the data.
The regression intercept is the older-A mean. The age coefficient is the younger-minus-older contrast specifically in A. The processing coefficients compare B, C, D and E with A specifically among older subjects. The interaction coefficients are differences between the age contrast in each of those methods and its value in A. Adding the relevant coefficients gives
Thus A, C and especially D favour younger subjects in their estimated means, whereas B and E have little estimated age difference. In the younger group, D has the largest estimated recall, followed by C and A; B and E are much lower. Among older subjects C is largest, D and A are intermediate, and B and E are lowest. Comparing these orders is a description of estimates, not a claim that every pairwise difference is significant.
Each coefficient's printed standard error estimates its uncertainty; its statistic divides the estimate by that error, and its two-sided p-value uses under the relevant zero-contrast null hypothesis. For example, the older B-versus-A and E-versus-A contrasts have and . The C-versus-A and D-versus-A older contrasts have and . The B interaction has , while the D interaction is borderline at and the other two individual interaction tests are not significant at . These individual tests do not override the joint interaction F-test, and multiple comparisons require care. A simple younger-versus-older contrast outside A combines coefficients and must use their estimated covariance, rather than adding their marginal errors.
The residual standard error estimates . The coefficient of determination is the fraction of centered sample recall variation explained by the ten-cell model. The overall with null law tests all nine non-intercept coefficients jointly against zero, giving extremely strong evidence that the cell means are not all equal. The sequential analysis of variance separates age, process, and their interaction; the balanced design makes the main-effect sums orthogonal, whereas the coefficient table uses the specified reference-level contrasts.
To assess pooling into three processing types, retain age-by-type interaction because the previous test rejects additivity. The reduced model has six cell means. Its null hypothesis says A and C have equal means within each age, and B and E have equal means within each age: four restrictions. Compare it with the ten-cell model using
In fact the supplied fitted cell means and equal cell sizes determine the increase without raw observations. Pooling two ten-person cells with means adds to the residual sum of squares. Here the four differences are , so
Therefore and . At , the data do not reject the three-type reduction, though the result is borderline and is not proof that the pooled means are identical. This factor-level pooling test keeps the previously supported interaction structure; reducing the categories and removing all interaction simultaneously would test a different set of restrictions.
Let be age in years, the male indicator and the indicator for the Messiah group. The fitted Cox proportional-hazards model is
with an unspecified common baseline hazard. Its coefficients were estimated by Cox partial likelihood, using the Breslow approximation for tied event times. There are participants, recorded completions and four censored observations.
A higher hazard function means a greater instantaneous chance of completion among those not yet completing, so it describes faster completion rather than greater mortality. Holding gender and group fixed, an extra year of age multiplies the completion hazard by , about a increase. The 95% confidence interval is and the Wald test has , so there is little evidence of an age association.
Holding age and group fixed, male participants have a hazard ratio relative to female participants, about a lower completion hazard. Its 95% confidence interval is and . Under the fitted model this corresponds to slower completion for males. It is not a ratio of mean or median completion times.
Holding age and gender fixed, participants assigned to Messiah have a hazard ratio relative to The Kingdom, with 95% confidence interval and . This is strong evidence of a group difference, with faster completion in the Messiah group under the fitted model. Random assignment supports interpreting a group contrast as an effect of the assigned condition, subject to the assumptions about follow-up and censoring; age and gender contrasts remain observational associations.
Each printed statistic is the coefficient divided by its standard error, using an asymptotic standard normal sampling distribution under a zero-coefficient null hypothesis. The hazard ratio is , and its confidence limits exponentiate the coefficient limits. Proportional hazards assumes these covariate-specific hazard multipliers stay constant over follow-up, together with the specified linear age effect and independent censoring conditional on covariates.
Multiple imputation by chained equations specifies one conditional distribution for each incomplete variable. In general, let be the incomplete variables, the fully observed predictors, and the parameters of a model . The notation means all variables except . The models should respect each variable's support and contain the terms needed by the planned analysis.
First choose suitable models and initialise only the missing entries with admissible provisional values. One sweep updates in turn. At update , fit its model to records whose is observed, using the latest filled-in predictors. Draw
The first draw represents parameter uncertainty through a Bayesian posterior; the second represents residual uncertainty through a posterior predictive distribution. Replace the missing entries with these draws, leaving every genuinely observed entry fixed. Repeat whole sweeps until the chain has settled, assessing traces, mixing and plausibility. Obtain completed datasets from independently initialised chains, or sufficiently separated draws after convergence. Both parameter and missing-value uncertainty must be propagated; repeated deterministic prediction is not multiple imputation.
Here use a logistic regression for conditional on , age and sex. For , use an appropriate discrete count model conditional on , age and sex, such as a suitably checked negative binomial regression, allowing enough flexibility for skewness and nonlinear effects. Include interactions or transformations needed by the analysis in the imputation models. If condom use is structurally undefined for a record, preserve that applicability rule rather than treating it as ordinary missing data.
Impute the eligible survey information before discarding records solely because the observed is absent. In each completed dataset select its own records and fit the requested logistic regression. This allows a record with missing to contribute to the target group in some imputations and not others. Models must respect any known eligibility restrictions; if eligibility was independently known, use that information.
For a scalar regression coefficient, let be its estimate and its estimated variance in completed dataset . Rubin's rules give
The standard error is . Use the corresponding multiple-imputation confidence interval, rather than treating one completed dataset as fully observed. For vector coefficients replace the squared differences by outer products and by the covariance matrix. This combines within-imputation and between-imputation uncertainty.
Three distinct benefits of a meta-analysis are greater precision, an explicit synthesis of the effect, and assessment of variation across studies.
Combining compatible independent estimates can reduce the standard error, improve statistical power and provide more informative confidence intervals than individual small trials. A prespecified pooled estimate summarises the direction and magnitude of the evidence quantitatively, instead of informally counting statistically significant results. Finally, between-study heterogeneity and subgroup comparisons can reveal whether effects vary with populations or interventions, helping assess generalisability. These benefits require comparable estimands and an appraisal of study validity; pooling cannot repair systematic within-study bias.
The event and nonevent cell counts are and . Thus the estimated odds ratio and log odds ratio are
For independent binomial groups, the delta method gives
Using the permitted normal approximation quantile of 2, the approximate 95% interval is
The observed odds of death are equal between groups. The confidence interval includes zero and allows appreciable effects in either direction; it does not demonstrate equivalence. Exponentiating gives an odds ratio interval approximately , so the data are compatible with roughly half to twice the death odds for the first treatment relative to the second. The tabulated standard error is rounded.
A fixed-effect meta-analysis assigns inverse-variance weights. Using the unrounded within-study variance from part (b), this trial has , so its percentage weight is
Using the printed rounded standard error of instead gives approximately ; the raw cell calculation yields the more precise answer.
For a random-effects meta-analysis, the corresponding weight and percentage weight are
With , its unnormalised weight is . The supplied sums of fixed-effect weights do not determine the denominator of the random-effects percentage; the individual are needed. Positive heterogeneity makes the weight distribution more even. Percentage weight measures the trial's contribution to a pooled mean with fixed weights; total influence can also involve re-estimation of heterogeneity.
For an independent subgroup contrast in meta-analysis, the difference of disjoint independent subgroup estimates has estimated variance equal to the sum of the two variances. The subgroup contrast and standard error are
The Wald test of equal subgroup mean log odds ratios therefore gives
Under the null, is approximately standard normal and has a chi-squared distribution with one degree of freedom. A quantile-2 confidence interval for the difference is . There is no statistically persuasive evidence of a subgroup difference. The result does not establish equal effects. Nor does a between-trial subgroup comparison, by itself, identify a causal advantage of one technique: other study characteristics may differ.
Use a common intercept and laboratory-specific slopes in the normal linear model. With denoting days and the indicator variables for laboratories B and C, the design matrix has row , and
The interaction terms change slopes, without introducing laboratory-specific intercepts. Thus the estimated daily growth rates are
in millimetres per day, with fitted common intercept mm. The residual degrees of freedom are . The usual unbiased error variance estimate is the square of the residual standard error:
The small difference from arises from rounding the standard error to two decimal places; the latter uses the more precise residual sum of squares supplied later. A maximum-likelihood estimate would instead divide that residual sum of squares by .
For a new independent tumour grown for ten days in B, use . Its fitted mean is
Write . The prediction interval in a normal linear model is
where and is the indicated Student's t-distribution quantile. The design information needed to evaluate is not supplied, so a fully numerical interval cannot be recovered from the coefficient standard errors alone: the coefficient covariances are also needed.
To prove coverage, write , with independent of the original sample. The error has a normal distribution with mean zero and variance . By the joint distribution of least-squares and variance estimators, and is independent of ; it is also independent of . Hence the pivotal quantity
Consequently , which is exactly the claimed prediction interval coverage. This is repeated-sampling coverage conditional on the design, assuming the model; it need not hold conditional on the particular observed training responses. The extra represents new-observation noise and must not be omitted as in a mean confidence interval.
Let be sunny days and latitude. The R linear-model formula expands to a normal linear model with both main effects and their interaction term:
The fitted conditional mean is
The residual standard error is , giving the usual variance estimate , and .
The estimated interaction term is tiny relative to its standard error: and the two-sided p-value is . A sensible initial simplification is to remove the interaction and refit an additive linear model, lm(energy ~ sunny + latitude). Both main effects are significant in the supplied fit, and should initially be retained. Do not simply copy their old coefficient estimates into the new fit: removing a design column generally changes all estimates. Centering predictors makes intercepts and main-effect interpretations more useful, but does not change the fitted surface. The Box–Cox transformation in part (d) suggests a further response-scale improvement; after changing the response scale, reassess the interaction and diagnostics.
The Pearson dispersion estimator is , well above the Poisson value one. A Quasi-Poisson regression retains the logarithmic mean model but uses
This is a quasi-likelihood specification; it does not by itself identify a count probability distribution. For a common , the quasi-score equation is the Poisson score divided by , so its roots and fitted means are unchanged. Thus
Coefficient standard errors are multiplied by . The altitude standard error becomes , giving the requested approximate normal confidence interval
It excludes zero, so retain altitude on this approximate 5% test. Its test statistic is about after allowing for overdispersion, rather than the Poisson value . Rescaling uncertainty cannot repair a systematically misspecified mean; the diagnostics in part (e) motivate reconsidering that mean as well.
Use the usual clinical trial sampling assumption that all patients' responses are independent, with fixed positive arm sizes and positive known variances. Marginal normal distributions alone would not specify the variance of a treatment contrast without this assumption. Put , , and . The sample mean contrast estimates and has standard error . Thus the one-sided Wald statistics are
Large positive values of these Wald test statistics provide evidence against the respective null hypotheses.
First, the absolute values in the printed limit are an error: the correct long-run variance of a stationary process is the signed sum of autocovariances. Directly,
so
Each coefficient tends to and has absolute value at most . Absolute summability and the dominated convergence theorem therefore give
The sum of absolute values is an upper bound, not the general limit. For a concrete counterexample to the printed assertion, take with unit-variance iid noise. Then , , and other covariances vanish. The absolute sum is , but , so .
For correlated data the central limit theorem can still hold under suitable strong mixing of a stationary process and moment conditions, but the limiting variance is the long-run variance of a stationary process, rather than the one-observation variance. When it is positive,
Positive serial dependence usually increases the standard error, while negative dependence can reduce it. The approximate effective sample size of a stationary sample is when that denominator is positive. A long-memory time series can require a different normalization or a different limit law. Absolute covariance summability alone does not prove a CLT: if with a common independent random scale taking values and with equal probabilities and iid with the standard normal distribution, the off-diagonal covariances are zero, yet has the nonnormal scale-mixture law . The example is not an ergodic stationary process. If the long-run variance of a stationary process is zero, the usual nondegenerate square-root- CLT is unavailable.
For the causal AR(1), and
The conditional distribution follows because the current innovation is independent of the past.
For a fixed known , condition on the observed and use the transitions . Their conditional maximum likelihood criterion is, up to constants,
Differentiating in yields
Since ,
Thus it is an unbiased estimator, even conditionally on , and
It has statistical consistency with mean-square convergence, and the iid-noise strong law of large numbers also gives almost-sure statistical consistency. Its conditional distribution is exactly normal with the displayed mean and variance. If is also observed and all transitions are used, replace by .
The fixed- qualification is necessary for the exact finite-sample claims. If is jointly estimated, conditional likelihood function is linear regression with an intercept: writing and , the unconstrained estimators are
This ratio is not generally an unbiased estimator and does not have the preceding finite-sample variance. Under the usual stationary regression conditions it has statistical consistency; its asymptotic variance is . Indeed, it differs from by , an asymptotically negligible endpoint term. Profiling an unknown innovation variance does not change the fixed- estimate of .