The statistician first models the age- and gender-dependent mean by linear regression. Its fitted value is . At fixed gender, a year of age is associated with a decrease of BMI units; the group coded gender has a fitted mean units above the group coded at the same age. This question does not state which gender receives which code. The intercept refers to age zero in the reference group, outside a typical adult-patient range, so its substantive interpretation is limited. Both slope Student t-tests have small p-values, and the overall F-test supports an age/gender-dependent mean. The coefficient of determination is only , leaving considerable individual variation to investigate.
The residual diagnostics check whether mean adjustment is plausible and whether a single normal error law is adequate. The residual-versus-fitted plot has no strong curved mean trend, although its smooth curve is not perfectly flat. The scale-location plot suggests some decline in spread as fitted BMI increases, so common residual variance is a working approximation rather than an established fact. The normal Q-Q plot has systematic departures, notably shorter tails than the normal reference, suggesting the residual law is not exactly normal. The regression leverage plot does not display an obviously extreme leverage point, but the marked observations and Cook's distance should still be checked for influence. Independence between patients cannot be diagnosed from these four plots alone.
Next the statistician extracts the regression residuals and fits an intercept-only normal model as a baseline residual distribution. With an intercept in the original ordinary least squares model, the residuals sum to zero by the normal equation; the near-zero fitted residual mean and its are therefore automatic, not new evidence of good fit. The standard error in this refit uses degrees of freedom, whereas the original uses after estimating three regression coefficients. The reported log-likelihood for the single-normal residual model is .
The histogram suggests a shape worth exploring beyond one normal density, with broad shoulders and some asymmetry, without showing unambiguous separated clusters. The statistician fits two- and three-component finite Gaussian mixtures with a common variance by the expectation-maximization algorithm, starting from separated means and positive weights. Successive likelihoods increase and the displayed final iterations stabilize, as expected from EM likelihood monotonicity. This is evidence of numerical convergence from those starts, not proof of a global maximum.
The two-component fit assigns weights , residual means and common variance . The three-component fit assigns weights , residual means and common variance . The code correctly passes the square roots of those variances to dnorm and overlays the resulting weighted densities. Both curves broadly follow the histogram and are very similar. In particular, a two-component mixture need not have two distinct visible modes.
These fits explore residual mixture clustering: groups differ in BMI relative to the same age/gender-adjusted mean, rather than simply in raw BMI. Membership can be summarized by the fitted mixture responsibilities, retaining uncertainty instead of asserting a certain label for each patient. The common-variance assumption is economical, but should be checked; the common regression slope assumption and constancy of mixture proportions across age and gender are also substantive. A residual mixture alone does not establish genuine biological subpopulations; a flexible continuous distribution, missing predictors, nonlinear mean effects or heteroscedasticity could explain a similar marginal shape.
There is also a two-stage residual mixture fitting limitation. Fitted regression residuals are not exactly independent identically distributed observations: even under a normal regression, their covariance matrix is , and estimating the mean adjustment introduces uncertainty. With subjects and three initial regression coefficients, treating them as independent is a useful approximation for exploring shape, but ordinary mixture likelihoods omit the first-stage uncertainty. A joint mixture regression with shared slopes, or a suitable bootstrap of the whole analysis, would give a firmer basis for parameter uncertainty and cluster selection. Examine component membership versus age/gender and repeat the algorithm from multiple starts before making substantive clustering claims.
First, the absolute values in the printed limit are an error: the correct long-run variance of a stationary process is the signed sum of autocovariances. Directly,
so
Each coefficient tends to and has absolute value at most . Absolute summability and the dominated convergence theorem therefore give
The sum of absolute values is an upper bound, not the general limit. For a concrete counterexample to the printed assertion, take with unit-variance iid noise. Then , , and other covariances vanish. The absolute sum is , but , so .
For correlated data the central limit theorem can still hold under suitable strong mixing of a stationary process and moment conditions, but the limiting variance is the long-run variance of a stationary process, rather than the one-observation variance. When it is positive,
Positive serial dependence usually increases the standard error, while negative dependence can reduce it. The approximate effective sample size of a stationary sample is when that denominator is positive. A long-memory time series can require a different normalization or a different limit law. Absolute covariance summability alone does not prove a CLT: if with a common independent random scale taking values and with equal probabilities and iid with the standard normal distribution, the off-diagonal covariances are zero, yet has the nonnormal scale-mixture law . The example is not an ergodic stationary process. If the long-run variance of a stationary process is zero, the usual nondegenerate square-root- CLT is unavailable.
For the causal AR(1), and
The conditional distribution follows because the current innovation is independent of the past.
For a fixed known , condition on the observed and use the transitions . Their conditional maximum likelihood criterion is, up to constants,
Differentiating in yields
Since ,
Thus it is an unbiased estimator, even conditionally on , and
It has statistical consistency with mean-square convergence, and the iid-noise strong law of large numbers also gives almost-sure statistical consistency. Its conditional distribution is exactly normal with the displayed mean and variance. If is also observed and all transitions are used, replace by .
The fixed- qualification is necessary for the exact finite-sample claims. If is jointly estimated, conditional likelihood function is linear regression with an intercept: writing and , the unconstrained estimators are
This ratio is not generally an unbiased estimator and does not have the preceding finite-sample variance. Under the usual stationary regression conditions it has statistical consistency; its asymptotic variance is . Indeed, it differs from by , an asymptotically negligible endpoint term. Profiling an unknown innovation variance does not change the fixed- estimate of .
The comparison is a nested-model F-test of the three time-by-diet interaction coefficients, with null hypothesis that all are zero. The reduced linear regression model has a common time slope and four diet-specific intercepts; the full model permits four slopes. It has eight fitted coefficients and residual degrees of freedom.
The rounded sums of squares give the displayed approximation; the software reports using unrounded values. The quoted p-value gives overwhelming evidence against equal log-weight growth slopes across diets under the normal linear model assumptions. Thus reject the common-slope hypothesis. Because repeated measurements on the same chicken may be correlated, the exact reference distribution requires independent, homoscedastic Gaussian errors; the displayed ordinary regression output by itself does not establish that assumption.
Ignoring the bounded second-order remainder, this is the linear regression model
The ordinary least squares estimate through the known zero intercept is
because . This is the randomized symmetric finite-difference derivative estimator.
Every move can be drawn from a full conditional distribution, producing a Gibbs sampler with acceptance probability one. Write and . First update independently
and then
Let have rows and . Update the linear regression coefficients jointly by
and update
Finally, the flat positive variance priors give the following full conditionals, each an inverse-gamma distribution:
A systematic sweep in the displayed order, using the newly sampled values immediately, defines the chain. The shapes are positive for ; full column rank of is also required.
For participants with the same recorded history, the first linear regression estimates that one additional average mile cycled per week is associated with fewer asthma episodes. The corresponding -value is , giving evidence against a zero conditional association.
The second model estimates that, among participants with the same history, receiving the incentive is associated with more episodes. The third estimates that receiving the incentive is associated with more miles cycled per week. Both incentive coefficients have very small p-values. Because the incentive was assigned in a randomized controlled trial, these last two comparisons estimate a causal effect of the incentive.
Under , the slope in this through-origin linear regression is . Its observed Wald statistic is
The corresponding two-sided p-value is about , so the fit does not give evidence against at the significance level.
The usual least-squares standard error assumes constant conditional variance. Goal counts are counts, and under the natural Poisson distribution model their variance equals their mean , so observations with different expected goals are heteroscedastic. The reported homoscedastic standard error is therefore doubtful; a heteroscedasticity-robust calculation or a suitable count model would be more credible.
Polynomial regression 2026-10-06
A linear regression in the coefficients with a polynomial mean function . Successive degrees define nested models that can be compared by an F-test.
A treatment consequence is not interchangeable with a baseline covariate in an intention-to-treat analysis. Let randomized be independent of , and let actual intervention use be , with and independent centered errors. The assignment changes the mean outcome by one. But the conditional expectation has coefficient zero on . Thus adjustment for the post-randomization variable changes the estimand even in a simple identified linear regression.
Predictor centering 2026-10-07
Replacing a numerical predictor by preserves the fitted mean space and slope in a linear regression containing an intercept. The intercept becomes the fitted mean at . In simple linear regression, centering at the sample mean makes intercept and slope estimates uncorrelated under a normal linear model. This changes coefficient interpretation, not predictions.
A reciprocal-predictor linear regression uses for nonzero predictor . It remains linear in its coefficients. Its flattening shape can suit a saturating response over a positive predictor range; residual checks and cross-validation must assess adequacy, and extrapolation toward zero is hazardous.
Regression coefficient Created 2026-09-24 Updated 2026-09-24
A regression coefficient is a component of measuring the change in the linear predictor associated with its design-matrix column.
Regression model 2026-10-07
A regression model specifies features of the conditional distribution of a response given predictor covariates, often a conditional mean or a full parametric density. Linear regression specifies a linear conditional mean; logistic regression specifies a logit-linear conditional probability for a binary response. The conditional comparison represented by a coefficient depends on which covariates are included.
For a correctly specified full-rank fixed-design Gaussian linear regression with , dividing the residual sum of squares by the residual degrees of freedom gives an unbiased estimator of the noise variance. The projection removes the whole deterministic mean, so the numerator's expectation is . A misspecified subset model need not have this property.