Best linear unbiased prediction 2026-10-06
With known covariance parameters, best linear unbiased prediction minimizes prediction-error variance over linear predictors that are unbiased over both observation errors and random effects, for every fixed-effect value. In a Gaussian linear mixed model, the random-effect predictor is , where generalized least squares estimates the fixed effects. Plugging in covariance estimates gives an empirical predictor; its uncertainty must also account for estimating those covariance parameters. It differs from a best linear unbiased estimator of an unknown fixed coefficient.
Conditional mode of Gaussian random effects 2026-10-06
In a Gaussian linear mixed model with , the conditional multivariate normal distribution of given has mean and covariance matrix . When nonsingular, its mean is also its mode. Estimated parameters yield empirical conditional modes and shrink group deviations toward zero. At a zero variance component the associated effect is degenerate at zero; the covariance formula still applies, whereas formulas involving require limits.
For , this error correlation decreases exponentially with elapsed time and permits irregular observation times. It is the stationary correlation of an Ornstein-Uhlenbeck process. Within a Gaussian linear mixed model, apply it to the errors conditional on random effects; the marginal correlation also includes those effects.
nlme::corCAR1 parametrizes the same correlation by and permits separate grouped time series. Fixed effect 2026-10-06
A fixed effect represents an unknown nonrandom coefficient in the specified mean model. In a Gaussian linear mixed model, is the population mean, while random effects are latent draws from a distribution whose parameters are estimated. Treating a group coefficient as fixed or random concerns the modelling and inferential target, not whether its estimate changes across samples.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 206 6 a Solution Created 2026-10-03 Updated 2026-10-06
Write for stirring rate of observation in furnace . The independent random-intercept and random-slope model isErrors and random effects are independent. The separate R terms
(1 | furnace) and (0 + stir | furnace) impose independent random intercepts and random slopes; (1 + stir | furnace) would instead estimate their covariance as well. The estimates areThe corresponding estimated standard deviations are , , and ; they are not additional parameters.For a furnace with predictor vector , the marginal formulation, obtained by integrating the Gaussian random effects, isindependently across furnaces. In particular,In stacked notation , , giving the Gaussian linear mixed model marginal law with .
The residual-versus-fitted plot on page 17 has residuals of both signs over the fitted range, with no convincing smooth curvature or clear fan shape. Its quantile-quantile plot is roughly straight in the central region, with some tail departures and a few large negative residuals. There is no decisive visible violation, but investigate those observations. These plots mainly address conditional observation errors; they do not validate the distribution of furnace random effects or independence within furnaces. With only three furnaces, normality and the variance of the random effects are especially difficult to assess.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 206 6 b Solution Created 2026-10-03 Updated 2026-10-06
For the Gaussian linear mixed model, temporarily regard as known, with here and . The joint multivariate normal distribution isBy the conditional multivariate normal distribution formula,A nonsingular Gaussian density has its mode at its mean. Thus the conditional mode of Gaussian random effects equals the conditional expectation. Replacing the unknown parameters by fitted values givesFor positive-definite and , an equivalent derivation minimizes the negative conditional log density,Differentiation yieldsThe inverse-covariance penalty shrinks furnace intercepts and slopes toward the population effects. For furnace , set and ; the same formula provides its two-component conditional mode from that furnace's observations, conditional on the fitted common parameters. If a variance component is zero, the covariance form remains meaningful and its corresponding random effect is zero, whereas the formula with needs a limiting interpretation. With known covariance parameters these are best linear unbiased predictors; plug-in variance estimates give their empirical version.
Variance component 2026-10-06
A variance component is a nonnegative parameter multiplying a specified covariance contribution. In a Gaussian linear mixed model with independent standardized group effects, describes the covariance induced by one set of random effects. Testing whether a component is zero is a variance-component likelihood-ratio test at a boundary; ordinary regular chi-squared likelihood-ratio calibration need not apply.