Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 201 4 c Solution Created 2026-10-03 Updated 2026-10-05
The Gaussian process assumption and the covariance formula give a centered Gaussian increment with varianceFor every finite , a standard normal variable therefore givesFor any , choose . Then , so parts (a) and (b) give a Hölder continuous function of exponent as an extension. To obtain one extension with every required exponent, take a countable sequence and apply the construction with suitable . Intersect the probability-one events. Their continuous extensions agree on the dense set and hence agree everywhere. For each smaller exponent choose with ; since , the bound with also implies the bound with . ThusThe exponent constants may depend on and the sample path. This proves Brownian Hölder regularity for the continuous Gaussian extension without making an uncountable intersection of unrelated full-probability events.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 1 c Solution Created 2026-10-03 Updated 2026-10-05
The negative binomial regression assumes independent random variables conditional on their recorded days, withThe logarithmic link function applies to the conditional expectation, not to the observed count. The displayed maximum-likelihood estimates areand the dispersion parameter for the fitted family is one. Thus the fitted variance is , practically the Poisson distribution variance at these means.
Increasing the day by one multiplies the conditional expectation by , a decrease of about . Comparing days 365 and 1 gives . The negative slope has Wald statistic approximately , so under the stated model assumptions there is very strong evidence of a decreasing conditional mean:This is an association with calendar day, not a causal effect established by the regression. The printed negative-binomial residual deviance is on residual degrees of freedom, which is a reason to investigate the adequacy of the assumed count model and dependence structure. In particular, the small reported slope standard error cannot make a misspecified model reliable.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 3 b Solution Created 2026-10-03 Updated 2026-10-05
Choose knots independently of the eventual validation responses, and let be a natural cubic spline basis as in part (a). A regression spline writes . Define the design matrix . Under the stated normal linear model, maximum likelihood estimation for is the same as ordinary least squares:Differentiation gives the normal equations . If the design has full column rank,If it does not, a Moore-Penrose inverse gives the fitted values, but not every coefficient or off-sample prediction is identifiable. Merely choosing distinct knots does not guarantee full rank for an arbitrary set of observed predictor values.
More knots allow greater curvature and reduce approximation bias at the cost of larger estimation variance. Too many or poorly located knots can cause unstable fits. Equally spaced knots are simple; empirical predictor quantiles put more flexibility where observations are dense; subject knowledge can concentrate knots near likely changes. Both the number and positions can be compared using cross-validation or an appropriate penalized model-selection criterion. Adaptive knot selection must be included within validation, since treating a data-selected basis as prespecified understates its flexibility. Boundary knots should cover the region where inference is intended, and natural linear tails do not by themselves justify far-out extrapolation.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 3 e Solution Created 2026-10-03 Updated 2026-10-05
There is a genuine syntax error in the printed command: With the default Gaussian family, this generalized additive mixed model isHere across doctors, is an estimated covariance matrix, and the Gaussian errors have variance and are independent of the random effects. The formula
random=list(...) must be a separate argument, following a comma rather than a plus. The intended call ismodel2 <- gamm(npres ~ s(age, bs="cr") + s(wbc, bs="cr"), random=list(doctor=~age))~age includes a random intercept as well as a random slope; it does not force these two effects to be uncorrelated.The random intercept allows different prescribing baselines, and the random slope allows doctor-specific linear modifications to the population age curve. Conditional on these effects the observations are independent under the model, whereas two patients of the same doctor have additional covariance . This accounts for clustered data and avoids treating doctor variation as independent patient-level noise. The population smooth and doctor-specific predictions are different targets. With only four doctors, estimates of the random-effect covariance can be imprecise; the Gaussian support issue for counts also remains. The new model accounts for doctor-specific baselines and age slopes.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 4 a Solution Created 2026-10-03 Updated 2026-10-05
The random-slope linear mixed model iswith independence between the random effects and errors. The estimates areIncubators are treated as exchangeable representatives of possible growth environments, so a random slope permits their growth rates to differ while estimating a population mean growth rate. The formula
0+hours deliberately removes a random intercept: larvae are assigned only after hatching, so it is reasonable to assume no incubator-specific baseline at time zero. Random assignment supports this common-baseline assumption in expectation; it does not prove that observed initial sizes or other baseline differences are exactly identical.For a new incubator, no observations are available to estimate its realized random slope, and its mean effect is zero. Under squared-error loss the best prediction integrates over that effect and the residual error:This is the plug-in conditional expectation given the population parameters, rather than a prediction using a fitted effect from one of the four existing incubators. Ignoring parameter-estimation uncertainty, the prediction variance for a new individual is ; it is not just the uncertainty in the population mean.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 4 b Solution Created 2026-10-03 Updated 2026-10-05
Let have columns , and let have one column per incubator, with entry in the column for observation 's incubator and zeros elsewhere. Integrating the Gaussian random effects givesConsequently its marginal log-likelihood isThe likelihood-ratio test of against usesFor each covariance, the optimizing coefficients are the generalized least squares estimator . Both fits should use the same marginal likelihood convention, for example fitting the alternative with
update(fly.model, REML=FALSE) and the null as a Gaussian linear model. The displayed alternative REML criterion alone cannot supply .The variance component is constrained to be nonnegative, and zero lies on the boundary. Thus the interior-parameter hypothesis of Wilks theorem fails; the usual approximation is inappropriate. A limit sometimes applies to a single variance component under additional asymptotic conditions, but four incubators do not give a persuasive large-number-of-groups approximation.
Use a parametric bootstrap under the null: estimate there; simulate independent Gaussian errors with that fitted variance at exactly the observed times and grouping labels; refit both models by maximum likelihood for each simulated sample; and calculate . The upper-tail proportion, conventionally , estimates the p-value. Boundary fits with estimated must remain in the simulation distribution. A restricted-likelihood ratio and a correspondingly calibrated bootstrap are another option when the fixed-effect design is identical, but one must not mix ordinary and restricted likelihoods in a single statistic.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 4 d Solution Created 2026-10-03 Updated 2026-10-05
Add a location-specific random intercept to the random-slope linear mixed model:Take the location effects, incubator slopes and individual errors to be mutually independent, with the original variances and . The random intercept models variation already present at hatching because of the origin of the eggs. Because larvae are subsequently assigned to incubators, location and incubator are crossed random effects, not automatically nested groups. The corresponding code isThe resulting covariance between two observations contains if they share a location and if they share an incubator. If the three named locations themselves are the only populations of interest, use a fixed location factor instead:Choosing between these interpretations depends on the inferential target; with only three locations, a location variance component will be weakly estimated.
fly.model.loc <- lmer(size ~ hours + (0+hours|incubator) + (1|location))fly.model.loc.fixed <- lmer(size ~ hours + location + (0+hours|incubator)) Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 5 a Solution Created 2026-10-03 Updated 2026-10-05
For a weakly stationary process, every observation has the same finite expectation . Linearity of expectation, without any assumption of independence, givesThe variance is a sum of all pairwise covariances:For a real-valued weakly stationary process, the autocovariance is even. There are pairs at lag zero and pairs in each direction at positive lag . ThereforePositive autocovariances inflate the uncertainty relative to the independent-observation formula; negative terms may reduce it. An unbiased estimator need not have variance tending to zero: a process consisting of the same random variable at every time is weakly stationary, but averaging cannot reduce its variance.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 5 c Solution Created 2026-10-03 Updated 2026-10-05
A zero-mean autoregressive process of order one satisfieswhere is white noise with variance . A causal time series uses present and past innovations only. For the serieshas mean-square convergence because , and it supplies the causal weakly stationary process. Its variance is . For , only the common innovations contribute to the autocovariance:Evenness then givesWhen , the signs alternate; when , the process is white noise. With nondegenerate innovations, does not give a causal finite-variance stationary solution. These covariance calculations need uncorrelated innovations, not Gaussianity; Gaussian innovations additionally yield a Gaussian process.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 6 a Solution Created 2026-10-03 Updated 2026-10-05
There is a literal domain error in the printed formula. A semivariogram indexed by a signed displacement must satisfy , since reversing the two observations leaves the squared increment unchanged. For positive or , the displayed positive-lag value is nonzero whereas the displayed negative-lag value is zero. Thus the claim on all of is false as written.
Interpret the argument as a nonnegative distance, or use the even extension of the Gaussian semivariogram. For and , the intended model isIt admits the covariogramThe Gaussian kernel is a positive-definite kernel, as can be seen from the Fourier transform of a Gaussian: in one dimensionand the nonnegative spectral density makes every finite covariance quadratic form nonnegative. In higher dimensions use the product Gaussian density. Adding independent Gaussian white noise of variance adds the diagonal nugget covariance. Thus a zero-mean stationary Gaussian random field exists with this covariance, and gives the corrected semivariogram.
For nonzero structured variance, the nugget effect is the right limit at zero, the sill of a semivariogram is , and the range of a semivariogram is infinite if defined as the distance at which the sill is exactly reached. A 95-percent practical range solves :The scale is sometimes called the range parameter; it is neither the exact range nor the 95-percent practical range. If , there is no nontrivial structured range.
The fact that a semivariogram does not determine stationarity is a further distinction: a semivariogram specifies increment variation, not a unique process or absolute covariance. Adding an independent random constant adds a constant to without changing . More strongly, subtracting from a stationary field preserves its semivariogram but generally makes its variance depend on . The corrected statement is that this semivariogram admits a second-order stationary model, with the displayed covariance using the usual convention at large distance; it does not force every compatible process to be stationary.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 206 6 b Solution 2026-10-05
Write , let , let , and put . Assume the covariance matrix is invertible. Because the mean is known to be zero, every linear predictor is unbiased. Its mean squared prediction error isCompleting the square yieldsThe positive-definite matrix property makes the last term nonnegative, proving the simple kriging formulasThe residual is uncorrelated with . Since the joint law is multivariate normal, it is independent of , so the same predictor and variance describe the conditional distribution. Consequently a 95-percent prediction interval isThere is no constraint that the weights sum to one: that is required for an unknown constant mean in ordinary kriging, not for the stated known-zero-mean problem. If is singular, use a Moore-Penrose inverse with the corresponding covariance compatibility condition. At an already observed location prediction of that very same field value has zero error; predicting an independent noisy replicate is a different target. Estimated covariance parameters make this a plug-in interval and generally add uncertainty that the formula does not include.