Gaussian process regression 2026-10-14
Gaussian process regression estimates an unknown function by assigning its values a Gaussian process law, then conditioning on observed values, often with independent Gaussian noise. The covariance function expresses the proposed relation between nearby inputs; the conditional multivariate normal distribution gives the resulting Gaussian process regression posterior. Its conditional mean provides a prediction and its conditional variance quantifies uncertainty under the chosen model. The index set can represent spatial locations or other inputs as well as time.
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 219 3 iii Solution Created 2026-10-03 Updated 2026-10-05
At the fitted hyperparameters, define , , and , with the matrices formed by pairwise kernel evaluations. Conditional independence of observation noise and future latent values givesThe residual has zero covariance with , so the joint normal law makes it independent of . This derives the conditional multivariate normal distribution and the Gaussian process regression posterior:The covariance is a Schur complement and is positive semidefinite. When nonsingular, its joint density is . Repeated phases can make it singular, in which case the displayed normal law is interpreted on its support.
This predicts the true latent light curve, so no future measurement variance is added. For noisy future observations, add their independent noise covariance to . Fixing the hyperparameters omits their estimation uncertainty, as requested; integrating over their posterior would add it. The periodic model extrapolates by phase, even though all prediction times follow the observed times.
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 219 3 b Solution 2026-10-03
At the fitted parameters, let and . For prediction times defineThe microlensing processes and measurement errors contribute no cross-covariance with the latent quasar light curve. The Gaussian process regression posterior is thereforeThe requested pointwise posterior variances are the diagonal entries of the latter matrix.
Past exam of the mathematics course of the University of Cambridge 2022 iii Paper 219 2 a Solution 2026-09-28
The vector is Jointly Gaussian. Assuming , Gaussian conditional independence givesThus the required condition is . Under it, conditioning on supplies no further information after , and the Gaussian process regression posterior isBoth the conditional expectation and conditional variance depend only on ; neither contains or .
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 207 3 a Solution Created 2026-09-24 Updated 2026-09-25
Let have entries , let have entries , and let . The Gaussian process prior and independent Gaussian noise implyApplying the conditional multivariate normal distribution gives the Gaussian process regression posteriorwhere
Past exam of the mathematics course of the University of Cambridge 2024 iii Paper 207 3 b Solution Created 2026-09-24 Updated 2026-09-25
Set in the Gaussian process regression posterior and compute and as in part a. Standardization of a normal random variable then giveswhere is the standard normal cumulative distribution function.