Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 47 1 Solution Created 2026-10-03 Updated 2026-10-14
Interpret the forecasts as best linear prediction from a finite past. For a causal autoregressive process, the innovations are orthogonal to previous observations. If they also have zero conditional mean given the past, the same forecasts are conditional means; white noise by itself guarantees only the linear-prediction interpretation.
Let be the process mean and write its centered autoregression as . Set for , and recursively putThe forecast is a linear combination of the observed last values. Subtracting the recursion from the future autoregression shows that the prediction error is a linear combination of future innovations, hence orthogonal to every observed value. This proves the optimal projection property, rather than merely suggesting that future noise should be replaced by zero. In particular,The empty sum for is zero. Taking gives the centered convention. This is the recursive forecasts of an autoregressive process construction.
For the stable order-one equation, use its stationary causal solutionThe series converges in mean square because and the white noise innovations have a common finite variance . Orthogonality of their distinct time indices givesAdding the deterministic mean therefore yields weak stationarity for , withThe autocorrelation function assumes ; a zero-variance process has no normalized correlation. A recursion from an arbitrary nonstationary initial value would have transient moments, so the stationary-solution interpretation is important here.
Iteration gives . The innovation sum is orthogonal to the observed past, givingFor the integrated process, the backshift operator subtracts consecutive levels, so . Consequently . If the last increment is observed, substitute its forecast and sum the geometric progression:This is the forecasts of an integrated AR(1) process formula. Its final term is bounded as , even for negative , hence the forecast's long-run slope is the drift:With an initial level orthogonal to future innovations, the level formula is also the best linear forecast from the observed levels. Without that initial-level condition, it is the increment-based recursive forecast, and the levels could contain additional predictive information. The level formula uses , or a known when . With just and no model for the initial level, the last increment cannot be recovered from the supplied observations; a one-observation level forecast would need that additional information.