The best mean-square linear predictor is orthogonal projection onto the span of the available centered observations, plus the known mean. Orthogonal innovations give a convenient basis of that span. Prediction at a future horizon must use only actually observed variables; it need not be a one-step predictor.
For a causal autoregressive process with mean and innovations orthogonal to the observed past, define for and replace future innovations by zero. The displayed recursion is its best linear prediction from a finite past when at least the last observations are available. Future innovation sums are orthogonal to those observations, which proves the projection property. Mere white noise does not guarantee that a linear forecast equals a conditional mean: that stronger interpretation requires martingale-difference or independent innovations.
If the increments of have mean and centered increments satisfy a causal autoregressive process of order one with , sum their recursive forecasts to obtain the displayed expression. For fixed forecast origin, . One must observe the last increment, requiring or a known initial level ; a single observed level without an initial-level model does not identify that increment.
For centered square-integrable random variables , their finite-past innovations are the successive errors of best linear prediction from a finite past:
Here the inner product is in the Hilbert space of square-integrable random variables. By the defining property of orthogonal projection, is orthogonal to every earlier observation, hence to every earlier innovation. Recursively, each is plus a linear combination of earlier innovations. Thus
This equality remains true when some innovations vanish. Only the nonzero innovations form an orthogonal basis: if , then , and a formula dividing by is invalid. When all innovation variances are positive, the construction is the Gram-Schmidt process applied to the observations. Finite-past innovations depend on the starting time; unlike innovations from best linear prediction from an infinite past, they do not use observations before initialization. Additional stability assumptions are needed to assert that this initialization effect disappears.
In a centered MA(1) process, is uncorrelated with every observation through time . Its best linear predictor from that information is therefore zero, with error variance . One-step innovation formulas using cannot be substituted when that observation is unavailable.
Starting at time one, the orthogonal residuals satisfy , with and . Earlier innovation directions have zero covariance with the new observation. Explicitly, with , and for . These formulas follow by induction from , with and . This includes , where .
For an MA(1) process, the recursion has candidate limits and . The limit in is when and otherwise. The limiting innovation variance is , expressing the same covariance law through an invertible reciprocal representation.

Articles by others on the same topic (0)

There are currently no matching articles.