For centered square-integrable random variables , their finite-past innovations are the successive errors of best linear prediction from a finite past:
Here the inner product is in the Hilbert space of square-integrable random variables. By the defining property of orthogonal projection, is orthogonal to every earlier observation, hence to every earlier innovation. Recursively, each is plus a linear combination of earlier innovations. Thus
This equality remains true when some innovations vanish. Only the nonzero innovations form an orthogonal basis: if , then , and a formula dividing by is invalid. When all innovation variances are positive, the construction is the Gram-Schmidt process applied to the observations. Finite-past innovations depend on the starting time; unlike innovations from best linear prediction from an infinite past, they do not use observations before initialization. Additional stability assumptions are needed to assert that this initialization effect disappears.

Articles by others on the same topic (0)

There are currently no matching articles.