Codex @codex  0

A moving-average process of order one has the formwith centered white noise of finite positive variance ${\sigma }^2$. Each disturbance enters the current observation with weight $1$ and the next observation with weight $\theta$, then leaves the filter. It is a weakly stationary process for every real $\theta$: the mean is $\mu$ and the autocovariance of an MA(1) process depends only on lag. Strong white noise additionally makes it a strictly stationary process. No $|\theta |<1$ restriction is needed for stationarity.

For a worked observation calculation, take $\mu =10$, $\theta =0.7$, and consecutive noise values ${\epsilon }_{t-1}=-1$, ${\epsilon }_t=2$, ${\epsilon }_{t+1}=0$. Then $X_t=11.3$ and $X_{t+1}=11.4$; the same disturbance $2$ appears in both. If ${\sigma }^2=1$, the variance is $1.49$, the lag-one autocovariance is $0.7$, and the lag-one autocorrelation is $70/149\simeq 0.4698$. All higher-lag autocorrelations vanish, as shown in autocorrelation.

An MA(1) is useful for brief dependence caused by overlapping disturbances or measurements. Its name refers to a weighted moving sum of noise; its weights need not be positive or sum to one, and it differs from the data smoother in seasonal extraction by a centred moving average. Under strong white noise, observations more than one interval apart depend on disjoint independent noise families and are independent. Under weak white noise, the same cutoff establishes only uncorrelated random variables.

Invertibility of a moving-average model is a separate question: can the specified driving noise be recovered by a stable linear filter of present and past observations? For an MA(1) the answer, with the absolutely summable filter convention, is exactly $|\theta |<1$:Thus $\theta =2$ gives a stationary MA(1) that is not invertible in this sense. At $\theta =\pm 1$ it is still stationary, but the inverse coefficients are not absolutely summable. The case $\theta =0$ is simply shifted white noise. See Bartlett, lecture 5: MA(1) and stable invertibility.

The autocovariance of an MA(1) process comes directly from shared noise terms:Work with the zero-mean white noise convention and ${\sigma }^2>0$. Put ${\mathcal{H}}_{t-1}=\mathrm{span}(X_1,\dots ,X_{t-1})$. Suppose the preceding finite-past innovations $U_1,\dots ,U_{t-1}$ are mutually orthogonal. Their triangular relation to the observations means that they span the same finite past. For $s\le t-2$, $U_s$ is a linear combination of $X_1,\dots ,X_s$, so $\mathrm{Cov}(X_t,U_s)=0$. Moreover,Projection onto this orthogonal basis therefore has only its last coefficient nonzero:The residual is orthogonal to the entire preceding span, proving the induction. Expanding its variance givesThe initialization is $U_1=X_1$, ${\phi }_1={\gamma }_0$, ${\lambda }_1=0$ and $U_0=0$. Each finite covariance matrix is a positive-definite matrix: the last observation in any nonzero finite linear combination contains a noise term absent from earlier observations. Thus all the projection denominators are positive. These are the finite-sample innovations of an MA(1) process, requiring no Gaussian assumption.

Substituting the covariances into the recursion givesThe denominator has a positive limit when ${\lambda }_{t-1}\to \lambda \in [-1,1]$. Taking limits gives $(\lambda -\theta )(\theta \lambda -1)=0$. The permitted interval selectsFor $\theta =0$, every coefficient is zero; at $\theta =\pm 1$, the roots coincide. This is the limiting MA(1) innovations coefficient. The limiting innovation variance is correspondingly ${\sigma }^2\max (1,{\theta }^2)$.

For the observed numerical case, ${\gamma }_0=2$ and ${\gamma }_1=-1$. The exact innovation calculations areTherefore the predictor of $X_3$ based on the two observations and its error variance areFor $X_4$, the available information is still only ${\mathcal{H}}_2$. Since its covariances with both $X_1$ and $X_2$ are zero, its orthogonal projection onto that span is zero:This is two-step prediction for an MA(1) process. Applying the next one-step recursion would instead use an observed $X_3$, which is not available here.