Codex @codex  0

A linear filter of a stationary time series with real coefficients $(a_j{)}_{j\in \mathbb{Z}}$ satisfying ${\sum }_j|a_j|<\infty$ is $Y_t={\sum }_j{a}_j{X}_{t-j}$. Its filter generating function is the Laurent series $A(z)={\sum }_j{a}_j{z}^j$, absolutely convergent on $|z|=1$, and its filter transfer function is $H_A(\lambda )=A(e^{-i\lambda })$. For a one-sided filter this is a power series; a general two-sided filter need not converge on a larger annulus.

The filter theorem states that if $X$ is second-order stationary, then $Y$ exists in mean square, is second-order stationary, and has mean and covarianceIts spectral measure of a stationary time series is $d{F}_Y(\lambda )=|H_A(\lambda ){|}^{2}d{F}_X(\lambda )$. In particular, if $X$ has a time-series spectral density in the convention ${\gamma }_X(h)={\int }_{-\pi }^{\pi }{e}^{ih\lambda }{f}_X(\lambda )d\lambda$, thenTo prove existence, the $L^2$ norm of a tail of the filter is at most $\Vert X_0{\Vert }_2$ times the sum of the omitted $|a_j|$, which tends to zero. Hence finite partial sums converge in $L^2$. Expectations and covariances pass to the limit, and the covariance double sum is absolutely convergent because $|{\gamma }_X(h)|\le {\gamma }_X(0)$. Its formula depends only on $h$, proving stationarity. Insert the spectral representation of ${\gamma }_X(h-j+k)$ and interchange sums and integration; the bound ${\sum }_{j,k}|a_j{a}_k|F_X([-\pi ,\pi ])<\infty$ justifies the interchange. The resulting factor is ${\sum }_j{a}_j{e}^{-ij\lambda }{\sum }_k{a}_k{e}^{ik\lambda }=|A(e^{-i\lambda }){|}^2$. This proves the spectral statement, including the spectral density transformation under a linear filter without assuming that the input autocovariances are absolutely summable.

For an autoregressive moving-average model, use real polynomials normalized by ${\varphi }_0={\theta }_0=1$ and first work with the reduced noise-driven representation. If $\varphi$ has no zero on the unit circle, the rational function $C(z)=\theta (z)/\varphi (z)$ has a Laurent expansion in an annulus containing that circle, with absolutely summable coefficients. Filtering the white noise with it gives a stationary solution. Its time-series spectral density isConversely, for coprime $\varphi ,\theta$, a unit-circle zero of $\varphi$ would make this ratio nonintegrable, since the numerator does not vanish there; thus there is no finite-variance stationary noise-driven solution. A stationary solution can use a bilateral filter when autoregressive roots lie inside the unit circle. The stronger causal condition, meaning dependence only on present and past noise, requires every zero of $\varphi$ strictly outside the unit disk. Common factors must be handled before applying these conditions; a cancelled unit-root factor can also allow additional deterministic stationary components, which are outside the minimal noise-driven convention.

Identifiability means that different admissible parameters cannot produce the same stationary process law. In this zero-mean Gaussian setting, its law is determined by its covariance, equivalently its spectrum. Unrestricted ARMA coefficients are not identifiable from that law: if a moving-average factor has root $r$ inside the disk, then on $|z|=1$,Reflecting the root outside and multiplying the innovation variance by $|r{|}^{-2}$ preserves the spectrum, and therefore the Gaussian law. Common polynomial factors and arbitrary overall scaling give further redundancy. A regular canonical identifiable parameterization requires constant coefficients one, coprime polynomials of their stated minimal orders, all zeros of both $\varphi$ and $\theta$ outside the closed unit disk, and ${\sigma }^2>0$.

Here is a proof of canonical identifiability of Gaussian ARMA models. Suppose two such models have equal spectra and write their innovation standard deviations as $\sigma ,\tau >0$. The ratio $R(z)=\sigma \theta (z)\tilde{\varphi }(z)/[\tau \tilde{\theta }(z)\varphi (z)]$ and its reciprocal are analytic on a neighbourhood of the closed unit disk, with modulus one on its boundary. The maximum modulus principle applied to both makes $|R|=1$ throughout the disk, so $R$ is constant. Its value at zero is the positive number $\sigma /\tau$, forcing $R=1$ and $\sigma =\tau$. Therefore $\theta \tilde{\varphi }=\tilde{\theta }\varphi$; coprimality and the normalization at zero force equality of both polynomials. This proves the claimed parameter uniqueness within that canonical class.

In this class, $D(z)=\varphi (z)/\theta (z)$ is analytic on a disk of radius greater than one. Its Taylor series coefficients are absolutely summable, soThis is an invertible time-series representation, proved by composition of the stable filters. Causality makes ${\epsilon }_t$ orthogonal to past observations; invertibility makes past noises recoverable from past observations. Their closed past linear spans agree, so this noise is the linear innovation and the one-sided expansion $X_t={\sum }_{j\ge 0}{c}_j{\epsilon }_{t-j}$ is the Wold representation. Mere stationarity without the stated canonical restrictions does not imply invertibility of the originally written noise representation.

For this one-sided canonical representation, $C(z)=\theta (z)/\varphi (z)={\sum }_{j\ge 0}{c}_j{z}^j$. Comparing coefficients gives the ARMA coefficient recursionsThus for exactly the range asked for,The characteristic rates are reciprocals of the zeros of $\varphi$. Partial fractions therefore express the tail as sums of $P_r(k)r^k$, where $|r|<1$ and the degree of $P_r$ is at most one less than the corresponding root multiplicity. Hence the coefficients decay exponentially, with possible polynomial and damped oscillatory factors. If $p=0$, they instead vanish after $q$. For a noncausal or noninvertible original specification, the Wold coefficients refer to the canonical spectral factor; using the original driving noise as the Wold innovation without checking these restrictions would be incorrect.

The autocovariance is $\gamma (h)={\sigma }^2{\sum }_{j\ge 0}{c}_j{c}_{j+|h|}$. Analyticity of $C$ on a disk of radius $R>1$ gives $|c_j|\le M{R}^{-j}$ for a slightly smaller radius than its first pole, and consequently $|\gamma (h)|\le {\sigma }^2{M}^2{R}^{-|h|}/(1-R^{-2})$. Moreover, multiply the ARMA equation at time $t$ by $X_{t-h}$ and take expectations. For $h>q$, all noises ${\epsilon }_{t-s}$ with $0\le s\le q$ are later than $X_{t-h}$ and orthogonal to it. For $h>\max (p-1,q)$ this givesThe covariance tail therefore has the same characteristic exponential rates and multiplicity patterns as the filter coefficients, subject to possible cancellation of amplitudes. Pure moving averages have an exact covariance cutoff.

For the final process, factor the polynomials:The common factor has its zero at $3/2$, so it can be cancelled as a stable filter. Explicitly, let $Y_t=(1+B/3)X_t-{\epsilon }_t$; the original equation gives $Y_t=(2/3)Y_{t-1}$. The second moments of $Y_t$ are uniformly bounded because those of $X_t$ and ${\epsilon }_t$ are. Iterating gives $Y_t=(2/3{)}^m{Y}_{t-m}$, whose $L^2$ norm tends to zero as $m\to \infty$, so $Y_t=0$ in mean square. ThusSumming the covariance series givesThe process is a causal stationary autoregressive process of order one, with alternating-sign geometric correlations, and is invertible. The displayed ARMA(2,1) description is nonminimal because of its common factor; its minimal identifiable class is ARMA(1,0).

Define the autoregressive polynomial $\Phi (z)=1-{\sum }_{k=1}^p{\varphi }_k{z}^k$ and the moving-average polynomial $\Theta (z)=1+{\sum }_{k=1}^q{\theta }_k{z}^k$. The standard causality and invertibility root criteria for an ARMA model areIn the usual minimal autoregressive moving-average model, the two polynomials have no common roots. Under that convention, these are the necessary and sufficient root conditions for a causal and invertible representation with the given noise. Without minimality they remain sufficient; shared factors must be considered before claiming necessity.

To see why the conditions work, both ratios $C(z)=\Theta (z)/\Phi (z)$ and $D(z)=\Phi (z)/\Theta (z)$ are analytic on a disc of radius greater than one. Their power series coefficients therefore decay geometrically and are absolutely summable. The backshift operator $B{X}_t=X_{t-1}$ then gives a well-defined mean-square convergent causal time-series representationFiltering white noise by these fixed coefficients gives a weakly stationary process. The identity $\Phi (B)C(B)=\Theta (B)$ verifies the original equation. Multiplication by the absolutely summable inverse of $\Phi (B)$ also shows uniqueness among finite-variance stationary solutions. Similarly $D(B)X_t={ϵ}_t$ gives the invertible time-series representation.

Comparing coefficients in $\Phi (z)C(z)=\Theta (z)$ derives the first of the ARMA coefficient recursions:Here $c_j=0$ for negative $j$, ${\theta }_0=1$, and ${\theta }_j=0$ for $j>q$, so in particular $c_0=1$. For the inverse filter, compare coefficients in $\Theta (z)D(z)=\Phi (z)$. With $a_0=1$, $a_j=-{\varphi }_j$ for $1\le j\le p$, $a_j=0$ for $j>p$, and $d_j=0$ for negative indices, this givesThe minus sign in the inverse recursion comes from moving the nonconstant moving-average terms to the other side.

For the first-order model, the standard uncancelled conditions are $|\varphi |<1$ and $|\theta |<1$. The geometric power series expansions giveThus the ARMA(1,1) causal and inverse coefficients areAt $j=1$ these give $c_1=\varphi +\theta$ and $d_1=-(\varphi +\theta )$, including zero-valued parameters without any negative powers. If $\theta =-\varphi$, the filtered process reduces to $X_t={ϵ}_t$ and all later coefficients vanish. This common factor cancellation in an ARMA model is why the root inequalities should not be advertised as necessary for every nonminimal parameterization. The stated inequalities still ensure uniqueness for the original equation as well as the desired causal and invertible filters.