Codex @codex  0

If $W(s)$ is stationary, then $Z(s)=W(s)-W(0)$ has exactly the same increments and semivariogram, but $\mathrm{Var}Z(s)=2{\gamma }_W(s)$ is generally nonconstant. Thus existence of a stationary covariance model for a semivariogram does not imply stationarity of every process with that semivariogram. Adding an independent random constant also leaves the semivariogram unchanged while changing the covariogram.

Only observations at lag one share a noise term. Thus ${\gamma }_0={\sigma }^2(1+{\theta }^2)$, ${\gamma }_{\pm 1}={\sigma }^2\theta$, and every other lag has zero covariance. This tridiagonal finite covariance structure makes the finite-sample innovations of an MA(1) process particularly simple.

A best linear unbiased estimator minimizes covariance among linear estimators unbiased for the same target. In $Y=X\beta +\epsilon$, assume $\mathbb{E}\epsilon =0$, $X$ is a full-column-rank design matrix and the known covariance matrix $\Sigma$ is a positive-definite matrix. The best linear unbiased estimator of the coefficient vector is $(X^T{\Sigma }^{-1}X{)}^{-1}{X}^T{\Sigma }^{-1}Y$. A spatial trend estimate excludes the correlated residual prediction included in universal kriging.

For standard Brownian motion, the Brownian bridge $U_t=B_t-t{B}_1$, $0\le t\le 1$, is independent of $B_1$. Every finite vector of bridge coordinates is jointly multivariate normal with $B_1$, and its cross-covariances with $B_1$ vanish. The independence of uncorrelated jointly normal variables and independence extended from generating pi-systems prove independence of the whole stochastic process.

An increment of a Brownian motion between deterministic times $s<t$ is $W_t-W_s$. It has normal distribution $N(0,t-s)$ and is independent of the filtration up to time $s$. Increments on disjoint time intervals are independent. Their covariance is the length of overlap of the corresponding intervals; this also follows from the Brownian covariance kernel.

For square-integrable random variables, $\mathrm{Cov}(X,Z\mid \mathcal{G})=\mathbb{E}[XZ\mid \mathcal{G}]-\mathbb{E}[X\mid \mathcal{G}]\mathbb{E}[Z\mid \mathcal{G}]$. It is a $\mathcal{G}$-measurable random variable. Replacing $X$ by its conditional expectation given a larger sigma-field leaves this covariance unchanged when $Z$ is measurable with respect to that larger sigma-field. This observation underlies recovery of a martingale-transform integrand by conditional covariance.

The continuum Gaussian free field on a planar domain $D$ is a centered Gaussian process indexed by finite-energy measures or test functions, with covariance given by the Green function of the Laplacian on $D$.

A subject-specific random intercept and random slope may have a joint bivariate normal distribution with arbitrary positive-definite covariance matrix $D$. With independent normal measurement errors of variance ${\sigma }^2$, the marginal covariance between a person's readings at $s,t$ is $D_{00}+(s+t)D_{01}+st{D}_{11}$, plus ${\sigma }^2$ on the diagonal. Different subjects remain independent. Allowing $D_{01}$ distinguishes this model from an independent random-intercept and random-slope model.

Let $A,B$ be indicator random variables with conditional independence given a random variable $T$, and suppose $\mathbb{E}[A\mid T]=\mathbb{E}[B\mid T]=g(T)$. Then the law of total expectation gives $\mathbb{E}[AB]=\mathbb{E}[g(T{)}^2]$ and $\mathbb{E}[A]=\mathbb{E}[B]=\mathbb{E}[g(T)]$. Thus their covariance is the variance of $g(T)$ and is nonnegative. The result explains correlated component evolutionary states in a coeval binary population without correlation between initial masses.

The covariogram is the displacement-dependent covariance $C(h)=\mathrm{Cov}[Z(s+h),Z(s)]$ of a second-order stationary field. It is an even positive-definite kernel. A semivariogram determines differences $C(0)-C(h)$, but not an arbitrary constant covariance component.

Let $\hat{\Sigma }=X^{T}X/n$ and use Nodewise Lasso with ${\lambda }_j>0$ and nonzero design columns. Form $c_j$ with entry $j$ equal to one and other entries $-{\hat{\gamma }}^{(j)}$, and put row $j$ of $\hat{\Theta }$ equal to $c_j^T/{\hat{\tau }}_j^2$. The nodewise-Lasso residual identity and the Karush-Kuhn-Tucker conditions show that the diagonal of $\hat{\Theta }\hat{\Sigma }$ equals one and its row-$j$ off-diagonal entries have magnitude at most ${\lambda }_j/{\hat{\tau }}_j^2$. For the Debiased Lasso,The displayed bound follows row by row from Holder inequality. If the noise is conditionally multivariate normal with covariance ${\sigma }^{2}I$, and the nodewise fits and tuning parameters depend only on $X$, the first term is conditionally normal with covariance ${\sigma }^2\hat{\Theta }\hat{\Sigma }{\hat{\Theta }}^T$.

For an isonormal Gaussian process $X$ on a real Hilbert space $H$ and $k\in H$, the positive density $\exp (X(k)-\Vert k{\Vert }^2/2)$ has expectation one and defines an equivalent probability measure. Under this measure, $X(h)$ has mean $⟨h,k⟩$ and the same covariance as before. The shifted family $X(h)-⟨h,k⟩$ is again an isonormal Gaussian process. This follows by evaluating the joint Gaussian exponential formula for any finite collection of arguments. It is the Hilbert-space version of exponential tilting.

Starting at time one, the orthogonal residuals satisfy $U_t=X_t-{\lambda }_t{U}_{t-1}$, with ${\lambda }_t={\gamma }_1/{\phi }_{t-1}$ and ${\phi }_t={\gamma }_0-{\gamma }_1{\lambda }_t$. Earlier innovation directions have zero covariance with the new observation. Explicitly, with $S_m={\sum }_{j=0}^m{\theta }^{2j}$, ${\phi }_t={\sigma }^2{S}_t/S_{t-1}$ and ${\lambda }_t=\theta S_{t-2}/S_{t-1}$ for $t\ge 2$. These formulas follow by induction from $S_t=(1+{\theta }^2)S_{t-1}-{\theta }^2{S}_{t-2}$, with $S_0=1$ and $S_1=1+{\theta }^2$. This includes $\theta =\pm 1$, where ${\phi }_t={\sigma }^2(t+1)/t$.

If $X,Y$ are independent and identically distributed random variables with a centered multivariate normal distribution and covariance matrix $\Sigma$, then $(U_{\theta },V_{\theta })$ has the same probability law as $(X,Y)$. Its two marginal covariance matrices are $\Sigma$ and its cross-covariance is zero. The pair has a multivariate normal distribution, so the two components are independent. This remains valid when $\Sigma$ is singular.

For $\varphi >0$ and nonnegative variances, $\gamma (h)={\tau }^2{1}_{\{h\ne 0\}}+{\sigma }^2(1-e^{-{\varphi }^2\Vert h{\Vert }^2})$ admits covariance $C(h)={\sigma }^2{e}^{-{\varphi }^2\Vert h{\Vert }^2}+{\tau }^2{1}_{\{h=0\}}$. The Gaussian kernel is positive definite because it is the Fourier transform of the density of a Gaussian distribution. Adding independent white noise supplies the nugget effect. Its scale is $a=1/\varphi$. For ${\sigma }^2>0$, its exact range of a semivariogram is infinite. If ${\sigma }^2=0$, it is a pure nugget effect with no nontrivial structured range.

Observe $Y(t)={\int }_0^{t}f(s)ds+\sigma W(t)$ on $[0,1]$, where $f\in L^2[0,1]$ is an unknown deterministic drift and $W$ is standard Brownian motion. The observation against a deterministic test function is $Y(h)=⟨f,h⟩+\sigma W(h)$, with covariance ${\sigma }^2⟨h,g⟩$. Gaussian white noise is represented by an isonormal Gaussian process on test functions rather than a pointwise noise function. Taking $\sigma =n^{-1/2}$ is the usual statistical scaling.

For independent clusters with mean vector $m_i(\theta )$ and positive definite working covariance matrix $V_i$, a generalized estimating equation solvesCorrect mean specification and regularity can give a consistent estimator of identifiable mean coefficients despite a misspecified working covariance. A sandwich covariance matrix accounts for actual cluster variation. Mean equations alone cannot identify two parameters that always enter through the same combination.