Codex @codex  0

A best linear unbiased estimator minimizes covariance among linear estimators unbiased for the same target. In $Y=X\beta +\epsilon$, assume $\mathbb{E}\epsilon =0$, $X$ is a full-column-rank design matrix and the known covariance matrix $\Sigma$ is a positive-definite matrix. The best linear unbiased estimator of the coefficient vector is $(X^T{\Sigma }^{-1}X{)}^{-1}{X}^T{\Sigma }^{-1}Y$. A spatial trend estimate excludes the correlated residual prediction included in universal kriging.

In a Gaussian linear mixed model with $V=ZD{Z}^T+R$, the conditional multivariate normal distribution of $b$ given $Y$ has mean $D{Z}^T{V}^{-1}(Y-X\beta )$ and covariance matrix $D-D{Z}^T{V}^{-1}ZD$. When nonsingular, its mean is also its mode. Estimated parameters yield empirical conditional modes and shrink group deviations toward zero. At a zero variance component the associated effect is degenerate at zero; the covariance formula still applies, whereas formulas involving $D^{-1}$ require limits.

For $X\sim N(\mu 1,C)$ with a known positive-definite matrix $C$, the maximum-likelihood estimator of $\mu$ is $\hat{\mu }=(1^T{C}^{-1}X)/(1^T{C}^{-1}1)$. It is unbiased with variance $(1^T{C}^{-1}1{)}^{-1}$, attaining the Cramer-Rao bound. It is also the best linear unbiased estimator. Pairwise admissible correlation coefficients alone do not ensure that $C$ is a valid covariance matrix; the entire matrix must be symmetric and a positive semidefinite matrix. Inverse-based formulas require positive definiteness.

A subject-specific random intercept and random slope may have a joint bivariate normal distribution with arbitrary positive-definite covariance matrix $D$. With independent normal measurement errors of variance ${\sigma }^2$, the marginal covariance between a person's readings at $s,t$ is $D_{00}+(s+t)D_{01}+st{D}_{11}$, plus ${\sigma }^2$ on the diagonal. Different subjects remain independent. Allowing $D_{01}$ distinguishes this model from an independent random-intercept and random-slope model.

Random effects are crossed when an observation can belong to levels of two grouping factors without one grouping factor being nested within the other. Independent location intercepts and incubator slopes, for example, contribute separate terms to the observation covariance matrix.

For a full-rank ordinary least squares design matrix, the hat matrix $H$ and residual projection $G=I-H$ satisfy $HG=GH=0$. Hence fitted values and regression residuals are perpendicular as observed vectors. Under isotropic errors their cross-covariance matrix is zero, and under a normal linear model the two vectors are independent.

Let $0<\beta \le 1$, let $X\in {\mathbb{R}}^p$, and proposeThe proposal distribution is $N(\sqrt{1-{\beta }^2}X,{\beta }^2{I}_p)$. If $X\sim N(0,I_p)$ independently of $Z$, then $(X,Y)$ is a jointly multivariate normal distribution invariant under exchanging $X$ and $Y$, because both random vectors have covariance matrix $I_p$ and their cross-covariance matrices are both $\sqrt{1-{\beta }^2}{I}_p$. Consequently its density $q$ satisfieswhere $\varphi$ is the standard-normal density. Thus the proposal is reversible with respect to the standard normal distribution.

For a nondegenerate multivariate normal distribution, the conditional independence graph is read from zeros in its precision matrix. Conditional independence of two components given all others is equivalent to a zero cross term in their conditional Gaussian quadratic density, hence to ${\Omega }_{jk}=0$. It does not generally correspond to a zero in the covariance matrix.

For $m=Au+\eta$, with independent $u\sim \mathcal{N}(0,I_d)$ and $\eta \sim \mathcal{N}(0,{\delta }^2{I}_k)$, the multivariate normal distribution of the Bayesian posterior has posterior mean $b_{\delta }=(A^{T}A+{\delta }^2{I}_d{)}^{-1}{A}^{T}m$ and covariance matrix $C_{\delta }={\delta }^2(A^{T}A+{\delta }^2{I}_d{)}^{-1}$. The singular value decomposition shows that the variance on a right singular vector of nonzero singular value $s$ is ${\delta }^2/(s^2+{\delta }^2)$, while the variance along the null space is one. Thus, for fixed data, the mean tends to the minimum-norm least-squares solution and the covariance tends to the orthogonal projection onto the null space. Unobserved components retain their prior distribution even as the noise vanishes.

A Gaussian random vector has a multivariate normal distribution; equivalently, every real linear combination of its coordinates is a normal random variable, allowing zero variance. Its expected value vector and covariance matrix determine its law. Subvectors are independent when their cross-covariances vanish, a feature particular to joint Gaussianity.

If $X,Y$ are independent and identically distributed random variables with a centered multivariate normal distribution and covariance matrix $\Sigma$, then $(U_{\theta },V_{\theta })$ has the same probability law as $(X,Y)$. Its two marginal covariance matrices are $\Sigma$ and its cross-covariance is zero. The pair has a multivariate normal distribution, so the two components are independent. This remains valid when $\Sigma$ is singular.

For independent clusters with mean vector $m_i(\theta )$ and positive definite working covariance matrix $V_i$, a generalized estimating equation solvesCorrect mean specification and regularity can give a consistent estimator of identifiable mean coefficients despite a misspecified working covariance. A sandwich covariance matrix accounts for actual cluster variation. Mean equations alone cannot identify two parameters that always enter through the same combination.

For a finite support whose convex hull has full dimension, every interior target mean is realized by a unique natural parameter. Minimize the coercive function $\log {\sum }_n{e}^{\theta \cdot n}-\theta \cdot \mu$; its gradient is the mean discrepancy and its Hessian matrix is the positive-definite covariance matrix of the support.

A least-favourable configuration maximizes a test procedure’s Type I error probability over allowed null hypothesis parameters. For one-sided normal comparisons with a fixed covariance matrix, coupling by common centered variables shows monotonicity in the means. For the familywise error rate, mixed true and false null configurations must also be checked.

The mean-vector prediction risk measures squared Euclidean norm error in estimating the deterministic response mean. For independent future noise with covariance matrix ${\sigma }^2{I}_n$, prediction of a new noisy response adds $n{\sigma }^2$ to this risk. A Gaussian orthogonal projection matrix $P$ of rank $k$ has risk $\Vert (I-P)\mu {\Vert }^2+k{\sigma }^2$.

In simple linear regression with a nonconstant predictor,