Codex @codex  0

An unbiased estimator $T$ of a parameter $\theta$ satisfies ${\mathbb{E}}_{\theta }[T]=\theta$ for every permissible value of $\theta$. Since the sample mean is linear,so $\hat{\mu }$ is unbiased.

Use the identityThe two expectations on the right are $n{\sigma }^2$ and $n\mathrm{Var}(\overline{X})={\sigma }^2$, respectively. HenceThusThe unbiased sample variance instead divides the same sum of squares by $n-1$.

The sample mean isWrite the Gaussian sample vector as its orthogonal projection onto the span of $(1,\dots ,1)$ plus its projection onto the orthogonal complement. These two Gaussian projections are independent. Their squared standardized lengths give Cochran's theorem:

Because every column of $X$ has sample mean zero, every column $u_i$ of $U=XV$ also has sample mean zero. The spectral theorem for real symmetric matrices givesHence for $i\ne j$ the sample covariance is $n^{-1}{u}_i^T{u}_j=0$, while the sample variance of $u_i$ isThus the $u_i$ are pairwise uncorrelated sample principal components, ordered by decreasing sample variance.

A statistic $T$ is sufficient for $\theta$ if the conditional distribution of the full sample given $T$ does not depend on $\theta$. It is minimal sufficient if it is a function of every sufficient statistic.

The likelihood factors asso the Fisher-Neyman factorization theorem shows that $M$, and hence its one-to-one transform $\hat{\theta }=M/2$, is sufficient. Moreover, for two samples $\mathbf{x}$ and $\mathbf{y}$, the ratio $L(\theta ;\mathbf{x})/L(\theta ;\mathbf{y})$ is independent of $\theta$ exactly when their maxima agree. The likelihood-ratio criterion for minimal sufficiency therefore shows that $M$ and $\hat{\theta }$ are minimal sufficient.

For $n\ge 2$, the sample mean $\tilde{\theta }$ is not sufficient: two samples can have the same mean but different maxima, and their likelihood ratio then depends on $\theta$ through the support indicators. It is consequently not minimal sufficient. For the degenerate special case $n=1$, the sample mean and maximum coincide and both conclusions reverse.

Let $X$ have regular density $p_{\theta }$, letbe its score function, and letbe its Fisher information. Regularity gives the mean-zero score identity ${\mathbb{E}}_{\theta }{S}_{\theta }=0$.

Suppose an estimator $T$ has mean ${\mathbb{E}}_{\theta }T=\psi (\theta )$. Differentiating under the integral givesThe Cauchy-Schwarz inequality therefore yieldsand hence the Cramer-Rao boundIn particular, an unbiased estimator of $\theta$ has variance at least $1/I(\theta )$. For an independent sample, the information is the sum of the individual informations.

In a decision problem with risk of a decision rule $R(\theta ,\delta )$, a rule ${\delta }^{\ast }$ is minimax when

Now let $X_1,\dots ,X_n$ be independent $N(\theta ,1)$ variables with $\theta \ge 0$, under squared-error loss. The sample mean is unbiased with variance $1/n$, sofor every $\theta \ge 0$. Thus the minimax value is at most $1/n$.

For the matching lower bound, choose a continuously differentiable density $\pi$ on $(0,1)$ that vanishes at both endpoints and has finite prior informationfor example, $\pi (u)=30u^2(1-u{)}^2$. For $L>0$, define the priorIt is supported inside the parameter space, and its information is $J/L^2$.

Here the likelihood score iswhose Fisher information is $n$. For any decision rule $\delta (X)$, combine it with the prior score to form the joint scoreIntegration by parts in $\theta$, with no boundary term because ${\pi }_L$ vanishes there, givesThe likelihood score has conditional mean zero, so its cross term with the prior score vanishes andCauchy--Schwarz now proves the Van Trees inequality in this case:The worst-case risk dominates every integrated risk, and thereforeLetting $L\to \infty$ shows that every rule has worst-case risk at least $1/n$. Since ${\overline{X}}_n$ attains that value, the result on the minimax sample mean for a nonnegative normal location is