An unbiased coefficient estimator with known variance gives a conservative level- test of a zero coefficient by rejecting when its absolute value is at least . Chebyshev's inequality bounds the null rejection probability by . This test needs the variance assumptions but no Gaussian error distribution; a normal-reference test requires additional distributional justification.
Gaussian error 2026-10-31
A Gaussian error is an error term with a normal distribution. Independent Gaussian errors of equal variance turn least squares into maximum likelihood and make standardized linear coefficient estimators exactly normal. Zero mean and common variance alone do not imply Gaussian errors.
Minimize the residual sum of squares . Differentiating gives the normal equations . Full column rank makes positive definite and invertible, so the unique minimizer is
Since , it is unbiased. The independent common-variance errors give , hence
Independent Gaussian errors with common variance are a sufficient condition for this estimator also to be the maximum likelihood estimator: their log-likelihood differs from by terms independent of . Profiling an unknown common variance gives the same minimizer. Mean and variance assumptions alone do not specify a likelihood.
For the seven design points, and . In increasing time order the design matrix is
Its columns are mutually orthogonal: the odd sums vanish and . Their squared lengths are , respectively. Therefore
In particular . Testing for a quadratic contribution means testing against .
The cooling measurements are stated to have zero-mean errors and known common variance, but normality is not explicitly assumed for them. Under the independent-error linear regression model as stated, Chebyshev's inequality gives a valid conservative level- test: reject when
Its null rejection probability is at most because the estimator has mean zero and the calculated variance. If Gaussian errors are additionally assumed, the sharper exact test uses under the null and rejects for . With only seven observations, exact normal calibration cannot be deduced from the printed moment assumptions alone.