If observed responses satisfy , their regression residuals necessarily obey the displayed inequalities. Subtracting the corresponding fitted values proves both bounds, without a normal distribution or a fitted-model assumption. On a residual-versus-fitted plot, all points must lie between two parallel lines of slope . This is also a consistency check when are merely the reported observed minimum and maximum, rather than theoretical response limits. A bounded response does not itself prove that a straight conditional mean is inappropriate.
For the state-space model , , assume independent Gaussian process noise and measurement noise of variances , independent of the prior state and previous observations. A normal distribution for the filtered state, with mean and variance , predicts mean and variance . Here denotes predicted state variance, rather than the observation-noise covariance notation used in the vector equations above. Gaussian conditional expectation then gives posterior mean and posterior variance , where the Kalman gain is .
Mere weak white noise assumptions do not imply normal posterior distributions: independent process noise with a Rademacher distribution makes the next state a mixture of two shifted normal distributions. The Kalman filter can still describe a best affine state estimate under appropriate second-order assumptions, but that is distinct from an exact Gaussian conditional law.
Scalar static-state Kalman update Created 2026-10-03 Updated 2026-10-14
Suppose the predicted state has normal distribution and the new observation is , where the measurement noise is independent of the state and previous observations. Gaussian conditional expectation gives
The coefficient is the scalar Kalman gain. The posterior mean is a weighted mean of the predicted state and the new observation, with the more precise quantity receiving more weight. For , the same equations can be expressed in precision parameters
The two precision parameters add because the measurement noise is independent of the state and past observations. Completing the square in the product of the prior density and the likelihood function gives this form directly. This is a Gaussian conditional expectation for a fixed unknown state; a moving state additionally requires a Kalman prediction step.
Scaled deviance 2026-10-14
For an exponential dispersion family with a common dispersion parameter , scaled deviance compares a fitted model with the saturated statistical model at the same dispersion:
For a normal distribution with variance , unscaled deviance is the residual sum of squares and scaled deviance is that sum divided by . For the binomial distribution, and the two coincide. Unknown Gaussian dispersion requires variance estimation; raw deviance differences should not be treated as chi-squared statistics without the scale.
Let and , where latent score has normal distribution with mean and variance , and the centred normal errors are independent of each other and . Since and , Gaussian conditional expectation gives with . Subtracting proves the formula. For , selecting scores below the mean creates positive expected self-assessment errors relative to those observed scores. This is a mathematical possibility, not an empirical estimate of any particular study's contribution from measurement error.
A probability distribution is self-decomposable if, for every , an independent remainder can be chosen so that the displayed equality in distribution holds. A normal distribution admits a normal distribution remainder with mean and variance . For an exponential distribution of rate , choose with probability and otherwise an independent exponential distribution of rate . Its moment-generating function is ; multiplication by proves the claim using the uniqueness theorem for moment-generating functions.
Take two stipulated oppositely charged daughters with equal rest mass and exactly opposite momenta of magnitude . Their total momentum is zero, so
This is a constructed event, not an identification of a historical particle. Boosting both four-momenta by along the first daughter's direction gives total energy and total momentum . Substitution recovers the same invariant mass, although the laboratory energy has increased.
The following independent simulation stipulates 700 signal combinations from a Cauchy distribution centered at with scale , truncated to , plus 2400 background combinations whose density decreases linearly across that interval. Each combination is converted to a back-to-back two-daughter event with . Independent isotropic directions are chosen, each Cartesian momentum component receives normal distribution noise with standard deviation , and invariant mass is reconstructed from the perturbed momenta. All inputs and counts are invented. No historical experimental points or fitted historical parameters appear.
Figure 1.
A stipulated resonance component produces an excess above a smooth simulated invariant-mass background
. Original simulation of two-daughter events, with invented counts, a truncated Cauchy signal and a linearly falling background. The two panels share the same generated events. The right panel adds chosen momentum noise before reconstructing invariant mass; this is not an experimental discovery plot. Details.
Single-observation location minimax bound Created 2026-10-06 Updated 2026-10-07
For a known mean-zero noise law with finite variance , observing only with unrestricted has minimax risk under squared-error loss. The observation itself attains this risk. For the lower bound, use a flat prior distribution on and condition an easier experiment on . Away from the prior endpoints, the Bayesian posterior noise has its original truncated law. Let and then in the resulting Bayes risk lower bound. No normal distribution or density for the noise is required.
Under the studentized normal sample mean assumptions, let denote the quantile at cumulative probability of the Student's t-distribution. For , rearranging the event gives a Student t confidence interval for the unknown mean with exact coverage probability . [ref]
Choose the list as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown , then
There are four statistical degrees of freedom. For a 95% confidence interval, , so
Using the standard normal quantile with the same estimated standard error would give only . That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is , rather than 0.95.
Figure 1.
Chosen five-value example: estimating the spread requires a wider t confidence interval
. Details.
The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact quantile cover the same fixed . This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.
For this four-degree case, the cumulative distribution function has an especially simple form:
One can check the formula by differentiation: , with limits zero and one at the two ends of the real line. Solving the increasing equation by the bisection method gives the quantile used above.
For and standard Brownian motion , the drift in Itô formula for vanishes exactly when the displayed equation holds for every spatial point and every . Necessity follows because a zero finite-variation integral has continuous integrand equal to zero, and at every positive time the normal distribution of has full support. Continuity extends the equation to time zero. There is no condition at negative times except compatibility with the global smoothness of .
Spatial Bernoulli infection model Created 2026-10-14 Updated 2026-10-20
Given the currently infected set and susceptible set , define and . Conditionally independent new-infection indicators have likelihood
A nonnegative infection intensity requires ; an unrestricted normal distribution prior distribution for must therefore be restricted or replaced. With or and positive distances, the conditional posterior kernels are not generally conjugate normal probability densities. Metropolis–Hastings algorithm updates, optionally on with its Jacobian determinant, provide a direct sampling method.
Standard normal distribution Created 2026-09-24 Updated 2026-10-14
The standard normal distribution is : the normal distribution with mean zero, variance one and standard deviation one. Its standard normal density integrates to one; its standard normal distribution function records the area accumulated from to a threshold. The distinction matters: , , and for a standard normal random variable .
For a toy measurement , leave the measurement unit unspecified. The standardization of a normal random variable converts into standard scores . Using the standard normal distribution function,
The second area is half the first because the normal distribution is a symmetric probability distribution about its mean. The numerical heights differ: , yet the corresponding shaded areas are equal because in the change of variables.
Figure 1.
Standardization changes density heights and coordinates but preserves probabilities
. The same toy normal distribution is shown before and after standardization of a normal random variable. The blue and orange areas together have probability approximately ; the orange area alone has probability approximately . The threshold becomes standard score . Each probability density function has total area one over the whole real line; a single outcome has zero probability. Details.
Standard score 2026-10-14
A standard score expresses an outcome as a signed number of standard deviations from a mean , assuming . It is a dimensionless quantity. For a random variable with finite positive variance , has mean zero and variance one; it has a standard normal distribution when has a normal distribution, but centering and scaling alone do not make other probability distributions normal. [ref].
Stationary process Created 2026-09-28 Updated 2026-10-14
A stationary process, in the strict sense, has the same joint probability distribution after every common shift of its time indices. More precisely, for every positive integer , every choice of times , and every integer shift ,
Here equality means equality of probability distributions, not equality of realized observations. A sample path can fluctuate, stay positive for a while, or show accidental runs while its generating law remains stationary. Strong white noise is a basic example: shifting time preserves every joint law of its independent and identically distributed random variables.
The distinction between strict stationarity and weak stationarity is useful. The former preserves all finite joint laws; the latter preserves only the finite mean and covariance structure. Strict stationarity with finite second moments implies weak stationarity, but strict stationarity itself does not require finite variance. A Gaussian process with weak stationarity is also strictly stationary, because each of its finite-dimensional distributions, a joint normal distribution, is determined by its mean vector and covariance matrix.
Compute observed-minus-expected event contributions within each stratum's risk set, then add them across independent strata. Under the null, the corresponding conditional variances add. Standardizing gives an approximate normal distribution test, or its square gives a one-degree-of-freedom chi-squared distribution test. The comparison requires the usual exchangeability and independent censoring assumptions within strata.
Suppose , , are independent and identically distributed with normal distribution , where the mean and standard deviation are unknown. Define the sample mean and sample variance by
Under these assumptions,
Substitution gives the exact ratio
The unknown cancels. The denominator estimates the standard error of the sample mean; its sampling variability is precisely why the Student's t-distribution has wider tails than the standard normal distribution.
The crucial independence has a geometric explanation. Apply an orthogonal transformation to the standardized observations , choosing its first coordinate along . That coordinate is ; the remaining coordinates are independent standard normal random variables whose squared sum is . Their joint probability density factorizes because the transformation preserves the squared length. This also explains the loss of one statistical degree of freedom when estimating the mean. Uncorrelatedness alone would not establish the required independence for arbitrary data.
The result is exact for every under the stated normal distribution model. A small sample size by itself does not justify it: a sample from an arbitrary probability distribution need not have the displayed chi-squared distribution or the necessary independence.
Studentized sample mean 2026-10-25
For independent and identically distributed observations with finite positive variance, the central limit theorem, consistency of the sample variance and Slutsky's theorem give . Under an independent normal distribution sample it instead has the exact finite-sample Student t-distribution with degrees of freedom, as described by the studentized normal sample mean. The asymptotic statement does not require normal individual observations.
A Student t random-effect model assigns Student's t-distributions to exchangeable study effects, allowing heavier tails than a normal distribution hierarchy. An equivalent Gaussian scale mixture is , , with independent latent draws. For the variance is , so is a scale rather than a standard deviation. Small latent precisions weaken shrinkage for atypical studies while retaining partial pooling for the rest.
A real probability distribution is symmetric about when and have the same distribution. A centered normal distribution is symmetric about zero.