The standardized observations are independent standard normal random variables. By the definition of the chi-squared distribution,
Its distribution is continuous, so gives the required probability. Put . Solving for the positive variance reverses the reciprocal order. The exact confidence interval is
The mean is known to be zero, so the degrees of freedom are , not . Coverage is exactly under the stated normal model.
The unrestricted likelihood is maximized at the empirical proportions, while the null likelihood is maximized at . Twice the log of their ratio is
Large values mean the fitted null likelihood is much smaller than the unrestricted maximum, so rejection is in the upper tail.
For a regular identifiable scalar parameter lying in the interior, positive true cell probabilities, and sufficiently large expected counts, Wilks theorem gives an approximate chi-squared distribution with degrees of freedom under the null. The unrestricted probability vector has dimension and the fitted null has dimension one. At significance level , reject if , or report the approximate p-value .
Cells with very small expected counts may require a prespecified pooling scheme or simulation calibration; the asymptotic reference is not an exact finite-sample law. For a regular null with fitted parameters, the corresponding degrees of freedom are .
For independent Gaussian measurements with correctly specified standard deviations, model residuals give the chi-squared test statistic
For a linear fit of identifiable parameters under the null model, it has a chi-squared distribution with degrees of freedom. The upper-tail p-value tests unusually large residuals; a nonlinear fit generally uses this distribution only approximately. Correlated Gaussian errors instead require .
For counts, Pearson's chi-squared test uses , with calculated under the null hypothesis. For multinomial categories and fitted parameters the usual asymptotic degrees of freedom are ; the subtraction of one reflects the fixed total count. Sparse expected counts can invalidate this approximation, requiring a suitable exact or simulation-based test. Contingency-table independence gives degrees of freedom.
A small p-value indicates tension with the specified model and error assumptions; it is not the probability that the null is true. Excessive may reflect a wrong model, underestimated errors, correlations or outliers. An implausibly small value may suggest overestimated errors or hidden constraints. For an adequate fitted model is typically near one, with fluctuations, rather than required to equal one.
A Gaussian distribution with mean and standard deviation has probability density
Its symmetry, finite variance and simple behavior under linear combinations make it useful for repeated measurements. Roughly , and of observations lie within one, two and three true standard deviations of the mean. These are coverage probabilities for a specified distribution, not guarantees that every experimental error is normal.
Why it appears. The central limit theorem explains why many sums of small independent finite-variance contributions approach a Gaussian law after centering and scaling, provided no single contribution dominates. Detector noise, small mechanical disturbances and multiple electronic fluctuations can combine approximately this way. The theorem does not remove a common calibration bias, and it does not justify assuming normal tails for rare large disturbances or arbitrarily correlated errors. A large-mean Poisson distribution also approaches a Gaussian with variance equal to its mean, making normal approximations useful for high-count photon or particle data; low counts require the discrete model.
A classical particle at thermal equilibrium in a one-dimensional harmonic potential has a Gaussian position distribution directly from the Boltzmann distribution:
Thus a Gaussian law can arise from the energy dependence of equilibrium probability, rather than only from an informal appeal to many independent errors.
Precision of repeated measurements. For independent observations with the same mean and variance, the sample mean has variance . For Gaussian observations this mean is exactly Gaussian:
Consequently quadrupling the number of independent readings halves the random standard error. When the true variance is unknown, a small-sample confidence interval for a normal mean uses a Student t-distribution with statistical degrees of freedom; replacing that by a normal quantile can overstate precision. Shared systematic errors and correlations do not decrease by the same averaging rule.
Combining results and fitting models. Independent Gaussian estimates of one quantity, with known variances , combine through the inverse-variance weighted mean
For a model with independent zero-mean Gaussian noise, maximizing the likelihood is equivalent to minimizing the weighted least-squares statistic
For a correct linear model with known independent Gaussian errors and fitted parameters of full rank, the minimized statistic has a chi-squared distribution with degrees of freedom. Nonlinear fits only inherit that familiar approximation under additional regularity and adequate-data assumptions. Known correlated Gaussian errors require the full inverse covariance matrix in the quadratic form.
These properties support confidence intervals, consistency checks, calibration and error propagation. They also give practical diagnostics: inspect residuals for trends, changing spread, correlations or outliers before trusting a Gaussian fit. Gaussian models connect physical fluctuations to quantitative uncertainty, but their assumptions must be checked rather than inferred from the shape of a convenient bell curve.
A chi-squared test compares residuals with the random scatter predicted by a model. For independent measurements with known Gaussian standard deviations and predictions , form
If the mean model and error assumptions are correct, a full-rank linear fit of parameters gives a chi-squared distribution with statistical degrees of freedom. With a fully specified prediction and no fitted parameters, . Nonlinear fits usually make this an approximation. Independent external calibration is not the same as fitting a parameter to these test data.
Under the reference distribution, the mean statistic is and its variance is . The upper-tail p-value quantifies how unusual a discrepancy at least this large would be under the assumed model. A small value suggests model failure or incorrect uncertainties; it is not the probability that the model is true. An unusually small statistic can also reveal inflated uncertainties or correlations. A rejection threshold should be specified in advance.
For independent Poisson distribution counts, the model variance is its expected count . The Pearson chi-squared statistic is . The estimated-error alternative is common for large counts but can differ substantially when counts are small. In that regime the Poisson deviance or a direct likelihood calculation is preferable, with simulation if an accurately calibrated goodness-of-fit probability is required.
A chi-squared test compares squared deviations with the size expected from the assumed random errors. For independent observations with a normal distribution with known standard deviations and predictions , use
For a correct fixed model, the standardized independent residuals are unit-variance normal distributions, so has a chi-squared distribution with . Fitting independent linear parameters removes residual directions, giving . This distribution is exact for a full-rank linear model with known errors with a normal distribution; it is an approximation for many nonlinear fits. With known correlated errors with a multivariate normal distribution, replace the sum by , where is the covariance matrix and its rank and fitted constraints determine the available statistical degrees of freedom.
Under the null hypothesis, and . The reduced statistic should therefore be near one, with standard deviation , rather than equal to one exactly. An upper-tail p-value is
Compare it with a significance threshold chosen in advance. A small value indicates tension with the model together with its error assumptions; it can arise from a wrong mean model, underestimated uncertainties or neglected correlations. An unusually small statistic can suggest overestimated uncertainties, correlations or overfitting. A p-value is not the probability that the model is true, and failure to reject is not proof of the model.
For counts in categories, the Pearson form is . Its chi-squared distribution is an asymptotic approximation requiring adequate expected counts. For a fixed-total multinomial sample there is one normalization constraint, so the usual statistical degrees of freedom are after fitting other parameters. Independent Poisson bins instead start with statistical degrees of freedom before parameters are fitted. Sparse counts require an appropriate count likelihood or a calibrated exact or simulation-based test; plugging tiny expected counts into the asymptotic formula is unreliable. The error model, binning, fitted parameters and chosen test must therefore be reported with the result.
A chi-squared test compares the sum of squared standardized regression residuals with the appropriate chi-squared distribution. With both line parameters fitted, the data give on degrees of freedom, with upper-tail P-value about : the fitted exponential decay model describes the data adequately.
First consider fixing the alternative lifetime at its central value . Its slope is . One must refit the normalization rather than retain the earlier intercept. Minimization over the intercept gives , and
on degrees of freedom, with upper-tail P-value about . Thus that fixed central lifetime gives a substantially worse fit than . Equivalently, the increase after profiling over the intercept is
This fixed-value comparison does not yet include the uncertainty of the alternative measurement.
For the compatibility of independent lifetime measurements, include both errors. Under the approximately Gaussian lifetime-error model, equality of the two true lifetimes is tested by
This has one degree of freedom and P-value approximately , equivalent to a -standard deviation discrepancy. The two measurements are therefore in mild tension: equality is rejected at a significance threshold, but not at . There is no unique yes-or-no compatibility verdict without choosing such a threshold. Treating the alternative central value as exact would overstate the disagreement between the experiments.
The lifetime that provides the best fit to these six rates remains , not . The compatibility calculation above assumes the two experiments have independent uncertainties; a shared systematic error would require its covariance.
Assume independent normally distributed angle errors with known standard deviation . The relevant chi-squared test uses the sum of squared standardized residuals,
For the model through the origin, the predictions and residuals, expressed in milliradians, are
Consequently . There are statistical degrees of freedom. The upper-tail P-value is approximately ; equivalently the value greatly exceeds the critical value . The zero-intercept model is strongly rejected under the stated errors.
For the alternative linear regression, minimize . Setting both partial derivatives to zero gives the normal equations, whose solution is
For these data , , and . This yields
The new predictions are , with residuals . Therefore
The affine model is compatible with the data. Allowing for its additional fitted parameter, the decrease has a chi-squared distribution with one statistical degree of freedom under the nested zero-intercept hypothesis, corresponding to . Thus the model with a fitted intercept provides the better description, rather than merely lowering the residual by adding a parameter.
With the measurement variance treated as known, the coefficient uncertainties are
Hence , about standard deviations above zero. A positive constant systematic error in the angular zero, or an additional nearly constant torque, could account for it. Its presence is evidence against the ideal zero-intercept model; four points alone do not identify the physical cause uniquely. A calibration error in only rescales the inferred gravitational constant and cannot remove this residual pattern.
Using the fitted slope after allowing for this offset would give , with the period and slope errors combined in quadrature. This is conditional on the constant-offset model.
For independent Poisson random variables with known expected counts , the model variance is . The Pearson chi-squared statistic is therefore
There are six independently specified bins and no parameters fitted from them, giving approximately six degrees of freedom. This is far above its expected value six; the approximate chi-squared distribution tail probability is . The discrepancies are much too large for a good Poisson-noise fit. Replacing model variances by the observed-count estimates gives the alternative statistic , with the same qualitative conclusion. There is no fitted normalization to justify subtracting a degree of freedom or rescaling the model to the observed total.
Let be the observed cell counts, the row totals, the column totals and . The fitted expected frequencies under independence are . For example the three-child, one-boy cell has expected count .
The Pearson chi-squared statistic is
Under it has asymptotically a chi-squared distribution with degrees of freedom, assuming the multinomial sampling model and sufficiently large expected counts. All expected counts here are large. The distribution is an asymptotic approximation, rather than an exact finite-sample identity.
Since the true mean is known to be zero, the chi-squared distribution gives . Let be the quantile of this law. The probability
rearranges, using positivity, to the exact confidence interval
There are degrees of freedom, because no unknown mean was fitted.
Up to a parameter-independent multinomial factor, the likelihood function is . A Lagrange multiplier for gives , whence and
Since all counts are positive, the log-likelihood function is strictly concave on the positive simplex and tends to minus infinity at its boundary, proving this is the unique maximum.
Under independence of random variables, , so the log-likelihood function separates as . Applying the same constrained maximization twice gives , , and
Twice the difference between the unrestricted and null maximized log-likelihood functions is
the required likelihood-ratio test statistic. Under the null hypothesis, its asymptotic chi-squared distribution has statistical degrees of freedom, the parameter-count difference . Here that is four. Since , reject independence at the 0.1 percent significance level. For four statistical degrees of freedom, the asymptotic upper-tail probability is . This establishes an association in these data; it is not a causal conclusion.
The moment generating function is wherever that expectation is finite. A useful continuity theorem says that if the moment generating functions are finite on a common open interval containing zero and converge pointwise there to the moment generating function of a probability distribution, then the corresponding variables converge in distribution to that law. Equivalently one may assume a finite limiting function on such a neighborhood, with the usual continuity at zero, and obtain the uniquely determined limiting law.
For the gamma density, integrating the exponential against the density and changing variable to gives
For the waiting time to one head, independence of successive tosses gives for . Summing the geometric series gives
The waiting times between consecutive heads are independent copies of , so their sum has moment generating function . Consequently
For fixed , numerator and denominator have leading terms and as . A fixed neighborhood of zero is inside the convergence domain for all sufficiently small , so the continuity theorem applies. The limiting distribution is
equivalently a chi-squared distribution with degrees of freedom.
Let be row of , viewed as a real vector. These are independent standard Gaussian random vectors, and . The trace expression for the empirical spectral measure gives
We need the norm moments
For completeness, has the chi-squared distribution with degrees of freedom. By independence and the Gaussian integral, its moment-generating function is for . Differentiating at zero once, twice and three times proves these three identities.
For the first moment,
For the second moment, if , conditional expectation given gives , hence an unconditional value . Separating equal and unequal row indices yields
For the third moment, the summand is . There are three disjoint cases.
Consequently
The three limiting expected values are therefore
For fixed , the likelihood ratio is strictly decreasing as increases. A likelihood-ratio test rejects for small , so its rejection rule is equivalently large . Under the null hypothesis, the standard normal distribution and chi-squared distribution results give independent quantities
Their ratio therefore has Student's t-distribution with statistical degrees of freedom. The exact level- rule is
This is precisely the two-sided Student's t-test; choosing the corresponding cutoff for yields the same rejection region and the same p-value.
Let be the cumulative distribution function of a gamma distribution with shape and rate ; explicitly,
The posterior distribution is continuous and has positive density on , so its quantiles give the requested equal-tailed credible interval:
Equivalently, , so the endpoints can be written as the corresponding chi-squared distribution quantiles divided by . Either form excludes posterior probability from each tail.
Let be the likelihood function, with full parameter space and null hypothesis . The generalized likelihood-ratio test compares the best null fit to the best unrestricted fit:
The likelihood ratio lies between zero and one, and small values count against the null hypothesis; equivalently, large values of the likelihood-ratio test statistic count against it.
Compute restricted and unrestricted maximum-likelihood estimates, evaluate their log-likelihoods, and form . Under the regular conditions of Wilks theorem, the null limit is
These statistical degrees of freedom count independent parameter restrictions. The regularity includes a locally identifiable smooth model, nonsingular Fisher information, and an interior null value; parameter-dependent support can invalidate the result.
For a chosen significance level , obtain the quantile of the chi-squared distribution and use
Equivalently, compare the asymptotic p-value to . This is a large-sample calibration; part (c) requires direct treatment because its support depends on a parameter.
The count vector has a multinomial distribution, with likelihood function
Maximize its log-likelihood using a Lagrange multiplier for the sum constraint. The equations and give and . Since all counts are positive and the log-likelihood is strictly concave on the interior of the probability simplex, this is the global maximum-likelihood estimate.
Under the uniform null hypothesis, each category has expected count
The common multinomial coefficient cancels from the likelihood ratio:
Taking minus twice its logarithm gives exactly
There are free category probabilities, because their sum is one, and the null fixes all of them. Thus its regular asymptotic chi-squared distribution has statistical degrees of freedom.
Write and , with . Two exact facts about a normal sample are
and independence of the normal sample mean and sample variance holds. A chi-squared distribution with statistical degrees of freedom is a sum of independent variables, each with mean one and variance two. The central limit theorem therefore gives
For , the derivative at is because . The delta method gives the asymptotic normality of a normal sample standard deviation:
The exact independence of and makes their limiting normal distributions independent. Consequently,
Thus
This has the same leading asymptotic variance as . The weights and are those in the optimal asymptotic combination of a normal sample mean and standard deviation. This does not require to be an exactly unbiased estimator of .
Let . For the exponential distribution with mean , the likelihood function is on positive observations. Fix any . The alternative-to-null likelihood ratio is
Since , this is strictly decreasing in . The Neyman-Pearson lemma says to reject for small . Under the null hypothesis, the given sum rule yields , where the second argument is a rate, and hence
Let be the lower quantile of this chi-squared distribution. The required critical region is
Its test size is exactly because the null distribution is continuous. Its cutoff is the same for every , so it is simultaneously most powerful against every such value: it is a uniformly most powerful test. Equivalently, reject if is below the lower quantile of the specified gamma distribution.