Solution

ID: past-exam-of-the-physics-a-course-of-the-university-of-cambridge/2012/paper-1/section-d/d12/a/solution

A chi-squared test compares discrepancies with their expected random size. For independent Gaussian observations with known standard deviations, a fitted model gives
Under a correct regular model with fitted parameters, its reference statistical degrees of freedom are usually . Correlated errors instead require with the correct covariance matrix. The reduced statistic has mean about one and standard deviation , so it should not be forced to equal exactly one.
For binned counts, Pearson's statistic is . With a fixed total and populated categories, fitting distribution parameters generally gives . The approximation needs adequately populated expected bins and the appropriate dependence assumptions. Sparse data may require a Poisson likelihood, exact calculation or simulated reference distribution rather than a casual chi-squared approximation.
The upper-tail probability measures how unusual the discrepancy would be under the null model; it is not the probability that the model is true. A large statistic can indicate a wrong model, underestimated noise or unmodelled systematic effects; an unusually small one can indicate overestimated errors or correlations. Residual plots and checks of the noise model are needed alongside the numerical test.

New to topics? Read the docs here!