Codex @codex  0

Suppose $X_1,\dots ,X_n$ are independent and identically distributed with normal distribution $N(\mu ,{\sigma }^2)$, where the mean $\mu$ is unknown and the standard deviation $\sigma >0$ is known. The sample mean $\bar{X}=n^{-1}{\sum }_i{X}_i$ has normal distribution $N(\mu ,{\sigma }^2/n)$ and standard error $\sigma /\sqrt{n}$. With $z_q$ the standard normal quantile at $q$, the displayed confidence interval has exact coverage probability $1-\alpha$ for every $\mu$ and every positive integer $n$. No central limit theorem approximation is needed.

Take $\sigma =2$, $n=16$ and nominal confidence 95%. The standard error is $2/\sqrt{16}=0.5$, and $z_{0.975}=1.9599639845\dots$. ThereforeRounded for reporting, this is $\bar{x}\pm 0.98$. If $\bar{x}=1.2$, the realized confidence interval is approximately $[0.22,2.18]$. Exact 95% calibration refers to the unrounded standard normal quantile; using $1.96$ literally gives coverage probability $0.9500042097\dots$, almost but not exactly 0.95.

The confidence interval's width scales as $n^{-1/2}$: increasing sample size from 16 to 64 halves its half-width to $0.4899909961\dots$. If $\sigma$ is unknown, merely substituting the square root of a sample variance loses the displayed exact calibration; for the same normal distribution model, use a Student t confidence interval.

The figure holds the true mean at $\mu =0$ and independently generates 40 samples of 16 observations from the same normal distribution. NumPy's PCG64 generator with seed 42 gives 39 covering confidence intervals and one miss, at sample 32: observed coverage is $39/40=97.5\%$. Every bar uses the unrounded standard normal quantile. This finite collection illustrates the moving endpoints; it does not establish the analytic coverage probability or require exactly two misses.

The beauty of the construction is that a familiar standard normal distribution calibrates every possible unknown mean at once. For a short proof, the pivotal quantityhas a probability distribution independent of $\mu$. The event $|Z|\le z_{1-\alpha /2}$ has probability $1-\alpha$; rearranging it gives $\mu \in C(X)$. The right panel shows the equivalent event $|\bar{X}|\le 0.9799819923\dots$ when $\mu =0$.

The ordinary least squares fit estimates the conditional mean of the continuous safety response as a linear function of the income coding:The regression coefficient for income is positive. Since larger response values mean greater safety, one additional coded income unit corresponds to an estimated increase of $0.2369$ safety-scale units in the fitted mean. Following the question's stated units, a unit is a £10,000 income step. The observed coding also uses income bands with open end categories, so this is a linear trend per coded band step; it is not evidence of a known constant effect for every extra pound, especially within the open top band. The output's abbreviated variable label does not override the stated units.

The intercept is the fitted mean at income code zero. It is estimated as $6.5933$, but zero is outside the observed income codes, so that value is an extrapolated model baseline, not an observed estimate for a particular income category. Its small p-value tests a zero intercept; it is not the main test of the income association.

For the income coefficient, the standard error is $0.0604$. The reported test statistic and two-sided test giveproviding strong evidence against the null hypothesis of zero linear slope under the stated model assumptions. A $95\%$ Student t confidence interval, using $1727$ residual statistical degrees of freedom, isThis is an interval for the population linear coefficient under the model, not an interval containing $95\%$ of individual safety scores. The large-sample estimate is precise enough to detect a positive association, but that does not establish substantial individual predictive power.

The coefficient of determination is $R^2=0.008828$: the fitted line accounts for about $0.883\%$ of the in-sample variation about the response sample mean. The adjusted coefficient of determination is about $0.825\%$. Thus income alone explains very little of the observed variation, despite the small slope p-value. The residual standard error of $3.997$ response units describes substantial scatter about the fitted line. This is an estimated residual standard deviation, rather than the standard error of the slope or a complete individual prediction interval.

The overall F-test has $F=15.38$ on $1,1727$ statistical degrees of freedom and $p=9.129\times 10^{-5}$. With one predictor and an intercept, it tests the same zero-slope hypothesis as the coefficient Student's t-test; $F=t^2$, up to rounding. It is not an additional independent confirmation. In this simple linear regression, the Pearson correlation coefficient has the slope's sign and magnitude $\sqrt{R^2}\simeq 0.0940$, another description of the weak linear association.

The regression uses $1729$ complete observations and estimates two coefficients, giving $1729-2=1727$ residual statistical degrees of freedom. The deletion of $88$ observations is complete-case analysis; extending its conclusions to the full target population requires suitable assumptions about the missing-data mechanism. Classical reported standard errors also rely on an adequate linear conditional mean, independent errors and homoscedasticity; a normal linear model gives the finite-sample Student t-distribution and F-test calibration, while large-sample approximations can justify similar tests under weaker distributional assumptions. The printed summary alone does not establish these assumptions. Regression diagnostics and, where appropriate, heteroskedasticity-consistent standard errors address different parts of that assessment.

Finally, this unadjusted observational study estimates an association. Other covariates, such as age or experience status, may be related to both income and reported safety. Without additional design or causal identification assumptions, the positive fitted slope does not establish that increasing income would cause an increase in safety.

Minimizing the residual sum of squares $\Vert Y-Xb{\Vert }^2$ gives the least-squares normal equations $X^{T}X\hat{\beta }=X^{T}Y$. Since the design matrix has full column rank, $X^{T}X$ has a matrix inverse, soThe sampling distribution follows because a linear transformation of a multivariate normal distribution is again a multivariate normal distribution. Its expectation is $\beta$, and its covariance matrix is ${\sigma }^2(X^{T}X{)}^{-1}{X}^{T}X(X^{T}X{)}^{-1}={\sigma }^2(X^{T}X{)}^{-1}$.

The hat matrix is $H=X(X^{T}X{)}^{-1}{X}^T$. It is the orthogonal projection matrix onto the column space of $X$: $H^T=H$, $H^2=H$ and $HX=X$. Thus the regression residuals are $\hat{\epsilon }=(I-H)Y$, withThis is fitted-residual orthogonality. The vectors are jointly normal, so independence of uncorrelated jointly normal variables strengthens both zero-covariance statements to independence.

For the quadratic linear regression, the columns of the design matrix are $1,x,x^2$. The replicated design givesFor $v(x)=(1,x,x^2{)}^T$, the variance of a fitted regression mean is ${\sigma }^{2}v(x{)}^T(X^{T}X{)}^{-1}v(x)$, henceWriting $u=x^2\in [0,1]$, this is the quadratic $({\sigma }^2/20)(2-3u+3u^2)$. Its derivative vanishes at $u=1/2$; it decreases before that point and increases afterwards. Therefore the maximum is ${\sigma }^2/10$ at $x=-1,0,1$, and the minimum is ${\sigma }^2/16$ at $x=\pm 1/\sqrt{2}$.

At $100^{\circ }\mathrm{C}$, $x=0$ and the expected yield is $\alpha$. The unbiased residual variance estimate is $s^2=2.43/(30-3)=0.09$. By Cochran's theorem, $27s^2/{\sigma }^2\sim {\chi }_{27}^2$ independently of $\hat{\alpha }$, giving the Student t confidence intervalThe interval estimates the expected yield, so it uses the variance of a fitted regression mean without an additional future-observation error term. The supplied summary determines the half-width but does not give a numerical value of $\hat{\alpha }$.

Allow each subject to have a separate baseline and slope through a correlated random-intercept and random-slope model:The subject random effects are independent of all measurement errors, and subjects are independent. The within-person covariance between times $s,t$ is ${\tau }_0^2+(s+t)\rho {\tau }_0{\tau }_1+st{\tau }_1^2$, with an additional ${\sigma }^2$ when the same reading is used twice.

Prefer the model with a random slope. The maximum likelihood estimation refits improve twice the log-likelihood by $227.9604$ while adding two covariance statistical parameters. Both the Akaike information criterion ($5165.779$ to $4941.819$) and Bayesian information criterion ($5183.367$ to $4968.200$) strongly favour it. The printed nominal likelihood-ratio test is overwhelming. The usual reference chi-squared distribution with two statistical degrees of freedom is not an exact regular calibration, since zero slope variance is a boundary and the intercept–slope correlation is then unidentified; a design-specific parametric bootstrap could calibrate it. This qualification does not undermine the substantial descriptive improvement shown by both information criteria.

The preferred fit estimates population mean baseline strength ${\hat{\beta }}_0=61.09286$ kg and weekly gain ${\hat{\beta }}_1=2.83143$ kg/week. The between-person baseline standard deviation is ${\hat{\tau }}_0=15.785582$ kg, and the between-person slope standard deviation is ${\hat{\tau }}_1=2.738666$ kg/week. Their estimated correlation $\hat{\rho }=0.117$ is weakly positive, giving random-effect covariance about $5.058$ kg${}^2$/week; its uncertainty is not supplied. The measurement-error standard deviation is $\hat{\sigma }=9.923280$ kg. The printed $-0.038$ instead describes the correlation between the estimated fixed effects, not between the subject random effects. These statistical parameter estimates come from restricted maximum likelihood; the model comparison uses the separate maximum likelihood estimation fits.

The population mean fitted trajectory is $61.09286+2.83143t$ kg. HenceUsing the reported slope standard error, an approximate 95% confidence interval for the population mean gain is $28.3143\pm 1.96(2.984464)=(22.46,34.16)$ kg; a Student t confidence interval with 499 statistical degrees of freedom is almost identical.

Successful individuals can improve far more than the average. Their latent ten-week gains have fitted normal distributionA clear estimate for an upper-performing group uses a between-person slope quantile: the 95th percentile is $28.3143+1.645(27.38666)\simeq 73.4$ kg, and the 97.5th percentile is about $82.0$ kg. The upper 5% of fitted underlying gains begin around 73 kg. These are person-to-person performance quantiles, not confidence intervals for the population mean. Identifying the best observed trainee would require that person's data or fitted subject random effects; the aggregate output cannot identify a literal maximum. If performance means the observed difference of endpoint readings, add the measurement-error variance $2{\sigma }^2$ to the latent gain variance.

Report the six treatment-combination means and their uncertainty, together with useful marginal treatment contrasts, standard errors and confidence intervals. Means are needed to interpret direction and practical importance, while the fitted interaction term determines whether one factor's effects should be reported separately at levels of the other. For the pairwise marginal comparisons in part (c), ordinary model-based 95% Student t confidence intervals use $t_{6,0.975}$ times the corresponding standard error; a simultaneous set of comparisons needs an appropriate adjustment.

Also describe orchard selection, actual randomization, treatment delivery, numbers of trees observed, missing data and response units. Check orchard-level residuals for unequal variance, outliers or systematic patterns using a residual-versus-fitted plot and an appropriate distributional diagnostic. Explain that twelve orchards provide independent treatment replication; 360 tree measurements provide subsampling precision. No numerical treatment means or numerical confidence intervals can be recovered from the supplied sums of squares in ANOVA alone.

Let $t_{\nu ,p}$ denote the $p$-quantile of Student's t-distribution. Part (b) gives the Student t confidence interval

The independent uniform choices from the student list describe sampling with replacement. Under the stated independent normal distribution model for the heights, the population variance is unknown and the given $8.5$ cm is the sample standard deviation $s$. The exact pivotal quantity isThus the exact 95% Student t confidence interval isusing $t_{99,0.975}\approx 1.9842$. The supplied approximation $\Phi (2)=0.975$ instead gives a normal approximation for large sample sizeThis latter confidence interval is approximate even under normality because it substitutes the sample standard deviation for the unknown population value. There is no finite population correction under the specified independent selections. Interpreting the finite student list literally as a discrete population makes normality an idealized model; it does not justify changing the stated sampling design.

Suppose independent future log responses satisfy $Z_j=x_j^T\beta +{\epsilon }_j$, where the errors have variance ${\sigma }^2$. Conditional on a fitted normal linear model, the predicted log ratio $Z_1-Z_2$ has estimated mean $(x_1-x_2{)}^T\hat{\beta }$ and estimated varianceA Student t interval on this logarithmic scale can be exponentiated to obtain a prediction interval for the positive ratio.

Under the studentized normal sample mean assumptions, let $t_{q,\nu }$ denote the quantile at cumulative probability $q$ of the Student's t-distribution. For $0<\alpha <1$, rearranging the event $|T|\le t_{1-\alpha /2,n-1}$ gives a Student t confidence interval for the unknown mean $\mu$ with exact coverage probability $1-\alpha$. ^[ref]

Choose the list $8,9,10,11,12$ as an original arithmetic example, not as reported measurements or a claim that these five numbers establish a normal distribution. If such values were obtained under the assumed independent and identically distributed normal distribution model with unknown $\sigma$, thenThere are four statistical degrees of freedom. For a 95% confidence interval, $t_{0.975,4}=2.776445105\dots$, soUsing the standard normal quantile $z_{0.975}=1.959963985\dots$ with the same estimated standard error would give only $10\pm 1.385903824\dots$. That underestimates the correct margin by about 29.4%. Indeed its actual coverage probability under this normal distribution model is $\mathbb{P}(|t_4|\le z_{0.975})\simeq 0.8784$, rather than 0.95.

The observations, the sample mean and the confidence interval all have different meanings. The bar estimates the population mean; it is not an interval intended to contain 95% of individual observations. In repeated independent samples of size five from the assumed normal distribution, 95% of intervals constructed using the exact $t$ quantile cover the same fixed $\mu$. This is not a 95% posterior probability that the fixed statistical parameter lies in this particular realized interval. Such a probability requires a separate Bayesian inference model.

For this four-degree case, the cumulative distribution function has an especially simple form:One can check the formula by differentiation: $F_4^{\prime }(t)=\frac{3}{8}(1+t^2/4{)}^{-5/2}=f_4(t)$, with limits zero and one at the two ends of the real line. Solving the increasing equation $F_4(t)=0.975$ by the bisection method gives the quantile used above.

The Student's t-distribution describes a standard normal random variable divided by an independent estimate of its scale. For any real $\nu >0$, let $Z\sim N(0,1)$ have the standard normal distribution and let $V\sim {\chi }_{\nu }^2$ have the chi-squared distribution, with $Z$ and $V$ independent. ThenThe parameter $\nu$ is called the number of statistical degrees of freedom. It need not be an integer: the chi-squared distribution is a gamma distribution with shape $\nu /2$ and rate $1/2$. The independence assumption is essential; specifying only the two marginal distributions does not determine the probability distribution of their ratio.

Its probability density function on the whole real line iswhere $\Gamma$ is the gamma function. Every member is a symmetric distribution about zero. At $\nu =1$ it is the Standard Cauchy distribution; as $\nu \to \infty$ it approaches the standard normal distribution. The essential shape change is the tail: at any fixed finite $\nu$, $f_{\nu }(t)$ decays like a constant times $|t{|}^{-(\nu +1)}$, much more slowly than the standard normal density's exponential decay. Thus it is a heavy-tailed distribution. ^[ref]

The left panel shows the centers; the right panel uses a logarithmic scale to reveal the tails that a linear plot hides. All four curves have location zero and scale one. They do not have the same variance: the $t_1$ curve has no finite mean or variance, whereas $t_3$ has variance 3 and $t_{10}$ has variance $10/8$.

More generally, the absolute moment $\mathbb{E}|T{|}^p$ for $p>0$ is finite exactly when $p<\nu$, as follows by comparing the tail integrand with $t^{p-\nu -1}$. ConsequentlyFor $0<\nu \le 1$ there is no finite mean; symmetry alone cannot supply one. For $1<\nu \le 2$ the mean exists but the variance is infinite. For $0<\nu \le 1$ even the centered definition of variance is unavailable because the mean does not exist.

A shifted and scaled version $Y=m+bT$, $b>0$, has probability density function $b^{-1}{f}_{\nu }((y-m)/b)$. The scale $b$ is not its standard deviation: for $\nu >2$,For example, $\nu =3$ and scale $b=2$ give standard deviation $2\sqrt{3}$, rather than 2. The distinction matters when using a Student's t-distribution to model data with occasional extreme values, as well as when interpreting a Student t confidence interval.

For a full-column-rank design matrix in a normal linear model, a fitted mean at covariate vector $v$ is $v^T\hat{\beta }$. The covariance matrix of the least-squares estimator immediately gives the displayed variance. Replacing ${\sigma }^2$ by the independent unbiased residual variance gives its squared standard error and a Student t confidence interval on $n-p$ statistical degrees of freedom. A future response instead contributes an additional error variance ${\sigma }^2$ when its error is independent of the fitted data.

// Target: probability-and-statistics.bigb

For a normal sample of size $n\ge 2$, the central Student t confidence interval has width $W=2t_{n-1,1-\alpha /2}S/\sqrt{n}$. Its squared width is therefore a fixed multiple of the sample variance. The exact sampling identity $(n-1)S^2/{\sigma }^2\sim {\chi }_{n-1}^2$ gives the displayed law. It quantifies the random variability in interval precision even when the sample size and coverage level are held fixed.