In a normal linear model with residual degrees of freedom , an internally studentized residual satisfies and , provided its leverage is less than one. Choose an orthonormal basis of the residual space with its first direction proportional to the projection of the th coordinate vector. The Gaussian coordinates in this basis are independent standard normal random variables , and . The beta distribution follows from the independent chi-squared distributions of and . The bounded residual is not exactly distributed according to Student's t-distribution; it approaches the standard normal distribution as .
Noncentral t-distribution Created 2026-10-05 Updated 2026-10-18
If and are independent, then has the noncentral t-distribution with statistical degrees of freedom and noncentrality . It describes the test statistic of a Student's t-test under a shifted alternative hypothesis. At it reduces to the Student's t-distribution. This is different from adding a constant to a central Student t-distribution: here the shift is inside the random denominator. For a normal distribution sample tested against null hypothesis , the noncentrality is .
For independent normal random variables with unknown common mean and variance, let and . The standardized future difference is normal with variance and is independent of the residual sum of squares. Thus the ratio using the displayed standard error has Student's t-distribution with degrees of freedom. This is unconditional repeated-sampling prediction coverage, not a confidence interval for the mean.
Pareto distribution Created 2026-10-07 Updated 2026-10-18
The Pareto distribution describes a positive random variable whose tail probability falls as a power law. In the shape–minimum convention used here, has shape parameter and minimum , with probability support . Its probability density function is
The minimum has the same units as ; the shape parameter is dimensionless. At fixed , changing gives a scale family, since . This convention is also used in uniform-Pareto conjugacy.[ref]
The survival function and cumulative distribution function are
For , solving gives the quantile function
Its right-hand limit at is ; it tends to infinity as .[ref] There is no probability mass at : changing a probability density function's value at that single point changes no probabilities.
Choose and as an original theoretical example. Then , , the median is , and the 0.99 quantile is . These chosen values and all figures below describe mathematical probability distributions, not actual wealth observations.
Figure 1.
Pareto survival curves: smaller alpha gives a slower power-law tail
. Details.
On this log-log plot, write to obtain . The slope is , whereas the probability density function has power exponent . Multiplying a threshold by ten divides its tail probability by . A larger therefore concentrates the Pareto distribution nearer ; a smaller makes extreme values more plausible. This exact scaling is useful when modelling large positive losses or sizes over several orders of magnitude.
The Pareto distribution is a heavy-tailed distribution: for every , the exponential moment diverges because eventually grows without bound. In contrast, the Laplace distribution has exponentially decreasing tails and some finite positive exponential moments. The Student's t-distribution also has power tails, but on both sides of the real line, with a smooth central region rather than a positive minimum.
Assume and . Up to a constant, the log-likelihood of the normal sample is
For each , the square is minimized at ; optimizing the remaining one-variable likelihood gives the maximum-likelihood estimators
They are the global maximum when the residual sum is positive, which occurs with probability one. On the exceptional all-equal sample the likelihood increases without bound as .
To derive the distributions and independence, write and perform an orthogonal change of coordinates whose first row is . The transformed components remain independent standard normal random variables, since their joint density depends only on the squared Euclidean norm. Then
The first expression uses only , the second only the other components. Consequently
This also exhibits why the maximum-likelihood variance uses divisor , even though its chi-squared degrees of freedom are .
The independent future observation satisfies . It is independent of the residual sum of squares, because both and are independent of the residual vector. Combining this normal variable with the independent chi-squared variable gives
The event in the proposed prediction interval is equivalent to . By symmetry and continuity of Student's t-distribution, exact joint coverage therefore requires
This is the normal prediction interval with maximum-likelihood variance. The factor cannot be dropped: the interval uses , not the unbiased residual standard deviation. Coverage here is over repeated joint sampling of the old and new observations, not a claim of parameter-free conditional coverage for every realized sample.
Assume , so the slope in this linear regression through the origin is identifiable. Expanding the residual sum of squares gives
Differentiation gives the unique least-squares estimator and its normal distribution:
For , estimate the unknown variance by
The fitted component and orthogonal residual of the Gaussian vector are independent, and has the chi-squared distribution with degrees of freedom. Under the null hypothesis,
The Student t test for regression through the origin rejects at significance level when , where the subscript denotes the corresponding quantile of Student's t-distribution. If all , the data contain no information about ; if , no residual degree of freedom is available for this unknown-variance test.
For independent observations from a normal distribution with unknown mean and positive variance, the maximum likelihood estimation of the mean gives
Indeed , which is minimized at . The likelihood is
For fixed , differentiation in gives the maximizer . Thus the unrestricted fit has , whereas under the null hypothesis the fitted variance is . Both maximize rather than minimize the likelihood: it tends to zero at either variance endpoint when the residual sum of squares is positive.
The restricted-to-unrestricted likelihood ratio is therefore
The generalized likelihood-ratio test rejects for small , equivalently large . Under the null, is standard normal, has a chi-squared distribution with degrees of freedom, and they are independent. To see the independence, apply an orthogonal matrix to the standardized normal sample, taking its first row to be : the transformed coordinates remain independent standard normal variables, and is the sum of squares of the other coordinates. Hence has Student's t-distribution with degrees of freedom.
For this two-sided test at , the cutoff is the percentile of , namely . The data give
Since , do not reject the manufacturer's mean-hardness claim at the level. This is a failure to reject, not proof that the mean equals .
Under the unrestricted model, insert the maximum-likelihood estimates . Under the diagonal-covariance restriction, the quadratic form is minimized over the mean at , and the remaining objective separates over the diagonal entries:
Differentiating in gives ; the derivative changes from negative to positive there. Put . The fitted trace term is under either model, since . Consequently the likelihood-ratio test statistic is determined by
This is the Gaussian diagonal-covariance likelihood-ratio test. Reject for sufficiently small , equivalently for large . Under the regular large-sample calibration, Wilks theorem gives , since diagonality removes that many free covariance parameters. The exact critical constant can instead be obtained from the null distribution at the actual sample size.
For , write the sample correlation coefficient as . Then , so the likelihood-ratio test rejects for large , not merely for large positive . Under the null, the two variables have a bivariate normal distribution and are independent, and the exact test is
Indeed, condition on the centered first-variable observation vector. Decompose the second centered Gaussian vector into its component along that direction and the -dimensional orthogonal complement. Their squared lengths give independent and variables. Their ratio shows that has Student's t-distribution with statistical degrees of freedom.
Assume independent samples and , each consisting of independent normal random variables, with respective means and a common unknown variance . Take . Normality, independence and equal variances are the assumptions giving the exact pooled Student's t-test; unequal variances would require a different test. We test against an unrestricted difference.
Put and
The normal likelihood is proportional to , where is the residual sum of squares. Under the unrestricted model, the maximizing means are and . Under , the maximizing common mean is and decomposition about the sample means gives . For either model, maximizing over variance gives . Thus the generalized likelihood-ratio test statistic is
Small is therefore equivalent to large .
Under the null, is standard normal. In each sample an orthogonal change of Gaussian coordinates separates the sample-mean coordinate from the centered residual coordinates; those coordinates are independent. Consequently has a chi-squared distribution with degrees of freedom and is independent of . Therefore has the Student's t-distribution with degrees of freedom. At significance level , reject exactly when , the two-sample pooled t-test.
Write and . The normal-sample likelihood is
Without the mean restriction, its maximum has and . Under the null, the maximizing variance is . Substituting them gives the generalized likelihood-ratio test statistic
where and . Assume ; almost surely for positive population variance.
The ratio decreases strictly as increases, so rejecting for small is equivalent to rejecting for large . Under , has Student's t-distribution with degrees of freedom. Therefore the exact size- rule is
This is the two-sided Student's t-test. Equivalently reject when . No large-sample chi-squared approximation is needed for this normal-mean likelihood ratio with unknown variance.
The ordinary least squares estimate, which is also the maximum-likelihood estimate in this normal linear model, gives the hat matrix
It is the orthogonal projection onto the column space of , so , and . Since , the vector of regression residuals is , with multivariate normal distribution
For , its covariance is , which is generally nonzero. Therefore the regression residuals are generally dependent, even though the original errors are independent random variables.
Fit the model in R, compute its internally studentized residuals with rstandard(fit), and examine a normal Q-Q plot with qqnorm(rstandard(fit)) and qqline(rstandard(fit)). A plot of these regression residuals against the fitted values helps detect a curved mean pattern or nonconstant variance. Approximate agreement with a straight line in the Q-Q plot, with no systematic residual pattern, supports the assumed error model.
Here . The average leverage is , and . Thus most diagonal corrections and most off-diagonal dependences are small when only a few directions have been removed from a large sample. Also estimates accurately when is large. These facts make the visual independent-normal approximation reasonable, though exceptional high-leverage observations still deserve attention.
The approximation is not an exact distributional statement: the distribution of an internally studentized Gaussian residual has when and . In particular these residuals are bounded, rather than exactly distributed according to Student's t-distribution. Formal goodness-of-fit calibration should account for fitting and dependence.
Use a normal linear model
The distance and climb are treated as fixed predictors; the assumptions are a linear conditional mean, independent errors with common variance, and normal errors for the exact tests. Fit by ordinary least squares using
hills.lm1 <- lm(time ~ dist + climb, data = hills)
The overall null hypothesis is , against at least one nonzero slope. The intercept-only and full models have respectively 34 and 32 residual degrees of freedom. Under the null, the F-test statistic is
The displayed residual sums are rounded; use the reported statistic for the test. Its upper-tail p-value is below , so reject the no-relationship hypothesis overwhelmingly. At least one predictor adds information beyond a constant mean.
In the coefficient table, Estimate gives one of the ordinary least squares estimators, Std. Error is the estimated standard deviation of that estimator, t value is the estimate divided by its standard error, and the last column is the two-sided p-value for a zero coefficient. Under the corresponding null, the statistic has a Student's t-distribution with 32 degrees of freedom. The fitted mean is
At fixed climb, an extra mile predicts about 6.22 extra minutes; at fixed distance, an extra foot of climb predicts about 0.01105 extra minutes. Both slopes have strong evidence of being positive. Specifically the climb test uses and , so climb remains significant after controlling for distance. The intercept differs from zero at the 5% level, but extrapolating to a zero-distance, zero-climb race has no useful physical interpretation.
The regression diagnostics show a very large positive residual for Knock Hill and a smaller positive outlier for Bens of Jura. The Q-Q plot has a pronounced upper tail, contradicting the assumed normal-error pattern. These observations can distort both the fitted coefficients and the estimated error variance. Check the source records, units, transcription and any unusual race conditions first, especially for Knock Hill; correct a demonstrated data error and refit. If the records are valid, consider omitted terrain effects, nonlinear distance/climb effects, a suitable response transformation or robust regression, and compare fits with and without influential observations. A diagnostic outlier alone is not a reason to silently delete a valid record.
Conditional on , let and independently . The normal distribution with the stated precision parameter can be generated as
Therefore
by the defining normal distribution and chi-squared distribution representation of Student's t-distribution. Its density is
Thus is the location and is the scale, not the standard deviation: . Each study gets its own independent chi-squared draw in this Student t random-effect model.
Write . Minimizing the residual sum of squares first over the coefficients of reduces the problem to minimizing . Full column rank ensures . Thus the partial regression formula and its variance are
This uses and the isotropic error covariance matrix .
Since the span of is contained in the column space of , orthogonal projection onto the latter removes at least as much squared norm. Consequently
and inversion proves the requested lower bound. Full rank makes the denominator positive.
Adding to column leaves the column space unchanged. Every old fitted vector is reproduced by keeping all slopes unchanged and replacing the regression intercept by . Uniqueness of the ordinary least squares estimators then proves that slope is unchanged. In particular all columns can be centered by such changes. Applying the previous projection argument to the centered design proves the bound with and ; the normalized inner product is now the usual sample correlation.
Each reported coefficient test is the two-sided Student's t-test of against , conditional on the other predictors. Under the null, has a Student's t-distribution with degrees of freedom. At five percent the intercept is significant, but neither individual test slope is. The final F-test compares the full model against an intercept-only model: . It has degrees of freedom and rejects at five percent, since its -value is . Thus the predictors jointly explain variation, without strong evidence separating their individual conditional effects.
The two test predictors have sample correlation , although each has only moderate correlation with the final exam response. The variance inflation factor is . Their nearly shared direction produces substantial multicollinearity, inflating the individual slope standard errors. The joint F-test can detect this common predictive direction even though either coefficient, given the other, has a large -value.
Put for the unrestricted fit. Under , the best slope is still because the design is centered. Orthogonality of the residuals to the constant vector gives
At either fitted mean, the maximum-likelihood estimator of variance is . The ratio used by the generalized likelihood-ratio test is consequently
Small likelihood ratios correspond to large . Under , part (a) gives independent and . Thus has the Student's t-distribution with degrees of freedom. The exact size-5% critical region is
where is the 97.5th percentile of that distribution. The denominator uses the unbiased residual variance estimate, not the likelihood variance denominator .
Under an alternative, the same statistic has the representation
The joint law of is parameter-free, and has disappeared. Therefore
where . This is also the noncentral t-distribution description of the power. As explained in part (a), an exact residual-based test requires .
For a new independent tumour grown for ten days in B, use . Its fitted mean is
Write . The prediction interval in a normal linear model is
where and is the indicated Student's t-distribution quantile. The design information needed to evaluate is not supplied, so a fully numerical interval cannot be recovered from the coefficient standard errors alone: the coefficient covariances are also needed.
To prove coverage, write , with independent of the original sample. The error has a normal distribution with mean zero and variance . By the joint distribution of least-squares and variance estimators, and is independent of ; it is also independent of . Hence the pivotal quantity
Consequently , which is exactly the claimed prediction interval coverage. This is repeated-sampling coverage conditional on the design, assuming the model; it need not hold conditional on the particular observed training responses. The extra represents new-observation noise and must not be omitted as in a mean confidence interval.
Check that the chosen mean structure adequately describes the transformed response. Examine the residual-versus-fitted plot and residuals versus each predictor: systematic curvature suggests omitted nonlinear effects or an interaction term. Plot residual spread against fitted values, for example using a scale-location plot, to assess homoscedasticity. Compare standardized residuals with a normal distribution using a quantile-quantile plot, especially for finite-sample Student's t-distribution and F-test inference.
Also check independence using the sampling design and residuals versus time, collection site, or other groups; spatially related photovoltaic systems may have correlated errors that are invisible in a residual-versus-fitted plot. Investigate large standardized regression residuals, high regression leverage, and influential observations using Cook's distance. Check that the design matrix has full rank and that severe multicollinearity is not making estimates unstable. Reassess whether the response transformation and retained predictors improve these diagnostics and prediction; a coefficient p-value alone cannot establish model adequacy. If observations are independent only conditional on site effects, use an appropriate dependence model rather than treating correlated systems as independent replicates.
Use the usual normal linear model , with fixed full-column-rank design , , and . These Gaussian distribution and constant-variance hypotheses are necessary for an exact finite-sample Student's t-test. Put and . The vector of ordinary least squares estimators satisfies
With , the test statistic is
Under the null hypothesis, has Student's t-distribution with degrees of freedom. A two-sided level- Student's t-test rejects when . If the intended test is one-sided against , it rejects when ; the statistical power conclusion below holds for either convention.
Under a correctly specified Poisson regression with adequate expected counts, the residual Poisson deviance is approximately chi-squared distribution with residual degrees of freedom. The observed gives
Thus the ordinary Poisson model gives a very poor fit under this goodness-of-fit approximation. This is consistent with overdispersion, although a wrong mean model or dependence can also cause lack of fit; quasi-Poisson variance inflation alone does not establish that the mean model is adequate.
For Quasi-Poisson regression, . The Pearson dispersion estimator is
It uses squared Pearson residuals, not the residual deviance divided by 102. The fitted coefficients are unchanged, and their estimated covariance matrix is multiplied by . With , standard errors increase by , so the main treatment coefficient has
The main Progabide coefficient is not significant at 5% after this dispersion adjustment. R uses a Student's t-distribution when dispersion is estimated, as described in its GLM summary documentation; the large-sample normal approximation also gives the same decision.
Because an interaction term is present, this tests the treatment contrast at baseline zero. An overall absence of treatment influence requires the joint null . The printed marginal standard errors do not give their covariance, so they are insufficient to calculate that joint Wald test, or the treatment contrast test at an arbitrary nonzero baseline.
Combining the independent standard normal variable with the independent chi-squared variable gives
the Student's t-distribution with degrees of freedom.