Arrhenius equation 2026-10-13
The Arrhenius equation models the temperature dependence of a rate constant byHere is the pre-exponential factor, the activation energy, the molar gas constant, and the absolute thermodynamic temperature. In its original form, and are held constant over the range being modeled. It is an empirical relationship, not a universal rule for every reaction mechanism. See the Arrhenius equation.
Eliminating between two positive temperatures gives the useful predictionFor , warming increases . The logarithmic sensitivity is , so there is no universal doubling per ten degrees. The same rise from to gives a factor for , versus for .
The useful simplification is that a strong change in reaction rate becomes a straight-line relation after changing variables. Measurements at several temperatures can estimate the slope and test whether one pair of constants describes the chosen range. Curvature can indicate a failure of that approximation; fitting a line does not uniquely establish a microscopic reaction mechanism.
Svante Arrhenius's 1889 paper on sucrose conversion through catalysis by a chemical acid compared the strong observed temperature dependence with the much smaller increase in collision frequency. He discussed van't Hoff's earlier temperature relations and proposed a small population of hypothetical active sucrose, replenished from ordinary sucrose, to interpret the dependence. The inspected translated excerpt derives an inverse-temperature relation in its equations (6)–(7) and then applies it to the reaction rate. That historical hypothesis is distinct from a modern transition state description. See the On the Reaction Velocity of the Inversion of Cane Sugar by Acids. The excerpt omits parts of the original paper; it does not provide a complete original apparatus description or dataset.
The pre-exponential factor must have the same units as the rate constant, since the exponential function supplies a dimensionless quantity. For a rate law , both and have units . Thus a first-order reaction uses , whereas a second-order reaction uses . Calling a frequency factor does not give it frequency units for every order of reaction. Its value includes the physical and geometrical factors allowed by the chosen reaction mechanism; equal activation energies need not mean equal reaction rates.
Synthetic Arrhenius plots: a constant pre-exponential factor and a temperature-dependent pre-exponential factor
. Both chosen first-order reaction models have and the same exponent parameter . Blue uses a constant pre-exponential factor; orange multiplies it by . All markers are synthetic evaluations, not observations. Left: natural logarithm of against . Right: the corresponding apparent activation energies, and in . The dashed orange tangent at has numerical slope on the displayed horizontal scale. Details.To read the blue Arrhenius plot, define the dimensionless quantity and . Its numerical slope is , giving . The slope against , by contrast, is . The orange tangent at gives ; its finite-interval slope between and gives about . The distinction between a local derivative and a fitted interval matters even with perfectly noise-free synthetic evaluations.
Two measured positive rate constants give a two-point estimateSeveral temperatures let linear regression test the constant-parameter approximation: inspect the regression residuals, keep the same rate law and composition convention, and account for uncertainty in both and . A straight line over a short range supports a useful local approximation; it does not uniquely identify a reaction mechanism. A fixed change of units or of shifts the intercept without changing the inferred activation energy.[ref]
12.5 Collision Theory. §12.5, Example 12.13 and alternate two-point approach: estimating activation energy from a slope
Coefficient of determination Created 2026-10-06 Updated 2026-10-14
In an ordinary least squares regression with an intercept and a nonconstant response, . It measures the fitted proportion of sample variation relative to an intercept-only baseline. It increases when regressors are added, even if those regressors are unhelpful for prediction. A high value does not establish the assumptions of a normal linear model or rule out a systematic regression residual pattern.
For the five-point example in linear regression, the total centered sum of squares is and the residual sum of squares is , so . This summarizes the fitted reduction in squared error. It does not record the order or shape of the regression residuals, which are worth examining in a residual-versus-fitted plot.
Here is a fully constructed illustration. Use and the same fitted line for both datasets. Add respectively the residual vectorsBoth sum to zero, both have zero inner product with , and both have squared norm . Their ordinary least squares fit is therefore exactly the same line, with the same . But the first residual is , a systematic quadratic shape, while the second changes direction across the predictor values. These examples show directly which information the scalar discards; neither constructed pattern proves a random-error model.
A concrete laboratory route to an Arrhenius plot is to infer a rate constant at each controlled temperature from a changing electrical conductivity. The Technical University of Munich's Activation Energy of a First-Order Reaction supplies a teaching protocol, rather than a published set of measured rate constants.
The manual follows tertiary amylbromide conversion, which produces conducting ions. A measuring cell connects to a thermostat; an immersed electrical conductivity probe also measures solution temperature, and a magnetic stirrer mixes it. Use of by volume ethanol in water, equilibrate, then add of tertiary amylbromide. Record the baseline before addition and set time zero at addition. Repeat with fresh mixtures at , , and , each within ; record for minutes at the first two temperatures and until completion at the last. Clean the cell between runs and keep the added volume fixed. The completed mixture supplies endpoint electrical conductivity measurements at the other temperatures: one endpoint reading cannot be used unchanged at every temperature.[ref]
Activation Energy of a First-Order Reaction. pp. 82–84, §§8.2.5–8.3.2, and p. 85, §8.5.1: reaction, apparatus, temperatures, endpoint and baseline
To see what is inferred from the readout, let , , and be the baseline, current, and completed-mixture electrical conductivities at the same temperature. Assume their baseline-subtracted changes are proportional to converted concentration. Combining that measurement model with a first-order reaction givesThus the electrical conductivity increases toward an endpoint, while the remaining reactant fraction decreases. Fit against time to obtain ; then fit against in kelvin to estimate an apparent activation energy. This baseline-aware derivation states the measurement assumptions explicitly; it does not infer a rate constant from the steepness of a raw conductivity trace alone.
The controls distinguish a faster chemical reaction from a larger instrumental response. Measure the actual solution temperature, retain the same solvent composition and initial reactant concentration, and compare endpoint and baseline at that temperature. As further diagnostic checks, repeat runs and inspect regression residuals for departure from a first-order reaction. These checks follow from the model: electrical conductivity also depends on how ions move, a baseline drift can mimic conversion, and a mixing delay can distort early points. Near completion, a small endpoint error produces a large relative error in and its natural logarithm. A successful fit supports an apparent rate model for this solvent and interval; it does not directly image a transition state or identify a unique reaction mechanism. No measured or is supplied here.
Fitted-residual orthogonality 2026-10-06
For a full-rank ordinary least squares design matrix, the hat matrix and residual projection satisfy . Hence fitted values and regression residuals are perpendicular as observed vectors. Under isotropic errors their cross-covariance matrix is zero, and under a normal linear model the two vectors are independent.
Fitted values Created 2026-09-24 Updated 2026-10-14
Fitted values are the predictions at the predictor values used to fit a regression model. In linear regression with an explicit regression intercept,Here is the slope design matrix, and is the regression residual vector. The fitted values estimate the regression function at the observed predictors; they need not equal the observed responses, which may also contain random errors. Prediction at a new predictor vector uses with the same centering and scaling used in fitting. A prediction interval addresses uncertainty in a new response rather than just displaying this point prediction.
For the five constructed observations in linear regression, ordinary least squares gives fitted values . The ridge regression fit at instead gives . Both fitted vectors have sample mean because the regression intercept is unpenalized; their regression residuals differ and their residual sums of squares are and , respectively.
For ordinary least squares, the fitted values are the orthogonal projection of onto the column space of the complete design matrix, including its regression intercept column. They remain unique even in rank-deficient ordinary least squares, although the regression coefficients can be nonunique. The regression residuals are then orthogonal to every column.[ref]
Regression 1: Different perspectives. slides 6–10: fitted values, hat matrix, projection and orthogonal residuals
With centered slopes, ridge regression instead satisfies , so the regression residuals need not be orthogonal to the slope columns. Their sum is still zero because the regression intercept remains free.For fixed predictors and scales and a fixed positive penalty, ridge regression gives a linear smoother,For with at least one nonzero slope direction, this matrix is not an orthogonal projection matrix: applying it twice shrinks that direction again. Its effective degrees of freedom are , where are the positive singular values of ; the extra counts the free regression intercept. If the penalty is selected using , the resulting fitting rule need not be a linear smoother, since its chosen also depends on .
Laplace median robustness example 2026-10-18
Choose the five numbers as an original illustration. Their sample median is 2 and their sample mean is 4. The sum of absolute losses at the sample median isIf these numbers were modeled as an independent and identically distributed Laplace distribution sample, the joint maximum-likelihood estimates would therefore be and . Using the sample mean instead gives , so it does not maximize this likelihood function.
Now replace only 10 by 100. The sample median stays at 2, while the sample mean becomes . The minimized sum of absolute losses rises to , and the fitted scale rises to . Stability of the fitted location therefore does not mean stability of every fitted parameter.
The left panel subtracts each objective's minimum so the two absolute loss curves can be compared despite the different totals. The right panel tracks the sample mean and sample median as the largest chosen value changes. This is an outlier sensitivity illustration, not actual observations or a check that a Laplace distribution fits any population. In applications, regression residuals and the data-generating assumptions need separate examination; a stable sample median alone does not validate a statistical model.
Laplace regression Created 2026-09-24 Updated 2026-10-18
For linear regression with fixed predictor vectors , assume conditionally independent responses with a common scale :Each conditional median and mean is . The log-likelihood function is , so maximum likelihood estimation minimizes the sum of absolute regression residuals:This is least absolute deviations. With only an intercept, it reduces to the Laplace location and scale maximum likelihood problem, so a sample median is a fitted intercept. Provided the minimum , the scale estimate is ; the conditional standard deviation is . If the scale is denoted instead of , the conditional standard deviation is .
Minimizing a sum of absolute losses does not automatically give a unique coefficient vector. Even an intercept-only fit to an even sample size can have an interval of solutions, and redundant predictor columns can introduce further nonuniqueness. If a fit makes every regression residual zero, the joint likelihood function is unbounded as , so there is no finite joint maximum-likelihood estimate with positive scale.
The linear growth of absolute loss limits sensitivity to an extreme response at fixed predictors compared with squared-error loss. It does not protect against every outlier: an extreme predictor can have large regression leverage. The numerical example above changes a response in an intercept-only problem, and makes no general claim of immunity to such predictor changes.
Linear regression Created 2026-09-24 Updated 2026-10-14
Linear regression models a response's conditional expectation as a linear combination of specified predictors. In matrix form,where the design matrix describes the observations, contains the regression coefficients, and contains the errors. The fitted values estimate the response means. The model is linear in its regression coefficients; its columns may include powers, interactions, or other transformed predictors, so polynomial regression can fit curved relationships using the same machinery.
For a concrete example, take five constructed observationsAn ordinary least squares fit with an intercept gives the line . Its regression residuals are and its residual sum of squares is . A one-unit increase in the predictor corresponds to a one-unit increase in the fitted response. This is a description of this fitted association; interpreting a change as a causal effect requires the assumptions of a causal inference problem.
A five-point least-squares fit separates the fitted trend from residual deviations
. Details. The geometric reason for the fit is simple. The possible mean vectors form the column space of . Ordinary least squares chooses the orthogonal projection of the data vector onto that vector subspace, so the remaining regression residual is orthogonal to every permitted fitted direction. The least-squares normal equations express this orthogonality as . The data's explained component and unexplained component are therefore separated by the same geometry used in a Hilbert space.
The optimization definition makes sense for any observed data. Quantifying the uncertainty of the regression coefficients needs additional assumptions about the sampling and errors. With fixed of full column rank and mean-zero errors with covariance matrix , ordinary least squares is unbiased and has covariance ; the Gauss-Markov theorem compares it with other linear unbiased estimators. A normal linear model additionally makes Student t-distribution intervals and tests exact in finite samples. Model adequacy and predictive assessment remain relevant even when these calculations are available.
Two historical settings help explain the subject's appeal. Adrien-Marie Legendre's Nouvelles méthodes pour la détermination des orbites des comètes (1805) includes an appendix on the method of least squares: observations give more equations than unknowns, and squared errors provide a criterion for reconciling them. Its astronomical setting shows the motivation for combining imperfect measurements. [ref]
https://www.e-rara.ch/zut/content/titleinfo/10838079. Legendre, Nouvelles méthodes pour la détermination des orbites des comètes, 1805, appendix pp. 72–80
Francis Galton's Regression Towards Mediocrity in Hereditary Stature (1886) examines the association between parental and offspring heights and the tendency of group averages toward the population average. This is a historical use of the regression name; the modern linear model is a general statistical formulation. [ref]https://zenodo.org/records/1449548. Galton, Regression Towards Mediocrity in Hereditary Stature, 1886, original article
Log-linear exponential-decay fit Created 2026-10-18 Updated 2026-10-25
An exponential decay rate becomes a straight line in and , where is a fixed reference rate. Constant small fractional rate errors become approximately constant vertical errors by propagation of uncertainty. With independent Gaussian log-rate errors, linear least squares gives and .
The covariance matrix is obtained by applying the variance rules to these linear estimators:Transforming back gives , , and . If a candidate lifetime fixes the slope , the intercept must be refitted as . The profiled objective obeysThis follows by separating the centred slope residual from the unrestricted regression residual, whose inner product with the design columns is zero by the normal equations for linear least squares. Known supplied measurement errors are not rescaled by the observed reduced chi-squared. This log-error model is an approximation for proportional errors, not an exact replacement for every raw-count likelihood.
Measurement of psychological resilience 2026-10-25
Measurement relating documented adversity to subsequent adaptation. A design specifies exposure, outcome, baseline functioning and follow-up; capacity questionnaires, trajectories and exposure-conditioned regression residual scores operationalize different questions.
Normal equations for linear least squares 2026-10-14
Minimizing gives the displayed equations by differentiation. Equivalently, the regression residual satisfies : it is orthogonal to every column of the design matrix. If has full column rank, the minimizer is unique and the fitted values are the orthogonal projection of onto its column space. A rank-deficient design matrix can give multiple coefficient vectors, while the projected fitted vector is still unique.
For an intercept and one predictor, put and . The equations give and , provided . In the five-point example in linear regression, , , and , giving and .
The normal equations describe the mathematical optimum, but explicitly forming and inverting can amplify numerical problems. A QR decomposition computes the same least-squares solution through orthogonal coordinates; a singular value decomposition also exposes nearly dependent columns. This connects statistical fitting to numerical linear algebra and the choice of a stable algorithm. [ref]
https://ocw.mit.edu/courses/18-06sc-linear-algebra-fall-2011/. MIT 18.06SC, Projections onto Subspaces and Least Squares
Normality (statistics) Created 2026-10-20 Updated 2026-10-25
A normality assumption specifies a normal distribution for the relevant observations, errors, or latent effects. These are different assumptions: normal latent random effects do not imply that the observed response is normal. Estimated regression residuals or fitted random effects are not independent copies of the underlying errors or effects.
Normal Q-Q plot 2026-10-14
A normal Q-Q plot compares order statistics with standard normal quantiles . For a normal distribution with , the population quantile function is , so the diagnostic sample relation isThe appropriate reference is a line with an intercept and positive slope, not necessarily the identity line. A line can be fitted through two central sample quantiles; R's
qqline uses the quantile levels and by default. Neither that line nor its fitting rule is part of the definition of a normal Q-Q plot. [ref]https://stat.ethz.ch/R-manual/R-devel/library/stats/html/qqnorm.html. R stats documentation, qqnorm and qqline
To isolate curvature, retain the same 19 plotting positions and construct two more ordered sequences:The are continuous uniform distribution quantiles on , while the apply the hyperbolic sine to the reference quantiles. Both examples are symmetric about zero. At ranks , is approximately and is approximately . Again, these are constructed values rather than random draws or real data.
Read these shapes relative to their central slope. The uniform distribution example has , with derivative ; at the upper endpoint the tangent predicts , while . Its lower end lies above the tangent and its upper end below it: the outer quantiles are compressed. The hyperbolic sine example has ; its tangent predicts at the upper endpoint, while . Its lower end lies below the tangent and its upper end above it: the outer quantiles are stretched. Unequal departures at the two ends can suggest skewness. The direction of these descriptions assumes that reference quantiles are horizontal and observed values vertical. The graphs illustrate finite-range shape differences; a sample pattern cannot establish an asymptotic tail probability law or membership in a heavy-tailed distribution class.
A nearly straight normal Q-Q plot is a diagnostic, not a proof of a normal distribution or a formal hypothesis test. Random statistical samples fluctuate, particularly at extreme order statistics, and apparent curvature depends on sample size, plotting positions and the reference line. A calibrated hypothesis test or uncertainty band requires its own assumptions and must account for parameters estimated from the same observations. Sorting also discards the original observation order: rearranging a time series leaves its Q-Q plot unchanged, so the plot cannot establish independence.
For a normal linear model, R's diagnostic normal Q-Q plot uses standardized regression residuals, also called internally studentized residuals. [ref]
https://stat.ethz.ch/R-manual/R-devel/library/stats/html/plot.lm.html. Maindonald and Maechler, R plot.lm documentation, Details
Even with independent errors, the regression residuals have covariance matrix , where is the hat matrix; fitting parameters generally creates dependencies. Dividing by a shared estimated standard deviation creates further dependence, and the distribution of an internally studentized Gaussian residual is not exactly the standard normal distribution. The normal Q-Q plot therefore helps assess error shape alongside other diagnostics rather than certifying independent normal random variables. Outlier 2026-10-14
An outlier is an observation unusually far from the behavior expected under a statistical model. A large regression residual can identify a candidate, but data validation, regression leverage, and the possibility of model misspecification should be examined before excluding it. An outlier need not be an influential observation.
Paired group Lasso optimality conditions 2026-10-06
For each unordered pair, and with centred columns and regression residuals. The subdifferential of the Euclidean norm is the unit ball at zero and otherwise. These KKT conditions are necessary and sufficient for the convex paired objective and explain joint edge deletion.
Partial residual Created 2026-10-06 Updated 2026-10-07
In an additive mean model, the partial residual for component subtracts every fitted term except that component. It equals the full regression residual plus the fitted component. Plotting it against that component's predictor shows the conditional pattern after accounting for other fitted effects, and supplies the response for a backfitting update.
The fitted simple linear regression for the numerical vaccination intention scale isHere age is measured in years. The fitted mean increases by about 0.01649 score points per year, or 0.16489 points per decade. The regression coefficient is an association across respondents, not an estimate of how an individual would change on ageing or of a causal effect of age.
The standard error of the age regression coefficient is . Dividing gives , with 2,133 residual statistical degrees of freedom, corresponding to fitted residual degrees. The reported two-sided p-value is , so the zero-slope null hypothesis is rejected at a prespecified 5% level, but not at 1%. An approximate 95% confidence interval isIts positive endpoints are consistent with the test decision; they do not make the slope large.
The coefficient of determination is , so the fitted age trend accounts for only 0.2744% of the observed score variation, compared with an intercept-only prediction. Its adjusted value is . In an intercept-containing simple linear regression, the positive slope implies a positive Pearson correlation coefficient . The reported overall statistic, on one and 2,133 degrees of freedom, agrees with the squared slope test statistic up to printed rounding.
The residual standard deviation estimate is score points, much larger than the fitted decade contrast. At age 50 the fitted value is about , and at 60 it is about . Across the observed ages 19 to 91, the fitted mean changes by only points. Statistical detection with 2,135 observations therefore coexists with weak individual prediction.
The intercept predicts at age zero, outside the observed age range; it should not be given a substantive infant interpretation. Centring age at its observed sample mean, , giveswhich agrees with the reported score sample mean of after rounding. The bounded scale and upper quartile at its maximum motivate attention to a possible ceiling effect; they do not establish homoskedasticity, a normal error distribution or a satisfactory linear conditional mean. Five residual quantiles cannot replace a residual plot or checks of the sampling assumptions.
There is also a source consistency problem. The output reports that all 2,135 records have age and score present, that the attained minimum score is one, and that ages lie between 19 and 91. The positive fitted slope therefore places every fitted value between and . By residual extrema when response extrema are attained, the minimum regression residual must satisfyAt the observation with score one, its residual is already at most . The printed minimum residual, , lies outside this necessary interval. Those summaries cannot all describe the same complete sample and fitted model. The discrepancy is too large to be explained by the displayed rounding. It is present in the original PDF; the individual records would be needed to establish which printed item is wrong.
The fitted simple linear regression isIts regression slope is a predicted decrease of approximately 0.006314 trust-score units per extra year, or 0.06314 units per decade. This is an estimated statistical association between age and the score. A cross-sectional study does not establish that the same person's trust decreases at this rate as they age.
The estimated standard error of the slope is 0.005427. Testing a zero regression slope gives on 746 residual degrees of freedom and . An approximate 95% confidence interval isThere is insufficient evidence of a nonzero linear age association at the 5% level. The interval includes both small negative and small positive slopes; failure to reject does not establish an exactly zero relationship or rule out a nonlinear one.
The regression intercept 6.388920 predicts the score at age zero. That age is outside the observed 19–89 range, so interpreting it substantively would be extrapolation. Its very small reported p-value tests a zero intercept, rather than the age hypothesis. The 746 residual degrees of freedom correspond to 748 observations minus the intercept and slope.
The coefficient of determination is , so the fitted line explains approximately 0.1811% of the observed centered variation, rather than 18.11%. The adjusted coefficient of determination is approximately 0.0004732. The residual standard error is 2.602 score units, close to the reported response standard deviation; most variation remains unexplained by the fitted line. With one predictor and an intercept, the slope's F-test is the square of its Student's t-test statistic, up to printed rounding, so and agree with the slope test.
Output 6 is a residual-versus-fitted plot: its vertical coordinates should be regression residuals . The fitted values range over only approximately 5.83–6.27, as the weak slope predicts over ages 19–89. The printed scatter shows no obvious strong mean curvature or clear widening funnel, but it has marked horizontal concentrations near its extreme residual levels. An absence of obvious curvature does not prove a correct linear conditional mean, and the plot alone cannot establish homoscedasticity, independent errors or a normal distribution. A normal probability plot and residuals against observation order address different aspects. Large residuals also do not by themselves establish influential observations; regression leverage and Cook's distance matter.
There is an additional inconsistency in the original figure. The descriptive output reports observed responses between zero and ten, so residual constraints from a bounded response requireYet the printed graphic contains points around , which would imply , above the stated observed maximum. Some lower-edge points likewise imply negative responses. This is present in the original PDF, rather than introduced by the transcription. The graphic therefore cannot be treated as a fully consistent diagnostic of the reported dataset. The observations about its visible shape above describe the supplied picture; reliable model checking would require the actual fitted values and residuals.
The printed code has separate typographical problems. The displayed model call supports the intended formula with
~, and the plot needs one closing parenthesis:model1 <- lm(t_guard ~ age, data = exam)
plot(fitted(model1), residuals(model1),
xlab = "Fitted values", ylab = "Residuals")
abline(h = 0)These calls correct the syntax; they cannot be rerun on the original observations because the individual-level dataset is not supplied. The regression interpretation above uses the available numerical summaries and states the diagnostic limitation explicitly.
The normality assumption concerns the model's error distribution, not necessarily the pooled raw observations. In an independent-groups analysis of variance, errors around each group mean are modeled as following a normal distribution; combining groups with genuinely different means can produce a nonnormal pooled distribution even when this assumption holds. In a paired t-test, the relevant distribution is that of within-pair differences. Linear regression conventionally assumes normal errors conditional on the predictors for exact small-sample Student t-tests and F-tests.[ref]
The one-way ANOVA model and assumptions by National Institute of Standards and Technology. Handbook Section 7.4.3.2, fixed-effects errors
Inspect suitable within-group or fitted-model regression residuals using a quantile-quantile plot and examine outliers and asymmetry. A formal normality test is not a decisive automatic gatekeeper: with small samples it may miss important departures, while large samples can detect minor departures. Approximate robustness depends on the sample size, balance, tail behavior and intended inference. The central limit theorem concerns sampling distributions and does not make every raw observation normal or repair dependence. Depending on the question, a justified transformation, a better-fitting probability model, robust inference or an appropriate bootstrap may be preferable. The normality assumption, independence and equal variance are distinct assumptions.
For observation of bird in year , a Gaussian linear mixed model with crossed random intercepts iswhere the , , and are mutually independent random variables. Here is age, is the population intercept at age zero, and is the change in conditional expected value per year of age. The capture persistent between-bird variation, the capture shared annual conditions, and the regression residuals capture remaining observation-level variation. Two observations from the same bird share covariance ; two from the same year share , with both contributions present if both group labels agree. The model also assumes the random effects are independent of the age covariate.






