Armijo condition 2026-10-24
For and a descent direction , the Armijo condition asks for a decrease at least a fixed fraction of the decrease predicted by the first-order Taylor expansion. Put . Differentiability gives for all sufficiently small positive . Thus the condition is satisfiable without a second derivative.
Asymptotic analysis 2026-10-14
Asymptotic analysis describes what remains dominant as an argument approaches a specified limit. It compares functions or sequences by scale: how much of a complicated expression can be replaced by a simpler one, and how large is the omitted part? The limit may be for a growing input or for a shrinking approximation parameter.
For example, is eventually dominated by its quadratic term, since division by gives . But at , the linear term contributes , compared with only from the quadratic term. A statement about the limiting scale and a good approximation at a particular input are different claims.
Three useful comparisons keep their strengths distinct. Big O notation supplies an eventual upper bound up to a constant multiplier; big theta notation supplies both an upper bound and a lower bound up to constants; asymptotic equivalence makes the ratio tend to one. Little o notation says that a term becomes negligible relative to a specified scale. These distinctions make approximations checkable instead of merely calling one expression small.
The same language connects time complexity with Taylor remainders. In an operation-count model, one asks how a cost scales with input size. In a Taylor expansion, one asks how the approximation error scales with the increment. Neither use requires interpreting the unspecified constant as one. The asymptotic comparison of exponential functions gives another example: dividing by the largest contributing exponential reveals the terms that disappear.
Atomic clock frequency lock 2026-10-18
A peak has zero slope at its center, so a single peak-height reading does not tell feedback control which way to tune. Instead sample the two sides at ordinary frequencies , where is a chosen modulation offset, and subtract:For an even signal around the true center , write . A Taylor expansion gives . On the descending side of a positive central peak , so the update has restoring sign for and is locally stable in this ideal discrete update when . A detector dip requires the opposite sign. These conditions follow from linearizing the update, not from assuming any particular electronics.
For the ideal signal , choose . Then . With and , a center error of gives exact . The sign directs the update toward lower frequency. Constant background cancels, but background drift between samples or asymmetric neighboring spectral lines can bias the zero. An initial scan matters because other fringes can also supply zeros.
Bennett rate function 2026-10-05
The Bennett rate function has Taylor expansion near zero. It is the optimized exponent in the Chernoff bound based on the moment-generating function estimate for the Bennett inequality.
A transformed-response regression estimates the conditional mean on the transformed scale. Inverting that mean does not generally estimate the original-scale mean, because nonlinear transformations do not commute with expected values. For a smooth inverse and centered transformed error of variance , a second-order Taylor expansion gives the displayed local correction. For at positive , it is . The variance is the response's residual variance, not the sampling variance of the estimated mean. This approximation requires errors small enough that the inverse is meaningful over the relevant range; it is not an exact moment formula for arbitrary transformed noise.
Bootstrap ratio bias with unequal cluster sizes arises because the pooled mean in a cluster bootstrap is a ratio with a random denominator. Let the empirical distribution over the observed groups assign mass to each pair of group size and response sum. One bootstrap replicate draws such pairs and computes . Its conditional expectation need not equal , even though the numerator and denominator averages are individually unbiased for their empirical means.
A second-order Taylor expansion of explains the leading effect. Write and for the empirical variance of one group size and empirical covariance of one group size with its response sum, using denominator . The conditional bootstrap bias is approximatelyThe second derivatives are and ; the variances/covariance of the averages bring in . This delta method approximation requires a denominator sufficiently concentrated away from zero and control of the remainder. It is not an exact identity for a few highly unequal groups.
For an original three-group example, take . Then , , , and . The second-order bias estimate is . Enumerating all ordered bootstrap draws instead gives mean about , hence exact conditional bias about . The approximation identifies the direction and mechanism but misses a visible remainder at this small group count.
Equal group sizes remove the random denominator and this particular ratio bias. If every group has the same response mean, , every replicate ratio is exactly regardless of size. Neither case justifies replacing a row-weighted estimand with an equally weighted group mean in general; see unequal-cluster weighting in a cluster bootstrap. The primary Stata specification samples entire clusters and allows replicate row counts to vary.[ref]
Bootstrap sampling and estimation in the Stata documentation. Printed pp. 3–5, cluster() and variable replicate size
Bounded density tilt Created 2026-10-07 Updated 2026-11-05
For bounded measurable with , the formula defines a normalized positive probability density function for . A uniform Taylor expansion of the square root proves differentiability in quadratic mean with score function : the squared remainder is . Such paths realize all bounded centered directions of an unrestricted density model.
Bragg wavelength error propagation 2026-10-18
Differentiate Bragg's law at fixed correctly assigned diffraction order:Divide the second equality by the first. For small signed changes,The Bragg angle error must be in radians. An error quoted for detector deflection must first be halved. The expression is a first-order Taylor expansion; an unknown diffraction order is a discrete assignment error, not an infinitesimal perturbation.
For error bounds, add magnitudes. For independent zero-mean random errors with standard deviations , variance addition instead givesCorrelated errors require a covariance term. A shared calibration bias does not become independent merely because many line positions are measured.
With a chosen angular error arcseconds, , the angular contribution is at and at . Larger Bragg angles reduce this contribution because decreases. For a nearby spectral doublet, the inverse relation is : a fixed fractional separation spreads farther apart angularly at large Bragg angle.
This does not permit unlimited improvement. The geometry requires ; a desired wavelength might not have an accessible large-angle reflection with the chosen crystal. Higher diffraction orders can reach larger Bragg angles but their strengths depend on the crystal lattice structure factor. Finite crystal response, slit widths and source size remain relevant. An error in , including uncorrected thermal expansion, remains even when the angular term is small. Very near , the leading angular derivative vanishes and the second-order Taylor expansion matters.
Central finite difference Created 2026-09-24 Updated 2026-11-05
A central finite difference uses sampled values symmetrically around an evaluation point. Common scaled derivative formulas areFor sufficiently smooth functions, they approximate and with error . Taylor expansion explains the accuracy: symmetry cancels the unwanted even or odd powers. The leading errors are for and for when the next derivatives permit these expansions.
At unit spacing and , the second formula becomes , with finite difference coefficients . Symmetry is a local approximation property; it does not by itself establish stability of a time update or provide values beyond the boundary. Those require von Neumann stability analysis, an energy estimate, or an appropriate boundary closure of a difference scheme.
Central limit theorem Created 2026-09-24 Updated 2026-10-14
Let be real independent and identically distributed random variables with expected value and finite, strictly positive variance . Write and for their sum and sample mean. The central limit theorem statesPrecisely, for every real ,where is the standard normal distribution function. The conclusion is convergence in distribution to the standard normal distribution. If the variance is zero, every observation equals almost surely; the displayed normalization is then undefined and there is no fluctuating error to describe.
The striking feature is that the observations need not have a normal distribution. They may be binary, bounded, or strongly skewed. Their detailed probability distribution disappears from this limit except through the expected value and variance. The subtraction removes predictable growth: . The division implements variance normalization: variance additivity for independent random variables gives , so every has expected value zero and variance one. For nonzero , an uncentered sum drifts; without rescaling its spread grows.
For a concrete example, let each have a Bernoulli distribution with success probability . Then has a binomial distribution, with expected value and variance . Its exact probability mass function and its normalized count areHere is a binomial coefficient. Individual trials are conspicuously skewed, yet their centered, rescaled counts approach the same standard normal distribution as sums of fair trials.
Exact standardized binomial distributions approach the standard normal curve
. For independent Bernoulli trials with , each blue bar has width equal to the normalized lattice spacing and area equal to the exact binomial distribution mass at its center. Heights are mass divided by spacing, so they can be compared with the orange probability density function of the standard normal distribution. All four normalized counts have expected value zero and variance one. The rectangles visualize discrete masses; they do not make the discrete probability distributions continuous. Details.At , has expected value and standard deviation . The exact binomial distribution gives . A normal approximation with the continuity correction uses the interval to :The small discrepancy is an approximation error, not an equality supplied by the central limit theorem.
The strong law of large numbers and weak law of large numbers locate the average: , respectively by almost sure convergence and convergence in probability. The central limit theorem magnifies that shrinking error and describes its shape. In terms of the sample mean, the resulting normal approximation is , with standard error . This explains why four times as many independent observations halve the standard error. When is known, has approximately coverage for at large , giving a confidence interval. This coverage refers to repeated samples, not a guarantee for an individual interval.
A useful application is the Monte Carlo method: estimate a success probability by the proportion of successful simulated trials. Nicholas Metropolis and S. Ulam's original paper, "The Monte Carlo Method" (1949), illustrates this with games of solitaire and estimation of a region's volume by randomly selected points, and discusses why estimates require probabilistic error control. The strong law of large numbers justifies convergence of such proportions for independent repetitions; the central limit theorem supplies their large-sample error scale when .[ref]
https://hedibert.org/wp-content/uploads/2013/12/1949MetropolisUlam.pdf. Metropolis and Ulam, The Monte Carlo Method, JASA 44 (1949), 335–341, especially pp. 336–337
There are three useful limits to this picture:
- A heavy-tailed distribution can have infinite variance, so the displayed hypothesis must be checked. A Pareto distribution with minimum one and shape has finite expected value three but infinite variance. The strong law of large numbers still applies, but the stated central limit theorem does not. More dramatically, the Cauchy sample mean has an unchanged distribution: even averaging need not concentrate when the expected value is undefined. A heavy-tailed distribution with finite variance is allowed by the stated central limit theorem.
- Independence matters. If all equal the same nonconstant Bernoulli random variable, then and . There is no accumulation of new information, and the variance of the sum grows like , not . Other versions of the central limit theorem can allow dependence, but require hypotheses controlling it.
- Convergence in distribution is a limiting assertion, with no universal sample size or error rate under finite variance alone. It does not automatically give accurate relative estimates of very small tail probabilities. Nor does it mean that discrete point masses converge as probability density functions: a binomial distribution remains discrete for every finite . If the success probability changes with so that and , the relevant result is the Poisson limit theorem, rather than the fixed- argument above.
A historical original-paper reference is J. W. Lindeberg's "Eine neue Herleitung des Exponentialgesetzes in der Wahrscheinlichkeitsrechnung" (1922), published in Mathematische Zeitschrift 15, pp. 211–225. The Lindeberg condition and Lindeberg-Feller central limit theorem below describe a version for sums whose summands need not share a probability distribution.[ref]
https://doi.org/10.1007/BF01494395. Lindeberg, Eine neue Herleitung des Exponentialgesetzes in der Wahrscheinlichkeitsrechnung (1922)
A brief proof outline uses the characteristic function of . Its expected value is zero and its variance is one, so the finite second moment givesThe Taylor expansion of the complex exponential, with its remainder controlled by , and the dominated convergence theorem justify this step without a third-moment assumption. Independence then gives the characteristic function of :The limit is the characteristic function of the standard normal distribution; the Lévy continuity theorem turns this into convergence in distribution.
Let be independent and identically distributed random variables taking and with equal probabilities, the Rademacher distribution. The two opposite complex exponentials give . Their expected value is zero and their variance is one. For , the characteristic functions of its sample mean and its variance normalization are respectivelyFor each fixed , the bases are positive for all sufficiently large . The Taylor expansion at zero then givesExponentiating proves the two displayed pointwise limits. The first limit is the characteristic function of the constant zero; the second is that of the standard normal distribution. The Lévy continuity theorem gives the corresponding convergence in distribution statements. Averaging has variance , whereas dividing the sum by preserves variance one. This sign calculation illustrates why the law of large numbers and the central limit theorem use different scales; it is not a proof for arbitrary probability distributions.
Charge-transfer efficiency Created 2026-10-18 Updated 2026-10-20
The charge-transfer efficiency is the fraction of a packet delivered into its intended next site or time slot in one transfer, under stated conditions. It is distinct from quantum efficiency, which concerns conversion of incident photons into collected charge carriers. Define the complementary inefficiency as .
In an original model with constant , let denote the mean number of original packet electrons still delivered on time after transfers. Assuming no reinjection into that packet,Repeated substitution proves the result; for different efficiencies the fraction is . For , a Taylor expansion of gives , while the simpler requires .
Choose and . For , the expected on-time output is electrons; for , it is . These are model means, so fractional electron counts do not describe an individual packet. Even a small per-transfer imperfection can imprint distance-dependent image errors.
If every original electron independently stays on time with probability , a fixed initial count gives a binomial distribution with variance . An initial Poisson distribution with mean instead gives an on-time Poisson distribution with mean and variance , by Poisson thinning. A deterministic attenuation formula alone does not specify noise. Real trapping can correlate packets and depends on timing, illumination and temperature; the independent constant-efficiency model then fails.
Common-origin pressure-tap position error 2026-11-05
A common-origin pressure-tap position error shifts several inferred tap positions together relative to a fixed physical reference. It is a shared contribution to correlated position errors of pressure taps, not an independent placement error for every hole. Whether it affects a pressure-derived load depends on which references are held fixed.
For dimensionless chord coordinate , suppose the uncertain displacement is the same scalar for every tap. A first-order Taylor expansion of the pressure coefficient gives . For a reconstruction with fixed quadrature weights,The position covariance matrix is , a rank-one matrix. Squaring each tap's contribution before adding would discard the shared covariances. The covariance terms belong in the general propagation of uncertainty.[ref]
An original locally linear example takes eight equal weights , equal local slopes and . The reconstructed coefficient has standard uncertainty . Incorrect independence would give . If a two-dimensional load per span is with stipulated dynamic pressure Pa and airfoil chord m, these become and N/m. The chosen slopes describe a sensitivity model, not measured airfoil data.
Opposite-signed sensitivities can cancel the shared contribution. Conversely, repeating coordinate readings without independently checking the misplaced datum cannot average away its fixed error. A proposed test measures an independent reference mark and deliberately translates the assumed origin in the reconstruction, comparing the observed load sensitivity with the derivative above. If moving coordinates also changes the integration weights, those additional derivatives must be included.
Pressure-tap datum cancellation is a different situation. When the tap, leading edge and trailing edge are all expressed through the same affine map , with ,The common origin and scale cancel exactly. Merely translating a shared coordinate system causes no physical tap misregistration. Affine pressure-tap coordinate calibration must therefore state whether the datum is shared or independently fixed before assigning a common-origin uncertainty.
Compact fourth-order Helmholtz stencil 2026-10-14
Let have center weight , axial weights and diagonal weights , and let have center weight and axial weights . Taylor expansion gives and . On a smooth solution of the constant-coefficient Helmholtz equation, the second-order term becomes . Thus the normalized PDE residual is fourth order, while the original unscaled stencil residual is sixth order. This local cancellation alone does not prove uniform global accuracy at or near a resonance.
Composite midpoint rule error Created 2026-09-24 Updated 2026-11-05
For , divide into cells of widths and midpoints . The composite midpoint quadrature rule is . Taylor's theorem around each midpoint givesThe odd linear term integrates to zero; integrating gives . Consequently, with ,Thus each cell has a cubic quadrature error, while the composite error is second order in the largest cell width. For the constant is attained, since the second-order Taylor expansion is exact. Endpoint singularities that make unbounded require a separate estimate or a smoothing change of variables.
Let be a finite convex function on a neighbourhood of , and suppose its first partial derivatives exist at . For any fixed vector , convexity givesThe equality uses the one-dimensional first-order Taylor expansion along each coordinate line; no continuity of second partial derivatives is assumed. Applying this upper bound to and using gives the matching lower bound. Hence the displayed directional expansion holds. This supplies the expansion used in the supporting inequality for a differentiable convex function even when continuous second partial derivatives have not been postulated.
Cumulant expansion Created 2026-09-24 Updated 2026-11-05
The cumulant expansion is the Taylor expansion of the logarithm of a moment-generating function:If the moment-generating function is finite on a neighbourhood of zero, the logarithm is analytic on a sufficiently small neighbourhood and this is a convergent local expansion. The first terms areA formal series of moments is not automatically a convergent representation of a moment-generating function. Finitely many moments can instead justify finite-order expansions of the characteristic function and its logarithm near zero; exponential integrability is a separate hypothesis.
For a centered normal distribution of variance , , so all cumulants beyond order two vanish. For a Poisson distribution of mean , , so every cumulant equals . independent sums add their cumulant-generating functions, making cumulants additive.
For a fluctuating interaction , expanding a Boltzmann weight gives whenever the exponential moment exists near . The logarithm thus organizes the expansion into cumulants rather than raw moments.
Detector volume averaging 2026-11-05
Detector volume averaging is the spatial averaging of a nonuniform radiation field over a detector's finite sensitive region. A reading associated with the detector centre need not equal the local absorbed dose at that point. This limits spatial resolution even if the detector position and electronic readout are exact.
For an idealized linear response, let be the absorbed dose field in the undisturbed medium and let be a normalized spatial weighting function, with . Model the spatially averaged quantity byThe model separates averaging from the change in the radiation field caused by inserting the detector. A real ionization chamber can require both effects to be considered. The IAEA definition compares a point dose with the average over the detector's sensitive volume, both evaluated in water with the detector absent.[ref]
Dosimetry of Small Static Fields Used in External Beam Radiotherapy by the International Atomic Energy Agency. §3.1.4, printed p. 37, definition and spatial weighting in equation (5)
For an original one-dimensional example, suppose the detector averages uniformly over a full width . ThenAn ideal sharp edge , where is the Heaviside step function, is recorded asThus a detector gives a distance between the 20-percent and 80-percent response points, although the stipulated field edge has zero transition width. A detector gives in the same model.
Uniform finite-detector averaging turns a sharp radiation-field edge into a ramp. Original model calculation; the indicated 2.4 mm width belongs to the 4 mm detector, not to an intrinsic field transition.
Details. For a smooth field, a Taylor expansion under the symmetric uniform weighting gives . A constant slope averages to its centre value; curvature produces the leading local discrepancy. A detector-volume-averaging correction factor therefore depends on the field shape and detector geometry, rather than only on the detector's nominal volume.
A proposed apparatus test scans a stable radiation field with detectors of different effective widths or orientations, keeping depth and irradiation geometry fixed. Changes in the recorded edge width test spatial response, while a uniform region checks relative sensitivity. The IAEA's geometric weighting examples show why a projected detector area may need nonuniform weighting; finer scan steps alone cannot remove averaging within each reading.[ref]
Embedded Runge-Kutta pair Created 2026-10-14 Updated 2026-10-14
Two Runge-Kutta methods share a stage matrix and nodes but use different output weights. An order- and order- pair with gives an output difference generally of order , estimating the lower-order defect. Shared stage evaluations reduce the cost. The adaptive step-size controller exponent must reflect this estimator order, rather than blindly the higher reported solution order.
Using the slope convention for Runge-Kutta stages, an embedded Runge-Kutta pair computesIts Butcher tableau has two output rows, and . Evaluating is often the expensive part of solving an ordinary differential equation; after the shared slopes have been computed, the extra row needs only another linear combination.[ref]
Write for the exact endpoint from the current numerical state, and define signed local defects and . Then . If and , with , the difference reproduces the leading lower-order defect. It does not reproduce the leading higher-order defect. Here the powers use big O notation and a smooth Taylor expansion; a vanishing leading coefficient or accidental cancellation can make the estimate misleading.
A common choice accepts after testing with absolute and relative error tolerances. With the scale approximately unchanged on a retry, the adaptive step-size controller uses exponent . Accepting a better endpoint does not change the power in the quantity being tested. The Euler-Heun embedded pair makes this visible without a large coefficient table.[ref]
Euler-Heun embedded pair 2026-10-14
The Euler-Heun 1(2) pair combines the explicit Euler method and Heun's method. Here 1(2) names their respective order of a numerical method; the accepted endpoint in this article is the second-order one. Its shared Runge-Kutta stages and endpoints areThe first output row in this Butcher tableau is Heun's method; the second is the explicit Euler method. Both outputs cost two evaluations of together, rather than one for Euler method plus two for a separately computed Heun's method.
For the initial value problem , , take . The first slope is ; the stage state is , giving . ThereforeThe exact exponential function gives signed local defects approximately for the explicit Euler method and for Heun's method. Their difference is exactly . Thus the pair difference estimates the larger Euler defect; calling it the actual Heun defect would miss by a factor about fourteen here.
More generally, a step from on hasThese original Taylor expansions separate three quantities: the accepted Heun's method has local truncation error and global error under suitable numerical stability, while the tested local error estimator is . For with held approximately fixed, use . A cube-root update would model a different quantity, the actual higher-order local defect.

