Quadratic expansion of a cumulant-generating function Created 2026-10-31 Updated 2026-11-05
Suppose the moment-generating function is finite on an open interval around zero. Its cumulant-generating function satisfies , and . Indeed,and . The Taylor expansion gives the displayed formula, with little o notation describing the remainder. Finiteness in a neighborhood justifies differentiation: polynomial factors times are dominated on a smaller interval by constants times two slightly larger exponential moments.
Randomized symmetric finite-difference derivative estimator Created 2026-10-03 Updated 2026-11-05
Let be independent Rademacher random variables and observe , where the noises are independent of the and of one another, with zero mean and variance . Assume the baseline is known exactly and on the sampled interval. The estimatoruses function values on both sides of . A first-order Taylor expansion givesThe average remainder therefore has squared magnitude at most , while the independent zero-mean noise contribution has variance . Their cross term vanishes after conditioning on the sample directions, provingThe noise assumptions and exact baseline belong to this bound. Correlated or biased errors, or an independently estimated baseline, require their own error calculation.
An ideal electric dipole at the origin with smooth electric dipole moment has Lorenz gauge electric potential and magnetic vector potential, for ,For a short proof, place electric charges at , , and let with fixed. The corresponding retarded times are . Each Liénard–Wiechert potential has denominator . The opposite terms cancel, leaving the displayed electric potential. The products of signed electric charge and velocity add, giving the displayed magnetic vector potential. Bounded time derivatives on the relevant interval justify the Taylor expansions.
A smooth real rotation-invariant potential is constant on every positive-radius circle, so its logarithmic-radius function is smooth on . Off the origin, . Since is smooth on the entire plane, this coefficient extends smoothly through the origin. A finite Taylor expansion, rather than a convergent series assumption, gives .
Runge-Kutta method Created 2026-09-24 Updated 2026-10-31
A Runge-Kutta method advances an initial value problem , , by sampling its vector field at several trial states within one time step. These samples are Runge-Kutta stages; a weighted combination of their slopes produces the next state. The construction improves on the single tangent line used by the Euler method while requiring evaluations of , rather than explicit higher derivatives of the solution. It applies to scalar equations and systems of ordinary differential equations alike. The coefficient choices distinguish methods such as Heun's method, the classical fourth-order Runge-Kutta method and implicit Runge-Kutta methods.
For stages, write for the stage matrix, for relative time nodes and for output weights. A time step of length computesHere is a slope, with units of state per time; is a state increment. Another common convention writes , so its stage states are and its output is . These are equivalent conventions: including both inside and again in the output would count the time step twice. The textbook formulation uses the increment convention.[ref]
6.4 Runge-Kutta methods. Fundamentals of Numerical Computation, §6.4.3, equations 6.4.10–6.4.11: multistage recipe and tableau
Usually the Butcher tableau obeys , called internal consistency. Stage then combines slopes over an effective time . The second-order conditions with independent Runge-Kutta abscissae explain what changes when time nodes are specified independently. A Runge-Kutta stage is generally an auxiliary approximation, not a separate accepted solution value at its node. Several stages can even have the same time node but different state arguments, as in the classical fourth-order Runge-Kutta method.
The useful idea is to approximate the integral without knowing the intermediate exact trajectory. Trial states provide places to sample , and Butcher order conditions make the resulting combination agree with the exact Taylor expansion. More stages alone do not guarantee a higher order of a numerical method: their coefficients must satisfy the appropriate conditions. Embedded Runge-Kutta pairs reuse these same samples for a second output and a practical local error estimator.
Sagitta Created 2026-10-25 Updated 2026-11-05
For the minor circular arc cut off by a chord of length on a circle of radius , the sagitta is the maximum perpendicular distance from the chord to that arc:The perpendicular bisector of the chord passes through its midpoint and the center. The Pythagorean theorem gives the center-to-chord distance ; subtracting it from proves the formula. The major circular arc instead gives , so choosing the arc matters.
For , a Taylor expansion gives . In a uniform magnetic field perpendicular to a charged track's motion, , so the sagitta measures the momentum .
Second-derivative test Created 2026-09-28 Updated 2026-10-14
Let have continuous second partial derivatives near an interior critical point of an open subset of , with . The Hessian matrix gives the following sufficient conditions:
- All eigenvalues positive: a strict local minimum.
- All eigenvalues negative: a strict local maximum.
- Both positive and negative eigenvalues: a saddle point of a scalar function.
A positive semidefinite or negative semidefinite Hessian matrix with a zero eigenvalue does not settle the classification. The higher-order test for separated extrema gives two quartic examples with exactly the same zero Hessian. These conditions apply to an interior critical point; a boundary optimum or a constrained optimization problem requires attention to the allowed directions. [ref]
https://ocw.mit.edu/ans7870/18/18.013a/textbook/chapter11/section03.html. MIT 18.013A Calculus with Applications, §11.3: Hessian eigenvalues and the critical-point criterion
The proof outline is the Taylor expansionFor a positive-definite matrix, the smallest eigenvalue supplies a positive bound proportional to , which dominates the remainder for small enough . Negate the function for the local maximum case. For opposite-sign eigenvalues, choose the two corresponding eigenvectors: the leading terms have opposite signs along their lines.
There are also necessary conditions. At an interior local minimum, the Hessian matrix is positive semidefinite; at an interior local maximum, it is negative semidefinite. Restriction to each straight line reduces this to the one-variable second derivative condition. Since the Laplacian is the trace of the Hessian, it is nonnegative at such a local minimum and nonpositive at such a local maximum. The sign of the Laplacian alone is insufficient: has negative Laplacian but a saddle point of a scalar function at the origin.
Second-order boundary expansion for local constant regression Created 2026-10-14 Updated 2026-11-05
For fixed , design , , a nonzero nonnegative symmetric piecewise regression kernel supported on , and , , write and . On the rescaled grid of spacing , the Riemann sum error for is , by bounded variation. The normalized first and second local moments are therefore and . A uniform second-order Taylor expansion gives the displayed bias of an estimator, since . Equivalently it is . The first-order term explains the generic boundary bias of a local constant estimator.
For a general nonautonomous Runge-Kutta method, Taylor expansion of stage gives . Matching the exact increment gives the three displayed conditions. When internal consistency is imposed, the last two coincide. Internal consistency is a usual tableau convention, but is not logically necessary for order two of a generalized tableau.
Second-order relative change of a monomial 2026-10-20
For positive , fixed real , and , change the inputs to with small. The ratio of the new value to the old one is exactly . Applying the binomial series to each factor and multiplying proves the displayed Taylor expansion. Positive inputs and make arbitrary real exponents well defined. A percentage change of in means , not . The mixed term is required even though there is no such term in either one-variable expansion separately.
For prescribed one-dimensional velocity , let , and expand the Lagrangian trajectory as . The Taylor expansion of gives and . Initial position requires andThe secular velocity is Stokes drift, even though the Eulerian time average vanishes. This fixed-time expansion requires and is not uniform once the secular displacement changes the phase by order unity.
Second variation Created 2026-09-24 Updated 2026-11-05
For a twice differentiable functional, the second variation at in an admissible direction isIts contribution to the Taylor expansion is . At a stationary local minimum it must be nonnegative in every direction. A negative direction rules out a minimum, but mere directional strict positivity in an infinite-dimensional space is weaker than a uniform coercive bound and does not alone supply a sufficient-minimum theorem.
For zero-endpoint functions on , considerAt , the second variation is . The Wirtinger inequality makes this coercively positive when . At equality, is a zero direction; above it, this same direction has negative second variation. Thus lower-order terms can destroy minimality despite a positive highest-derivative coefficient. The Legendre necessary condition, Jacobi equation and conjugate point organize these tests for general variational integrals.
Seismic travel-time fold caustic Created 2026-10-20 Updated 2026-11-05
A seismic travel-time fold caustic occurs where two branches of a seismic ray family merge in the mapping from seismic ray parameter to surface range . At an ordinary fold,A local Taylor expansion gives . On one side of there are two nearby rays; at the fold they merge, and beyond it that pair no longer exists. This is the local geometry underlying a boundary of seismic travel-time triplication.
In a horizontally layered model the travel times also merge, since for the ray family. Geometrical spreading then makes a simple ray-amplitude estimate singular because the same ray bundle is compressed into a small range interval. Actual seismic waves have finite wavelength; their interference requires a wave approximation near the fold instead of interpreting the geometrical singularity as infinite measured motion.
For on , the Peano kernel isThe Taylor expansion with integral remainder gives , because annihilates polynomials of degree at most two. Since and , the sharp bound is . Equality holds for .
Simple harmonic motion Created 2026-09-24 Updated 2026-10-14
Simple harmonic motion is motion in which the acceleration is proportional to the displacement from equilibrium and points back towards it:Here is measured from equilibrium, and is the constant angular frequency. For a point mass attached to an ideal spring, Hooke's law gives the restoring force , with stiffness , and Newton's second law yields . The minus sign matters: for the force is negative, and for it is positive. A restoring force need not oppose velocity; on the return towards equilibrium it increases speed.
The general solution isThe amplitude and oscillation phase encode the initial conditions. We use for the oscillation period to distinguish it from kinetic energy . For , the oscillation period is independent of amplitude, the property of isochronous harmonic motion. At the body remains at equilibrium. [ref]
https://ocw.mit.edu/courses/8-01sc-classical-mechanics-fall-2016/mit8_01scs22_chapter23.pdf. MIT mechanics, Chapter 23, sections 23.2 and 23.3
Choose , , and release the mass from rest at displacement . Then , , and . Writing time in seconds,At the velocity vanishes, but the acceleration is : a turning point is not a state of rest that persists. At , the body crosses equilibrium with velocity and zero acceleration. At it reaches the opposite turning point, .
Taking potential energy zero at equilibrium, the same solution givesAt each turning point all mechanical energy is potential energy; at each equilibrium crossing it is kinetic energy. Both repeat twice during one complete position cycle because squaring removes the sign. At , for example, each contributes .
Position, velocity, phase ellipse and energy exchange for a mass of 0.5 kg on a spring of stiffness 2 N/m
. Details. The physical position trace covers a line segment, in metres. In the phase plane, the paired position and velocity instead trace the ellipseThis is precisely , rewritten: the single conserved mechanical energy fixes the amplitude and the whole ellipse. It does not fix the starting oscillation phase. At both and lie on it; position alone cannot distinguish them. Replacing by momentum gives the equivalent phase-space trajectory. The arrows show increasing time, clockwise in coordinates.
This closed ellipse assumes a time-independent spring and no damping or applied drive. Adding a resisting force , , gives and . An underdamped damped harmonic oscillator spirals inward in the phase plane, crossing successively smaller energy contours. The ideal harmonic oscillator is also useful beyond springs: near a smooth potential energy minimum with , its Taylor expansion begins with . For sufficiently small displacements, this gives the same restoring force to leading order, explaining why small oscillations share one solvable pattern.
Small-delay expansion of an epidemic transfer rate Created 2026-10-31 Updated 2026-11-05
Consider a smooth delayed compartmental model with susceptible and infected populations , incidence , and removal rate , where . The zero-delay equations are and . A Taylor expansion of the incidence givesSubstitute the zero-delay equations only in the first-order correction to obtainThe remainder is controlled on a compact time interval when the required second derivatives are bounded. The same approximated transfer enters the susceptible and infected equations with opposite signs, preserving their compartmental model transfer balance. Defining the zero-delay dynamics explicitly is essential: different population equations would give a different correction.
Small multiplicative risk premium 2026-10-14
Small-signal model 2026-10-18
A first-order Taylor expansion of an electrical circuit's response about an operating point. It describes small changes in electric potential difference and electric current; the neglected higher-order terms limit the useful signal range.
Space focusing 2026-11-05
Space focusing in time-of-flight mass spectrometry reduces differences in arrival time caused by the initial positions of otherwise equivalent ions. An ion starting farther from the exit of an accelerating region spends longer there but can acquire greater kinetic energy, allowing it to catch up during the drift. Electrode geometry and electric fields are chosen so that these effects compensate at the detector.[ref]
Time-of-Flight Mass Spectrometer with Improved Resolution by W. C. Wiley and I. H. McLaren. pp. 1151–1154; initial space distribution and ion-gun focusing analysis
A simple idealized derivation makes the compensation explicit. Consider positive ions of mass and electric charge , initially at rest, with distance remaining in a uniform accelerating electric field . Let be the field-free distance beyond its exit. Their total flight time isThe first term is acceleration time; the second is drift time. Setting the derivative to zero at a reference position givesFor example, gives a first-order space focus at in this simplified single-field model. Nearby position errors then affect arrival time only at higher order in the Taylor expansion. Practical two-field sources allow the focus to be placed at more useful drift distances. Initial velocity spread is a separate contribution to peak width, motivating time-lag focusing.
Stoner threshold for an interaction normalized per electron Created 2026-10-18 Updated 2026-10-20
For a three-dimensional zero-temperature parabolic Fermi gas, let and . Suppose the interaction energy per electron is . The total energy per electron isIts Taylor expansion has quadratic coefficient and positive quartic coefficient . Hence the unpolarized state loses stability at . This has units of energy. It differs from a contact coupling defined by interaction-energy density , for which and . Normalization must be fixed before comparing critical couplings. For , convexity of implies , so the unpolarized minimum is a global minimum; a first-order polarized minimum does not pre-empt this threshold in the stated model.
