Adaptive Euler step doubling for exponential decay Created 2026-10-14 Updated 2026-10-14
Consider the nonstiff scalar initial value problem , , on . Its exact solution is the exponential decay . Use step-doubling error estimation with the explicit Euler method: from the same numerical starting value , form one coarse step and two half steps giving :Accept when the absolute and relative error tolerances test passes, with . There is no Richardson extrapolation in the accepted value. Both approximations have order of a numerical method one, while this local error estimator has step exponent . Consequently the adaptive step-size controller uses a square root, not a cube root:Start with . A rejected trial retains both and , caps at one, and retries. A zero estimate uses . Before every trial, cap at . Stop with a failure if floating-point arithmetic gives , or after 100000 trials. These rules specify the example completely; they are not a prescription for every ordinary differential equation solver.
Adaptive two-half-step Euler decay: exact and numerical trajectories, accepted step sizes and rejected trials
. Details. The first two trials, and , have and and are rejected. The next trial has and and is accepted. For positive decreasing numerical values, , so the local error estimator givesWhen the relative term dominates, this suggests nearly constant accepted steps, approximately . When falls below the crossover size , the absolute term increasingly permits longer steps. The sharp final decrease in only lands on ; it does not indicate a sudden loss of smoothness.
The actual signed local defect from the same numerical input isHere is Big O notation, obtained from Taylor's theorem for the exponential function. Thus agrees with the leading term as , but is not identical to . At , , the estimate is while the actual local defect is . Their closeness improves for the smaller accepted steps. Had we added using Richardson extrapolation, the accepted formula would instead be , of order of a numerical method two; the same raw difference would still scale as and would not estimate that improved value's leading defect.
Estimated versus actual local Euler defects, rejected trials, and actual accumulated global error scaled by the local tolerance
. Details. The global error obeys an exact recurrence relation involving the actual local defects:Each previous global error contracts, yet the local defects keep adding. In the plotted run, 101 steps are accepted and two trials are rejected. Every accepted is at most approximately , while the largest is approximately . At , the numerical value is approximately , compared with the exact , giving absolute error approximately . The right-hand plot deliberately scales actual global error by the same used for local acceptance; it is not a new global error tolerance test.
Tightening both absolute and relative error tolerances by a factor ten gives 315 accepted steps and endpoint absolute error approximately ; tightening both by a factor one hundred gives 991 accepted steps and endpoint absolute error approximately . This is a convergence comparison for this particular initial value problem. The endpoint error decreases by about a factor three per tenfold tightening, rather than by ten: a first-order Euler method accumulates defects across many steps, while its local error estimator varies quadratically with . A variable-step global ODE error bound needs propagation information as well as accepted local tests.
The absolute stability boundary remains a separate constraint. On the Dahlquist test equation with , the accepted two-half-step formula has stability function . It strictly damps perturbations only for . Its local error estimator is , which can pass an absolute-tolerance test at tiny even outside this damping interval. In a stiff two-mode linear system, a fast mode can therefore constrain the step long after its visible amplitude has become small. An adaptive step-size controller does not turn an explicit Euler method into an A-stable method. Official solver documentation likewise distinguishes explicit Runge-Kutta methods for nonstiff problems from implicit Runge-Kutta methods and backward differentiation formulas for stiff equations.[ref]
scipy.integrate.solve_ivp. solve_ivp, method parameter: explicit versus implicit methods and stiffness
Backward difference operator 2026-10-25
The scaled backward finite difference uses the current and preceding nodal values to approximate a first derivative. If a function has two continuous derivatives, Taylor's theorem gives as . Composition with the scaled forward difference operator gives , the second-order central difference for the second derivative.
Concave Newton iteration from below 2026-10-25
Suppose , , and . Starting at , the Newton root-finding iteration remains below and increases strictly to it. To prove this, assume . Strict increase of gives , so the Newton step is positive. Taylor's theorem between and gives, with ,Its coefficient is negative and at least , proving both the stated error bound and . Mathematical induction establishes the invariant. The increasing bounded iterates have a limit ; continuity in forces , hence . The error bound supplies local quadratic convergence.
Consistency of a numerical method Created 2026-09-28 Updated 2026-10-14
For a one-step approximation to an ordinary differential equation, insert the exact solution and define the unscaled local truncation errorConsistency of a numerical method requires uniformly on the finite interval being approximated, under the stated smoothness assumptions. Merely asking is too weak: the useless update has defect , which tends to zero but generally fails the scaled test. Here denotes Big O notation. MIT uses this division-by-step convention.[ref]
https://ocw.mit.edu/courses/18-330-introduction-to-numerical-analysis-spring-2012/a9d2bd9be098f0ada172af40379a17cc_MIT18_330S12_Chapter5.pdf. Laurent Demanet, MIT 18.330, Chapter 5, Definition 6, 2012
For the Euler method, Taylor's theorem gives . A bounded second derivative therefore gives local truncation error and a scaled defect . Under a uniform Lipschitz continuity assumption on in , within a region containing the exact and numerical solutions, numerical stability controls accumulation over about steps. This yields global error with exact starting data. Consistency of a numerical method checks each step; numerical stability controls their combination.
Euler one-step defect 2026-10-31
For a smooth solution of , Taylor's theorem gives the displayed local truncation error when an Euler method step starts at an exact solution value. Thus the one-step defect is . Dividing it by gives a normalized local truncation error of ; these are different conventions for reporting the same residual. Also along the solution by the chain rule. A global error conclusion additionally requires the usual regularity and stability control over successive steps.
Explicit midpoint linear multistep method 2026-10-31
For an ordinary differential equation , this linear multistep method uses a centered derivative across the two-step interval , evaluated at its midpoint . It requires two starting values, and . For a sufficiently smooth exact solution, Taylor's theorem givesThe unscaled local residual is therefore and the method has order two. Its first characteristic polynomial is , with the simple roots , so it satisfies the root condition for a multistep method; the second root is a parasitic amplification root. This two-step method differs from the one-step midpoint method and the implicit midpoint rule.
For the special equation and , an even number of steps gives , independently of the odd-index starting value. It is the composite midpoint quadrature rule on intervals of width . An odd final index depends on , which must be specified separately.
Explicit midpoint method 2026-10-31
This explicit numerical method is a two-stage Runge-Kutta method and a one-step method. For a sufficiently smooth ordinary differential equation, the chain rule gives , and Taylor's theorem shows that its local truncation error is . Uniform Lipschitz continuity of in its solution argument gives an increment-function Lipschitz constant at most . The Lipschitz one-step error bound then proves second-order numerical convergence on a fixed time interval. This method uses an intermediate prediction from ; the explicit midpoint linear multistep method instead requires a separate previous value .
Exponential limit 2026-10-31
For fixed real , the base is positive for sufficiently large . Applying Taylor's theorem to the natural logarithm at one gives . Continuity of the exponential function then proves the displayed limit. In particular for fixed , a basic source of exponential distribution limits in probability theory.
Near a smooth local minimum with and , Taylor's theorem givesIf evaluated function values have absolute uncertainty of order , differences on that scale cannot reliably identify smaller displacements than order . In ordinary floating-point arithmetic, when and evaluations have relative error of order , this becomesFor unit-scale values and curvature, this is the square root of machine epsilon, rather than machine epsilon itself. It explains why a derivative-free golden-section search can lose reliable comparisons while candidate positions remain representably different.[ref]
One dimensional minimization in the GNU Scientific Library manual. Caveats: loss of the quadratic term when added to a nonzero minimum value
This is a precision limit of the evaluated values, not an invariant property of the minimizer. Accurately subtracting a known constant, obtaining values at higher precision, or locating a zero of an accurately evaluated derivative can change the attainable position accuracy. A zero minimum with relative error controlled on its small values also needs separate analysis.
For on the unit square with zero Dirichlet boundary conditions, the continuous eigenvalues are , whereas the mesh- five-point Laplacian gives . The inequality yields . For fixed indices, Taylor's theorem gives an error of order ; for indices , division by gives the positive limit . Thus an error estimate for fixed smooth eigenfunctions need not be uniform over all grid-resolvable eigenfunctions.
Hoeffding lemma Created 2026-09-24 Updated 2026-10-14
The Hoeffding lemma controls the entire centered moment-generating function using only an interval width. For an essentially bounded real random variable with finite deterministic bounds almost surely, every real satisfiesEquivalently, . This single-random variable statement needs no independence assumption; independence enters when applying it to the factors for a sum in the Hoeffding inequality. Both signs of are allowed, and equality holds at or when .[ref]
In the convention for a centered sub-Gaussian random variable , the Hoeffding lemma supplies . This upper parameter need not equal the actual variance. For a Bernoulli random variable of success probability ,The actual variance is , whereas the supplied parameter is for every . This explains part of the conservatism visible in Hoeffding sample size for Bernoulli frequencies.
A short proof exposes why the constant is . Put and define exponential tilting byThe tilted probability measure has the same interval of possible values, and differentiating the cumulant-generating function gives . Boundedness justifies these derivatives for every finite . Under any such tilted law, Popoviciu's inequality on variances gives : the variance is no larger than the expected value of the squared distance from the interval midpoint, itself at most . Since , the integral form of Taylor's theorem yieldsThis expression handles either sign of without changing the argument.
The constant cannot be reduced uniformly over all essentially bounded real random variables. Equal endpoint probabilities at and give , a scaled Rademacher random variable, andThus the sharpness is already forced near zero by the variance; the bound need not be equality at nonzero parameters for a particular probability distribution.
Laplacian as departure from a local average 2026-10-18
The Laplacian detects whether a value lies below or above nearby values, to second order. For a scalar field whose partial derivatives through order four are continuous functions, take the arithmetic mean of four equally spaced neighbors:Applying Taylor's theorem in each coordinate cancels the first- and third-order terms between opposite neighbors. The two pairs leaveThis is an asymptotic expansion, rather than an equality for arbitrary . Rearranging gives the familiar central finite difference approximationThis finite difference replaces partial derivatives by five sampled values. The arithmetic mean lies above the center for a sufficiently small if the Laplacian is strictly positive there, and below if it is strictly negative. A zero Laplacian cancels this second-order discrepancy without requiring equality of individual values.
At , the bowl has center value zero and four neighbor values , so the discrepancy is exactly . The saddle has neighbor values , whose arithmetic mean is exactly zero. For the Gaussian function the discrepancy is , agreeing with .
A harmonic function need not equal this four-neighbor arithmetic mean for a finite . The polynomial has everywhere, but . Higher-order terms remain even when the second-order terms cancel.
At a local minimum, each coordinate second derivative is at least zero, hence the Laplacian is at least zero. At a local maximum the inequality reverses. The sum alone does not characterize an extremum: cancellation at a saddle point of a scalar function can also produce zero. The local-average interpretation explains why the heat equation smooths differences, and helps motivate the heat equation maximum principle.
Local quadratic convergence of Newton iteration Created 2026-10-14 Updated 2026-10-18
Let be twice continuously differentiable on an interval around a zero of a function , with and there. Choose a closed interval inside that interval with . Starting inside it makes the Newton root-finding iteration well defined, keeps it inside, and gives the displayed quadratic convergence bound for . The nonzero derivative and sufficiently close start are essential hypotheses. The scalar estimate follows from the Taylor remainder argument in MIT's root-finding notes.[ref]
https://ocw.mit.edu/courses/18-330-introduction-to-numerical-analysis-spring-2012/5b325bfa56a599794c7196de926844b0_MIT18_330S12_Chapter4.pdf. Laurent Demanet, MIT 18.330, Chapter 4, pp. 2–3, 2012
For a short proof outline, apply Taylor's theorem between and ; subtract the defining tangent line equation. The linear error cancels, leaving . The displayed bound shrinks the error and preserves the chosen interval. If , the error ratio tends to ; if it vanishes, convergence can be faster.
Net radiative heat exchange 2026-10-14
For a small, uniform surface at temperature , enclosed by much larger black walls all at temperature , the outward net heat transfer by thermal radiation isAssume an opaque grey body that is a diffuse thermal emitter, with the same emissivity and radiometric absorptance at the surface's current temperature. Its emitting area sees only the enclosure: the view factor to the walls is one, with no self-viewing surface, opening or intervening obstruction. The intervening medium must neither absorb nor emit appreciable thermal radiation; a vacuum supplies a useful idealization. The enclosure is maintained at uniform . The small-body assumption makes that reservoir description physically reasonable; genuinely black isothermal walls supply the incoming irradiance even without an infinite area ratio. Positive means net loss by the surface; negative means net gain. This expression counts thermal radiation alone, not all heat transfer.[ref]
Thermodynamics and Propulsion. §19.1, cavity irradiance; §19.2, grey-body absorptance/emittance; §19.4, enclosed-body view factor one
The reasoning is a two-way energy balance. Black walls supply irradiance , so the surface absorbs and emits . Subtract these to obtain . For an opaque surface the remaining fraction of incoming radiant flux is reflected; counting emitted plus reflected outgoing radiant flux minus total incoming radiant flux gives the same result. Kirchhoff's law of thermal radiation justifies equal spectral absorption and emission factors; the grey body assumption lets one factor be taken outside both spectral integrals.
Choose , , and . These are stipulated model inputs, not measured material properties. Using givesThe incoming irradiance is , corresponding to incident on the surface; only is absorbed. At , emitted and absorbed powers are both , so radiative equilibrium has zero net exchange despite continuing emission. Changing only emissivity to reduces both one-way powers and the net loss by a factor of four, giving net. A low-emissivity coating therefore suppresses both radiative cooling to colder walls and radiative heating from hotter walls.
Two-way exchange in a black enclosure and the effect of emissivity
. Original schematic, not an experimental apparatus. The central convex body has total emitting area , temperature and view factor one to black walls at . Arrows show gross emission, absorbed enclosure radiation and reflected enclosure radiation for emissivity ; widths are illustrative. The graph compares stipulated emissivities under the same geometry and temperatures. Details.Near equal temperatures, write . Taylor's theorem givesFor constant emissivity, the radiative heat transfer coefficient is approximately at and . This local linear approximation is useful for small temperature differences; the difference in the worked example needs the full fourth-power expression.
A cooling experiment requires a wider first law of thermodynamics balance. In a uniform-temperature model without a heater,where is the sample's heat capacity and the last two terms are signed outward convection and thermal conduction losses. A vacuum suppresses convection but does not eliminate thermal conduction through supports or sensor leads. A cooling slope therefore cannot establish emissivity unless these paths and heat capacity are independently constrained. Multiple wall temperatures, incomplete view factors, wavelength-selective materials or appreciable intervening absorption require a more complete radiative transfer calculation.
At a zero , Taylor's theorem gives near . If some coefficient is nonzero, let be the least such index. Then with , and continuity makes nonzero on a smaller disc. Thus is an isolated zero. A limit point of zeros is also a zero by continuity and cannot be isolated, so all Taylor coefficients there vanish and vanishes on a nonempty open disc.
Let be the set of points having a neighborhood on which vanishes. It is nonempty and open. A point in its relative closure either already belongs to or is a limit point of distinct zeros; the preceding argument puts it in in either case. Thus is also relatively closed. Connectedness of gives , proving is identically zero.
For conjugate reflection, the disc is invariant under conjugation, andHence is holomorphic, with derivative . If is real on the real diameter, then for real , . The holomorphic difference therefore has zeros accumulating at zero, and the identity theorem just proved gives on the entire disc.
Past exam of the calculus of variations course of the University of Oxford 2010 1 b ii Solution 2026-10-31
Zero is a strict strong local minimizer, and therefore also a strict weak local minimizer. Here , andFor , Taylor's theorem gives . Also and the Cauchy-Schwarz inequality give . ThereforeThe coefficient is positive. Thus every nonzero admissible with has strictly greater energy, proving that zero is a strict strong local minimizer of a variational integral.
Past exam of the calculus of variations course of the University of Oxford 2011 2 b ii Solution 2026-10-31
Here . First restrict . On that slope interval, the second derivative of is . Taylor's theorem givesThe linear term integrates to zero because . Since , the Poincaré inequality yieldsThe coefficient is positive. Thus zero is a strict weak local minimizer.
For failure of strong minimality, take a triangular bump supported on , with slopes and , and zero outside. Its height is . Almost everywhere its slope is or , so the cosine term has exactly its zero-function value everywhere. The potential term is strictly negative on the bump. ThereforeHence it is not a strong local minimizer. The derivatives of these bumps stay large, so they do not contradict weak local minimality.
Past exam of the mathematical methods II course of the University of Oxford 2013 resit 7 Solution 2026-10-25
Let . At the expansion point, the function and its first three derivatives have values , , and . Taylor's theorem therefore givesFor real , the magnitude of the omitted fourth-order remainder is at most , because the fourth derivative is another cosine and has magnitude at most one.
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 53 3 a Solution Created 2026-10-03 Updated 2026-10-14
At a current approximation , Taylor's theorem replaces by the affine equation . Solving this equation gives the Newton iteration in a Banach spaceThe inverse is a bounded linear inverse by the bounded inverse theorem. The displayed operator is defined where the derivative is invertible, in particular on the specified open domain; the hypotheses do not supply a globally defined Newton operator on all of . If with in that domain, then .
For quadratic convergence, choose a sufficiently small neighbourhood of . Continuity of the inverse derivative and of gives constants there such thatPut and . The quadratic Newton error bound in a Banach space follows from the integral remainder:soTake a closed radius- ball lying in the neighbourhood with . This inequality maps the ball into itself and makes errors tend to zero. More explicitly, for , induction gives . Hence every sufficiently close initial point converges to at least quadratically; special maps can converge still faster.
For a fixed-point equation, apply the same method to . Wherever is invertible, the exact adapted map isEvery fixed point of is fixed by , and conversely on this domain. This additional invertibility condition is distinct from invertibility of ; for example, is invertible but is not.
For certification, a frozen Newton correction for a fixed-point equation is often more useful. Choose a bounded, injective approximate inverse of and setAgain if and only if . A well-chosen makes the corrected operator contract even if the original operator has an expanding direction. The subsequent contraction mapping argument requires the stated derivative and residual bounds; it does not assume that arbitrary inverse approximations provide them.
Past exam of the mathematics course of the University of Cambridge 2002 ia Paper 1 12C Solution Created 2026-09-24 Updated 2026-10-14
For a function with continuous derivatives through order on the interval between and , the Taylor formula with integral remainder isThis is Taylor's theorem about zero; translation gives the formula about any other point. To prove it, the case is the fundamental theorem of calculus. For , integration by parts givesSubstitution into the formula at order proves the formula at order by induction. The integral estimate, valid also for negative , isFor the smooth function satisfying , each fixed derivative is continuous on and hence is bounded there by the extreme value theorem. Thus a bound exists for every . Differentiating the differential equation repeatedly gives . Only the three functions are needed: take to be the maximum of their absolute-value bounds on . Then simultaneously for every and .
At zero the derivatives consequently repeat the values . Taylor's theorem therefore givesThe last limit of a sequence follows because the ratio of consecutive majorants is , eventually less than . Since is arbitrary, Taylor expansion from a periodic derivative equation provesThis proves convergence to the function using a remainder bound; it does not assume beforehand that a smooth function equals its Taylor series.



