Adaptive Euler step doubling for exponential decay Created 2026-10-14 Updated 2026-10-14
Consider the nonstiff scalar initial value problem , , on . Its exact solution is the exponential decay . Use step-doubling error estimation with the explicit Euler method: from the same numerical starting value , form one coarse step and two half steps giving :Accept when the absolute and relative error tolerances test passes, with . There is no Richardson extrapolation in the accepted value. Both approximations have order of a numerical method one, while this local error estimator has step exponent . Consequently the adaptive step-size controller uses a square root, not a cube root:Start with . A rejected trial retains both and , caps at one, and retries. A zero estimate uses . Before every trial, cap at . Stop with a failure if floating-point arithmetic gives , or after 100000 trials. These rules specify the example completely; they are not a prescription for every ordinary differential equation solver.
Adaptive two-half-step Euler decay: exact and numerical trajectories, accepted step sizes and rejected trials
. Details. The first two trials, and , have and and are rejected. The next trial has and and is accepted. For positive decreasing numerical values, , so the local error estimator givesWhen the relative term dominates, this suggests nearly constant accepted steps, approximately . When falls below the crossover size , the absolute term increasingly permits longer steps. The sharp final decrease in only lands on ; it does not indicate a sudden loss of smoothness.
The actual signed local defect from the same numerical input isHere is Big O notation, obtained from Taylor's theorem for the exponential function. Thus agrees with the leading term as , but is not identical to . At , , the estimate is while the actual local defect is . Their closeness improves for the smaller accepted steps. Had we added using Richardson extrapolation, the accepted formula would instead be , of order of a numerical method two; the same raw difference would still scale as and would not estimate that improved value's leading defect.
Estimated versus actual local Euler defects, rejected trials, and actual accumulated global error scaled by the local tolerance
. Details. The global error obeys an exact recurrence relation involving the actual local defects:Each previous global error contracts, yet the local defects keep adding. In the plotted run, 101 steps are accepted and two trials are rejected. Every accepted is at most approximately , while the largest is approximately . At , the numerical value is approximately , compared with the exact , giving absolute error approximately . The right-hand plot deliberately scales actual global error by the same used for local acceptance; it is not a new global error tolerance test.
Tightening both absolute and relative error tolerances by a factor ten gives 315 accepted steps and endpoint absolute error approximately ; tightening both by a factor one hundred gives 991 accepted steps and endpoint absolute error approximately . This is a convergence comparison for this particular initial value problem. The endpoint error decreases by about a factor three per tenfold tightening, rather than by ten: a first-order Euler method accumulates defects across many steps, while its local error estimator varies quadratically with . A variable-step global ODE error bound needs propagation information as well as accepted local tests.
The absolute stability boundary remains a separate constraint. On the Dahlquist test equation with , the accepted two-half-step formula has stability function . It strictly damps perturbations only for . Its local error estimator is , which can pass an absolute-tolerance test at tiny even outside this damping interval. In a stiff two-mode linear system, a fast mode can therefore constrain the step long after its visible amplitude has become small. An adaptive step-size controller does not turn an explicit Euler method into an A-stable method. Official solver documentation likewise distinguishes explicit Runge-Kutta methods for nonstiff problems from implicit Runge-Kutta methods and backward differentiation formulas for stiff equations.[ref]
scipy.integrate.solve_ivp. solve_ivp, method parameter: explicit versus implicit methods and stiffness
Amplification polynomial of a multistep method Created 2026-10-05 Updated 2026-10-14
Applying a linear multistep method to the Dahlquist test equation with produces a constant-coefficient recurrence whose modes satisfy . Absolute stability requires the resulting roots of a polynomial to lie in the unit disk, with unit-modulus roots simple. Thus multistep stability depends on every recurrence mode, rather than a single one-step stability function.
Amplification root 2026-10-14
An amplification root is a root of a polynomial governing a geometric mode of a numerical recurrence on the Dahlquist test equation. Its modulus measures damping or growth per step. A repeated root produces additional modes such as ; therefore a unit-circle root can be permitted by a bounded-root condition only when it is simple. The principal root approximates near zero, while additional roots can describe parasitic amplification roots.
The endpoint expansion of this multiderivative multistep method has unscaled defect and zero-stability roots , giving third-order convergence with suitably accurate starting values. On the Dahlquist test equation its amplification roots obey . The complex quadratic Schur criterion puts both roots in the open unit disk for , and only the simple root one reaches the boundary at . Thus it is A-stable; its higher derivative places it outside the hypotheses of the Second Dahlquist barrier.
On the Dahlquist test equation, write the amplification polynomial as , where and . The identity shows that both roots of a polynomial can lie inside the open unit disk only if . But the complex quadratic Schur criterion would then require , which is impossible. Thus the strict linear stability domain is empty. This concerns robust damping of all modes, rather than convergence on fixed time intervals or the bounded-root stability set of the symmetric two-derivative formula.
Euler method 2026-10-14
The Euler method approximates an initial value problem , , by evaluating the derivative at the current point and moving along that tangent line for a time . With , its displayed update needs one evaluation of per step. This simple rule turns local slope information into a whole approximate trajectory. MIT's course notes derive it by dropping the second-order Taylor remainder.[ref]
Take , , whose exact solution is the exponential function . The Euler method givesAt , the first values are . At , five steps give , compared with . The result decays but is too small: absolute stability alone does not ensure accuracy. At , the first values are , and at five steps give , while the exact solution is about .
For the Dahlquist test equation , the Euler method has stability function with . Its absolute stability region is , the closed disk centred at with radius one. For the present real decay problem and , bounded numerical values require ; strict decay requires . At the values alternate without decay. These conditions follow directly from the amplification factor , matching MIT's criterion for .[ref]
https://web.mit.edu/10.001/Web/Course_Notes/Differential_Equations_Notes/node3.html. MIT 10.001, Forward and Backward Euler Methods, linear decay example
The Euler method is first order: with bounded second derivative and suitable Lipschitz continuity, its global error is on a fixed interval. In this example the logarithm gives for small positive . At , this means . It explains both the downward bias and why halving the step roughly halves the error once is sufficiently small.
Fourth-order conditions for a Runge-Kutta method Created 2026-10-05 Updated 2026-10-14
With and , a Runge-Kutta method has order at least four exactly when the eight Butcher order conditionshold; powers of are componentwise. These conditions match the numerical and exact coefficients indexed by rooted trees through order four. Matching the scalar Dahlquist test equation alone is insufficient to check the nonlinear Butcher order conditions.
On the Dahlquist test equation, the symmetric two-step two-derivative formula has amplification polynomial . For every real , its leading coefficient is positive and , whereas as . The intermediate value theorem therefore gives a real root below minus one. Thus the method is not A-stable, without any appeal to a multistep order barrier.
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 57 1 Solution Created 2026-10-03 Updated 2026-10-14
Let be the coefficients of the -stage Runge-Kutta method. On the Dahlquist test equation , its stability function isBoth polynomials have degree at most , with denominator normalized to one at zero. Order implies . A rational function with these degree bounds and this accuracy is uniquely the diagonal Padé approximant . To see uniqueness directly, if and have the required accuracy, then is a polynomial of degree at most vanishing to order at least at zero, hence identically zero.
The diagonal exponential Padé approximant can be writtenUse the permitted Padé property that the zeros of lie strictly in the right half-plane and numerator and denominator are coprime. Thus has no poles in the closed left half-plane. Its real coefficients give , so . Also at infinity. Applying the maximum modulus principle on left half-disks and letting their radii increase proves for . There are no hidden stage poles there either: the irreducible Padé denominator has degree , exhausting the possible degree of , so the latter cannot contain an additional canceled factor. Every such maximal-order Runge-Kutta method is A-stable. This is maximal-order Runge-Kutta methods are A-stable; it does not assert L-stability, since the stability function does not tend to zero at infinity.
Past exam of the mathematics course of the University of Cambridge 2003 iii Paper 67 1 a Solution Created 2026-10-03 Updated 2026-10-14
Introduce one stage with , and update . This is the implicit midpoint rule as a one-stage Runge-Kutta method, with Butcher tableauFor a smooth vector field, write . Expanding its stage equation giveswhich matches the exact Taylor expansion through degree two. The method therefore has order at least two. On the Dahlquist test equation , its stability function isThe third coefficient differs from the exponential's , so the order is exactly two.
There is no pole in , andThus throughout the closed left half-plane:This conclusion is A-stability, not strong damping of arbitrarily stiff modes: along the negative real axis.
Past exam of the mathematics course of the University of Cambridge 2003 iii Paper 67 2 b Solution Created 2026-10-03 Updated 2026-10-14
Only needs consideration, by the preceding zero-stability analysis. On the Dahlquist test equation, all roots of the amplification polynomialmust satisfy the unit-disk root condition if the method is A-stable. Evaluate it at :Take a real negative . Then , whereas the leading coefficient is positive and as . The intermediate value theorem gives a real root strictly below . Its numerical mode grows in modulus, contradicting absolute stability at this negative test parameter. ConsequentlyThis proof detects an unstable root directly; the second-order value alone would not exclude A-stability. Equivalently the limiting derivative polynomial has an exterior root , explaining the instability for large negative .
Past exam of the mathematics course of the University of Cambridge 2004 iii Paper 69 1 a Solution Created 2026-10-03 Updated 2026-10-14
Apply the Runge-Kutta method to the Dahlquist test equation and put . Its stability function isSince is an invertible matrix, has polynomial degree . The adjugate matrix formula gives , but the additional condition givesso actually . The specified order of a numerical method implies near zero. Therefore the Padé identification of a Radau stability function makes the Padé approximant to the exponential function: its numerator and denominator have the required degrees, and its Taylor series agrees through degree .
In the permitted A-stability of near-diagonal exponential Padé approximants, take , . Then , so the scheme is A-stable. The same stability function also tends to zero at infinity, giving L-stability.
Past exam of the mathematics course of the University of Cambridge 2004 iii Paper 69 5 b Solution Created 2026-10-03 Updated 2026-10-14
The stability convention matters. The Cambridge numerical analysis notes define a strict linear stability domain through decay . For a multistep recurrence, robust decay requires every amplification root to lie strictly inside the unit disk. With that convention we can prove the stronger result that this method's strict linear stability domain is empty, and therefore bounded. Mere boundedness of oscillatory sequences gives a different answer, described below.
On the Dahlquist test equation, . With , the amplification polynomial of a multistep method isExclude , where the intended two-step update cannot be solved. If both polynomial roots have modulus below one, their product requires . Butso necessarily . The complex quadratic Schur criterion also requiresIts left-hand side equals , while for its right-hand side is only . The inequality is impossible. ThusFor comparison, the bounded-root stability set of the symmetric two-derivative formula is unbounded. On , rotate the amplification polynomial into a real reciprocal quadratic. Its two roots are distinct and on the unit circle precisely whenequivalently or . In particular, arbitrarily large imaginary parameters give bounded, undamped numerical oscillations. At the two equality thresholds, repeated unit-circle roots produce unbounded solutions. Hence the question's bounded-domain claim holds for the strict decay convention; it does not hold if the phrase is interpreted using the non-growing root condition for a multistep method.
Past exam of the mathematics course of the University of Cambridge 2005 iii Paper 69 2 c Solution Created 2026-10-03 Updated 2026-10-14
For the Dahlquist test equation, write . The amplification roots solveA root on would require the boundary-locus valueIts denominator cannot vanish on that circle. Setting and simplifying the real part givesThus no amplification root can cross the unit circle while . The leading coefficient is also nonzero throughout that half-plane. At , the roots are , both strictly inside the unit disk. Connect any other left-half-plane point to : continuity of the roots, without a boundary crossing or a root escaping through infinity, keeps both roots inside.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 71 1 b Solution Created 2026-10-03 Updated 2026-10-14
Apply the method to the Dahlquist test equation , so , and put . A trial numerical mode satisfiesFor every real , the leading coefficient is positive, whileThe intermediate value theorem gives a real amplification root . Its modulus exceeds one although the exact scalar solution is decaying. ThereforeFor a concrete choice, gives , whose negative root is . This proves negative-real instability of the symmetric two-derivative formula directly, without using either an order barrier or the supplied quadratic criterion. The unstable branch is the parasitic amplification root issuing from at ; its small-step expansion is , so a negative moves it outside the unit circle immediately.
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 80 1 b Solution Created 2026-10-03 Updated 2026-10-14
Consistency was established in part (a). By the Dahlquist equivalence theorem, convergence additionally requires the root condition for a multistep method. Since , its roots lie in the closed unit disk with each unit-modulus root simple exactly forThe endpoint is zero-stability although it has a simple parasitic root at minus one; has a repeated root at one and is excluded.
For every parameter in this convergent range, the leading coefficient of is , whileSince as , it has a real root . Its other real root lies between minus one and one because , so the exterior root is simple.
On the Dahlquist test equation, the amplification polynomial of a multistep method is , with . For , the equivalent polynomial tends coefficientwise to , and its leading coefficient stays nonzero. Choose a small closed disk about lying wholly outside the unit disk and containing no other root of . On its boundary has a positive minimum, while is smaller for every sufficiently large . Rouché's theorem then puts one root of inside this exterior disk for all such complex .
That root violates the stability root condition for a multistep method. Hence there is a finite radius beyond which no point belongs to the absolute stability domain:This proves boundedness in every complex direction, rather than only excluding A-stability. It is an instance of exterior roots of the derivative polynomial bound multistep stability.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 2 c Solution 2026-10-14
Apply the method to the Dahlquist test equation, put , and retain every root of its amplification polynomial of a multistep method:An A-stable convergent method must satisfy the root condition for a multistep method for every .
First take . As negative real tends to minus infinity, one root tends to the nonzero root of ,It follows by root continuity that some sufficiently negative finite is unstable. At , the recurrence has polynomial ; for any negative real , its root is below . Thus all negative convergent parameters are excluded.
For , use the boundary-locus test for multistep A-stability. A unit root with would require . Direct multiplication by the conjugate denominator givesThere is therefore no unit-root crossing in the open left half-plane. The leading coefficient of never vanishes there, since its only zero is the positive real value . For a small negative real , the simple root initially at one moves to , inside the disk, and the other root is close to , also inside. Continuity of polynomial roots and connectedness of the open left half-plane then keep both roots strictly inside throughout that half-plane. Possible zeros of cause no omitted crossing: for its other root lies strictly inside the unit disk, while at its unit-circle zero has .
On the imaginary axis, if the displayed real part vanishes only at , which corresponds to and is simple. Other imaginary-axis parameters retain strictly interior roots. If , the two roots are zero and the stability function , whose modulus is one on that axis; the unit root is simple. Thus the required boundary root condition for a multistep method holds as well.
Combining necessity and sufficiency givesIn particular, the third-order member is convergent but not A-stable, in agreement with the Second Dahlquist barrier.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 4 b Solution Created 2026-10-03 Updated 2026-10-14
The Butcher contractivity theorem states that an algebraically stable Runge-Kutta method is B-stable: for a dissipative vector field and any positive step for which the stage problems are solved, its step does not increase the distance between two numerical solutions. The required condition on the dissipative vector field isfor all compared states at each common time. The inner product can be real Euclidean or complex Hermitian. The stage solvability of an implicit Runge-Kutta method is assumed in this comparison, not a conclusion from a distance estimate alone.
Let be the difference of starting values, the differences of corresponding stages and the differences of their vector-field values. ThenExpanding the squared norm of the update givesSubstitute in the linear term. Symmetrizing the double sum proves the Runge-Kutta contractivity identityEach inner product in the first sum is nonpositive by the defining inequality for a dissipative vector field, and its weight is nonnegative. The final quadratic form is nonnegative: resolve the vectors into components and apply positive semidefiniteness of to each component vector. Hence , which is exactly B-stability. No linearization of the vector field has been used.
For the Dahlquist test equation with , this also bounds the amplification factor by one wherever the stages are well defined. With strictly positive weights, no stage pole can occur in the open left half-plane. Indeed, if for nonzero , thenwhen , contradicting . This proves the usual A-stability corollary for the scalar stability function; boundedness from the open half-plane makes any boundary pole in that rational function removable. Zero-weight redundant stages require their own solvability treatment. The nonlinear B-stability statement is stronger than A-stability, and the two notions should not be conflated.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 7 Solution Created 2026-10-03 Updated 2026-10-14
A fixed-step linear multistep method for uses several previous solution and derivative values:The coefficients are fixed independently of the step size. It is explicit when and implicit otherwise. Its characteristic polynomials of a linear multistep method are and . The contraction mapping theorem gives a uniquely solvable implicit step under a Lipschitz continuity bound whenever , by contraction of the new-value equation on the appropriate solution region. A suitable starting procedure must supply the first values; the method alone does not determine them.
Order is defined by inserting a smooth exact solution into the recurrence. If the residual is and its first nonzero coefficient occurs at that degree, the method has order ; dividing the residual by gives an local truncation error. Taylor expansion gives the exact order conditions for a linear multistep methodwith the right side interpreted as zero at , and failure at for exact order. Equivalently,The basic consistency of a numerical method conditions are , ; for the ordinary nondegenerate consistent formulation this common value is nonzero. Exactness on constants and linear functions does not control propagation of numerical perturbations.
That propagation is the role of zero-stability. On the homogeneous recurrence is . Its modes are , with powers of determined by root multiplicities. The theorem on the root condition for a multistep method states that zero-stability is equivalent to every root of having modulus at most one, with every unit-modulus root simple. Interior repeated roots are permitted, since geometric decay dominates their polynomial factors. An exterior root amplifies perturbations geometrically; a repeated unit root amplifies them polynomially and violates a step-independent perturbation bound.
The Dahlquist equivalence theorem states that a fixed-step consistent linear multistep method is convergent exactly when it is zero-stable. This concerns ordinary differential equations with a uniformly Lipschitz continuous right-hand side on the solution region over a fixed finite interval, convergent starting values, and the well-defined nearby branch of each small-step implicit solve. For order convergence of a numerical method, the solution must have the required smoothness and the starting errors must be .
The mechanism can be sketched explicitly. The root condition for a multistep method bounds the recurrence's discrete Green function. For an order- exact-solution defect , the Lipschitz continuity error equation then gives an estimate of the formThe current-step term can be absorbed for small . The discrete Gronwall inequality says that a bound implies . There are defects on a fixed interval, so their sum is and this yields the claimed global order. Conversely, testing with vanishing starting perturbations in exterior-root or repeated-unit-root modes proves that convergence of a numerical method fails without the root condition for a multistep method.
For example, the two-step Adams-Bashforth method hasIt is explicit, order two and zero-stable, hence convergent with order-two starting values. By contrast, a recurrence with has solutions on the zero differential equation. Starting differences tend to zero yet become unbounded at a fixed positive time, since is of order . A small local defect or formal high order cannot rescue this mode. Canceling a common factor may remove it only by changing the allowed starting relations, as the parameter endpoint in Question 2 illustrates.
Absolute stability addresses a different limit: apply the method to the Dahlquist test equation and put . The amplification roots satisfyAll roots must satisfy the disk condition, with unit roots simple; one cannot inspect only the root that tends to one as . The degree and solvability of the recurrence must also be preserved. The resulting set of is the domain of absolute stability. A-stability means that it includes the whole closed left half-plane, so the numerical solutions of every Dahlquist test equation with are stable for every positive step size. It is a linear test-equation property, not a proof of arbitrary nonlinear contractivity or high accuracy at large steps.
Forward Euler method has order one and factor , so its stability region is the disk . Backward Euler method has factor and is A-stable. The trapezoidal rule is order two with factor ; its modulus is at most one throughout the left half-plane. These one-step methods are included as the simplest multistep examples. For the two-step Adams-Bashforth method, the negative-real stability interval is : its polynomial is , and the root reaches at . It therefore imposes a step restriction when applied to strongly decaying modes.
The genuinely two-step BDF2 method isIt has order two, roots at zero step and is A-stable. For its normalized polynomials , , the unit-circle boundary locus hasThe leading coefficient has no zero in the left half-plane, and the roots at a small negative are both inside the disk. Root continuity then proves open-half-plane stability; on the imaginary boundary the only possible unit root is the simple root one at . This gives a direct proof of the stated A-stability rather than relying on a boundary plot.
Two sharp order barriers explain the tradeoff. The first Dahlquist barrier states that a consistent zero-stable real linear -step method using only first derivatives has order at most for odd and for even ; an explicit method has order at most . The Second Dahlquist barrier states that an irreducible A-stable real linear multistep method has order at most two. These statements concern fixed constant coefficients and the ordinary first-derivative multistep class, not multiderivative methods or arbitrary variable-step formulations. Thus higher order alone is not a route to unconditional stiff stability. Question 2 provides a concrete illustration: its third-order member is zero-stable but not A-stable.
No nontrivial consistent explicit multistep method is A-stable. Its amplification polynomial of a multistep method has a fixed highest coefficient, while at least one lower coefficient grows without bound as real . Were all roots uniformly in the unit disk, their elementary symmetric polynomials would keep all the monic coefficients bounded, a contradiction. This is the coefficient argument behind explicit multistep methods cannot be A-stable.
In practice, selecting a method therefore involves accuracy, startup, the presence of a stiff differential equation, implicit-solve cost and step-size control. Zero-stability handles propagation as the step tends to zero; consistency of a numerical method supplies a vanishing defect; A-stability handles the numerical solutions of all decaying Dahlquist test equations at finite steps. None substitutes for the others, and variable steps or PDE discretizations require additional uniform stability arguments appropriate to their setting.


