Euler method Created 2026-10-14 Updated 2026-10-20
The Euler method approximates an initial value problem , , by evaluating the derivative at the current point and moving along that tangent line for a time . With , its displayed update needs one evaluation of per step. This simple rule turns local slope information into a whole approximate trajectory. MIT's course notes derive it by dropping the second-order Taylor remainder.[ref]
Take , , whose exact solution is the exponential function . The Euler method givesAt , the first values are . At , five steps give , compared with . The result decays but is too small: absolute stability alone does not ensure accuracy. At , the first values are , and at five steps give , while the exact solution is about .
For the Dahlquist test equation , the Euler method has stability function with . Its absolute stability region is , the closed disk centred at with radius one. For the present real decay problem and , bounded numerical values require ; strict decay requires . At the values alternate without decay. These conditions follow directly from the amplification factor , matching MIT's criterion for .[ref]
https://web.mit.edu/10.001/Web/Course_Notes/Differential_Equations_Notes/node3.html. MIT 10.001, Forward and Backward Euler Methods, linear decay example
The Euler method is first order: with bounded second derivative and suitable Lipschitz continuity, its global error is on a fixed interval. In this example the logarithm gives for small positive . At , this means . It explains both the downward bias and why halving the step roughly halves the error once is sufficiently small.
Consider an implicit centered heat stencil of width weighted by , combined with an explicit centered stencil of width weighted by . With , its amplification factor is . For , contraction in the discrete norm holds exactly under the displayed condition. It is unconditional for . Put : the condition reduces to . Maximizing this concave quadratic proves the threshold; the Parseval identity converts the multiplier bound into contraction.
Lax-Wendroff advection scheme Created 2026-10-06 Updated 2026-10-14
For the advection equation on a uniform grid, the Lax-Wendroff update isIts amplification factor is , with . Thus von Neumann stability analysis on an infinite or periodic grid gives stability for . The scheme has second order of a numerical method for sufficiently smooth solutions; finite-interval boundary conditions still need separate treatment.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 71 3 b Solution Created 2026-10-03 Updated 2026-10-14
For a Fourier mode , defineThe amplification factor is . To derive its stability condition, use the coefficient abbreviations from the preceding solution and set . The squared moduli areHere , , and . Subtraction and factorization giveThus for every frequency exactly when , provided the implicit denominator does not vanish. For the physically nonnegative Courant number, this givesFor a signed convention the full real range is .
There is no hidden denominator failure in these ranges. If and , the identity forces and ; but . If , then , and could vanish only when its two real coefficients have equal magnitudes. Their sum is three, so equality requires , which is not a root of . Hence is nonzero for every frequency in the allowed ranges. On the compact frequency interval its inverse is bounded for each fixed allowed .
When , choose a small nonzero frequency. The denominator remains close to three, while the boxed identity gives . Its fixed-frequency numerical mode grows geometrically, proving instability in the usual fixed-Courant refinement limit. Conversely, for , the Plancherel theorem converts the mode bound into a discrete L2 norm contraction on the whole-line or periodic grid. The large-Courant branch is possible because the scheme is implicit; stability alone does not promise small error at a large step.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 68 6 Solution Created 2026-10-03 Updated 2026-10-14
For an evolutionary partial differential equation, stability of a numerical method means that errors in the starting data and forcing stay controlled on each fixed interval , with constants independent of the mesh. Fourier stability analysis is especially effective for a constant-coefficient finite difference method on a uniform infinite or periodic grid: translation invariance makes different Fourier modes evolve independently.
For a scalar one-step scheme on the integer lattice, insert , with . The Fourier symbol of each shift is , and the update reduces toThe amplification factor must be defined for every relevant frequency; for an implicit scheme this includes checking that its denominator is nonzero. The Parseval identity turns a bound into a discrete L2 norm bound. Thus gives contractivity, while the more general bound gives for . Conversely, frequencies with amplification uniformly greater than one produce unstable wave packets or periodic Fourier modes under refinement.
For a system, is an amplification matrix; for a multilevel scheme, a companion matrix evolves the vector of time levels. The actual requirement is a uniform bound on matrix powers, not just their spectral radius. A nontrivial Jordan block at a unit-modulus eigenvalue creates polynomial growth in the time index. Even simple eigenvalues inside the unit disk can fail to give a uniform bound if the eigenvector matrices become ill-conditioned as the mesh changes. Uniformly controlled diagonalization of a matrix, or a suitable quadratic energy estimate, resolves this issue. The power boundedness of a two-level Fourier scheme illustrates why root multiplicities and conditioning matter.
For the heat equation, put . Centered space with the Forward Euler method hasThe von Neumann stability analysis condition holds exactly for on the full frequency interval. The Backward Euler diffusion scheme instead has and is stable for every . The Crank-Nicolson diffusion scheme hasIt too is unconditionally stable, but poorly resolved high-frequency modes have for large , giving oscillatory numerical transients. A-stability therefore does not guarantee strong damping; L-stability distinguishes the damping of the Backward Euler method.
For the advection equation , let . Forward time and centered space giveFor nonzero fixed , repeated steps amplify some modes by a fixed factor greater than one, so the method is unstable under the usual refinement . This calculation also shows the refinement qualification: if , its finite-time growth can be bounded by , though the restrictive scaling defeats the usual hyperbolic time-step choice. For , the upwind finite difference scheme hasso it is stable for . The Lax-Wendroff advection scheme instead hasgiving . These examples separate the effects of the spatial stencil, temporal approximation and Courant number; a higher order of a numerical method by itself does not establish stability.
A periodic boundary condition is ideal for this analysis. The discrete Fourier transform diagonalizes the circulant update, with only the discrete frequencies needed on a grid of points. A bound on all is a convenient guarantee over every such grid. On the whole line, the Fourier transform uses a continuous frequency interval and the Parseval identity proves the corresponding square-summable-data estimate.
Homogeneous Dirichlet boundary conditions do not admit arbitrary complex exponential Fourier modes. For the standard centered second difference on interior points, a discrete sine transform diagonalizes the actual boundary-value matrix:The same heat amplification formulas then apply at these sine frequencies. For example, the exact forward-Euler contractivity limit on that fixed grid is ; the mesh-independent sufficient limit follows by including all frequencies. Homogeneous Neumann boundary conditions can similarly permit a discrete cosine transform, provided the endpoint discretization and its weighted inner product are chosen consistently. The constant mode is then present, reflecting conservation of the heat equation's spatial mean. For inhomogeneous boundary conditions, subtract a suitable lifting of the prescribed boundary data and estimate the induced source using the homogeneous evolution's bound and a Duhamel principle estimate. Bounds for the lifting and source must themselves be uniform in the mesh.
General boundary conditions require separate boundary stability of a finite-difference method. For an advection equation, incoming data are prescribed at the inflow boundary, while an outflow closure must respect the outgoing characteristics. An interior periodic Fourier symbol cannot detect a growing mode confined near a boundary. A normal-mode test on a half-line seeks modes with and that satisfy both the interior recurrence and boundary closure. Their existence proves instability, and uniform control requires more than merely excluding isolated growing roots; the Uniform Kreiss--Lopatinskii condition addresses boundary resolvent bounds. Alternatively, a direct energy method using summation by parts can include the boundary terms and establish the required estimate.
Variable coefficients and nonuniform meshes usually destroy exact Fourier transform diagonalization. Frozen-coefficient Fourier stability analysis is then a useful diagnostic, but it is not automatically a proof for the full variable-coefficient boundary problem. The mesh-uniform energy method in question 5 is an example of a direct proof. Also, an L2 norm proof is not automatically a mesh-uniform maximum-norm proof: finite-dimensional norm-equivalence constants may grow with the number of grid points.
Finally, stability measures error propagation; consistency of a numerical method measures the defect of inserting the exact solution. For a well-posed linear initial-value problem in the chosen norm, the Lax equivalence theorem says that a consistent approximation is convergent exactly when it is stable. Boundary discretization and starting data must be included in that assertion. A Fourier calculation proves convergence only after consistency, well-posedness and the actual boundary treatment have also been checked.
Past exam of the mathematics course of the University of Cambridge 2015 ii Paper 3 38E b Solution Created 2026-09-24 Updated 2026-10-20
For the Fourier mode , the forward Euler method has amplification factorIt is real and ranges from to . The two-dimensional Fourier stability analysis therefore requires its minimum to be at least . Thus the exact stable range isThe endpoint is included; the highest-frequency mode then has amplification and bounded norm.
Past exam of the mathematics course of the University of Cambridge 2019 ii Paper 3 40C b Solution Created 2026-09-24 Updated 2026-10-03
Let be the symmetric Dirichlet second-difference matrix on the interior points. The method isThe orthogonal sine vectors diagonalize , with eigenvaluesBecause the two time-level matrices are real symmetric polynomials in the same symmetric matrix, they share this orthonormal eigenbasis. Whenever the left matrix is invertible, the amplification matrix is therefore normal, so its Euclidean operator norm is the largest modulus of its eigenvalues. The th amplification factor isFor the physical Courant number ,Hence exactly when . Requiring this uniformly for every mesh, whose values become dense in , givesEquivalently, and . Under these inequalities the denominator is nonzero for every : if this is immediate, while if then gives . Thus the necessary and sufficient mesh-uniform stability conditions areThis is the stability of a two-parameter implicit-explicit diffusion scheme. If consistency with the stated diffusion equation is also required, comparison of the leading Taylor terms gives , so and the stable consistent family has .
Past exam of the mathematics course of the University of Cambridge 2021 iii Paper 341 4 c Solution 2026-09-29
Forward Euler method giveswhereIts amplification factor isWriting , the condition for every is equivalent toThereforewith the second bound omitted when .
Past exam of the mathematics course of the University of Cambridge 2021 ii Paper 3 40E a Solution Created 2026-09-24 Updated 2026-09-25
For the discrete Fourier mode , the centred second difference has multiplier . Hence the amplification factor isFor every , . The discrete Parseval identity then shows directly that the discrete norm cannot increase at any time step, proving unconditional stability for the Cauchy problem.
Past exam of the mathematics course of the University of Cambridge 2022 iii Paper 341 Section B 7 Solution Created 2026-09-28 Updated 2026-10-14
Consider first a scalar constant-coefficient Cauchy problem for a partial differential equation on the whole line. A translation-invariant spatial discretization is a convolution operator, so the discrete Fourier transform turns it into multiplication by its Fourier symbol. This reduction is exact because Fourier modes are the simultaneous generalized eigenfunctions of every translation-invariant stencil.
For a fully discrete one-step methodwrite for its amplification factor. The Parseval identity givesConsequently the exact necessary and sufficient condition for stability on every bounded time interval iswith independent of the mesh. Sufficiency follows directly from Parseval; necessity follows by choosing transformed initial data concentrated where the multiplier is largest. For a contractive scheme one can take , yielding the familiar von Neumann stability analysis condition .
For a semidiscretization with scalar symbol , the corresponding exact criterion isIndeed, the Fourier multiplier of the solution operator is . For systems, eigenvalues alone cease to be sufficient when the matrix symbol is non-normal; the necessary and sufficient statement is the uniform bound .
On the whole lattice, a finite stencil defines a Laurent operator, whose operator norm is the essential supremum of its symbol. Restricting the same stencil to a half-line gives a Toeplitz operator. The Cauchy symbol condition remains necessary for a stable initial-boundary scheme because data localized far from the boundary behave like the whole-line problem for a finite time. It is not sufficient: the boundary closure can support growing modes or amplify incoming modes even when every interior Fourier mode is stable.
Boundary stability therefore requires a uniform estimate for the forced half-line recurrence. After a Laplace transform in time and a Fourier transform in tangential variables, one solves a normal-direction recurrence. The Uniform Kreiss--Lopatinskii condition requires the boundary equations to determine its decaying roots with a uniformly bounded inverse. In practical terms, one imposes one independent boundary condition for each incoming characteristic or numerical mode and none for outgoing modes. The group velocity identifies the direction in which a narrow wave packet carries energy, so its sign helps determine which boundary is inflow and explains why a numerically generated high-frequency branch can require a boundary condition different from that suggested by its phase velocity.
For a two-step method, the Fourier substitution produces an amplification polynomial of a multilevel finite difference scheme. Every root must lie in the closed unit disk, and unit-modulus roots must be simple, uniformly in the wavenumber. For example, leapfrog differencing of givesand henceThe roots have unit modulus when , giving the usual Courant restriction . At the endpoint, a wavenumber with produces a repeated unit root and violates the uniform root condition; strict avoids this marginal linear growth. The second root is the familiar oscillatory computational mode, illustrating why a multilevel scheme requires its full amplification polynomial rather than a single multiplier.
Local errors of the Euler schemes. Let , and evaluate and its partial derivatives at an exact starting point . DefineThe exact Taylor expansion is . The forward Euler method retains only , so its one-step defect, exact minus computed value, isFor the Backward Euler method, substitution of the exact solution into the scheme gives the residualbecause . Under local smoothness, solving the implicit step changes this residual by a factor , so the one-step defect has the same leading term:These are unnormalized local truncation errors, as in the question. A convention dividing by instead gives . Both schemes have first-order global error under the usual smoothness and stability hypotheses.
Euler stability. For the Dahlquist test equation , put , with . The numerical amplification factors areStrict decay requires ; the boundary gives bounded but generally nondecaying values. For Forward Euler method,For positive real , this reduces to . The absolute stability region in the plane is the disk . For Backward Euler method, whenever , so it decays for every step size. It is A-stable and also L-stable, since for large in this half-plane. Here has the opposite sign from the alternative convention for .
Predictor-corrector accuracy. The printed two-stage construction is Heun's method, equivalentlyAlthough the second stage resembles a Backward Euler method evaluation, it uses the predicted value, so the combined method is explicit. Expand that stage around the exact starting point, puttingThenand the numerical step is . Along the exact solution, , so comparison with the exact Taylor expansion givesThus the local defect improves by one power of , giving second-order global error under the usual hypotheses. For the linear test equation the defect reduces to .
Predictor-corrector stability. Applied to the test equation, the predictor is and the second value is . Their average givesFor real positive , , so strict decay holds exactly for , the same real-axis step bound as Forward Euler method. For complex the precise condition isThe region is bounded and does not contain the full right half-plane: for example gives . It is therefore not A-stable. Its imaginary-axis values satisfy for . Better accuracy has not inherited the unconditional stability of an actual implicit Backward Euler method step.
Transforming the spatial shifts and putting gives the real amplification factorFor the denominator is at least one, so the implicit step is a bounded Fourier multiplier on . Set and use . The numerator is no greater than the denominator, so . The other inequality isIf , the bracket is nonpositive and this always holds. If , the concave quadratic has its maximum at , with value . Therefore precisely under the stated conditionand without a mesh-ratio restriction when . The Parseval identity now givesIteration proves stability with constant one. It is conditional for and unconditional for . The sampled initial data have finite support, hence belong to . This is the Fourier stability threshold for a mixed-width heat scheme.
For a grid sequence define its semidiscrete Fourier transform in the dimensionless frequency variable byFor general square-summable data the transform is interpreted as an limit in the L2 norm, rather than an absolutely convergent pointwise sum. The Parseval identity in this normalization isThe Fourier symbols of and are and . Transforming the implicit equation givesIts amplification factor is consequentlyThe denominator has real part at least one because . It never vanishes, so multiplication by defines a unique next value in the l2 sequence space, andThe Parseval identity now givesThis is unconditional practical stability of a finite difference scheme: in the course's terminology the numerical evolution does not increase this norm. Linearity gives the same estimate for perturbations of the initial data. This contraction convention is stronger than a finite-time mesh-uniform bound allowing physical exponential growth.[ref]
https://www.numerical.rl.ac.uk/media/people/tyrone-rees/nsde/notes/Lecture12.pdf. Archived Oxford NSDE I Lecture 12, PDF page 2, definition of practical stability as non-growth of the discrete norm
Using the semidiscrete Fourier transform from (b), the explicit scheme has amplification factorSet and , so . Direct expansion givesThe expression in square brackets is an affine function of . At the two endpoints its values areusing precisely . Every intermediate value is a convex combination of these endpoints, so for every frequency. The Parseval identity provesThus the scheme is practically stable under the given condition. For it is equivalent to and . This is the Forward Euler stability for centered advection-diffusion calculation with the diffusion coefficient retained. The proof does not require all three stencil weights to be nonnegative.
When , the explicit amplification factor becomesA single Fourier mode has constant modulus in space and is not in the l2 sequence space. Instead choose a whole interval of frequencies on which there is definite growth. LetThe inverse Fourier transform here gives the real sequenceBy the Parseval identity, its squared norm is , finite and strictly positive. These data are also compatible with sampling a bounded continuous function: useThe value at zero is the limit of the displayed quotient, and .
On we have . Therefore the transformed solution and the Parseval identity giveFor each fixed pair , takeTaking square roots proves for every . In particular the norm already increases at the first step, so no positive mesh pair gives practical stability in the contraction sense of (b).
The native PDF places the existence of before the universal quantifier over mesh pairs. If this means a single positive independent of , that assertion is false for nonzero data. Indeed, for every datum the same Fourier symbol givesFor any proposed fixed , choose . The upper bound then contradicts the requested lower bound at . The correct quantifiers are , with nonzero square-summable data as constructed above.
Finally, failure of this stronger practical stability of a finite difference scheme should not be confused with every possible refinement notion of numerical stability. If , then givesThus a finite-time mesh-uniform bound can hold under this severe refinement even though contraction fails on every positive mesh. This is the distinction recorded in centered-advection refinement-dependent stability.
The amplification factor is . To reproduce decay, the forward Euler method requires , equivalentlyAt , and the approximations alternate with constant magnitude ; for , and the magnitude grows. This is the condition of absolute stability for this decaying differential equation.
Stability is only a minimum requirement. Values just inside the bound can still give a poor endpoint approximation; resolving the decay accurately generally requires a smaller step size. If positivity at every step is desired, the stronger condition ensures . The figure shows the difference between decay of the exact solution and numerical oscillation.
Forward Euler approximation to exponential decay: instability, neutral oscillation, and stable decay
. Details. Principal-root obstruction to A-stability 2026-10-14
Suppose a consistent linear multistep method has a simple principal polynomial root and its analytic logarithm satisfies near zero, with real coefficients. If , then at the real part of is positive to leading order. The same remains true after giving a small negative real part of smaller magnitude than that leading term. Thus a growing amplification factor occurs inside the left half-plane, ruling out A-stability. For an order-three method with , choose .




