Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 57 7 Solution Created 2026-10-03 Updated 2026-10-18
For an initial value problem, convergence of a numerical method means that on each fixed interval , the largest error at mesh points tends to zero as the step size tends to zero and the starting errors vanish. Order of a numerical method describes how rapidly an exact-start local defect decreases; stability of a numerical method controls propagation of that defect and of errors already present. These are related but different properties. A high-order expansion alone cannot ensure that accumulated error remains small.
For a one-step map , define the exact-start defect . Order means for sufficiently smooth solutions. The normalized local truncation error divides this defect by and is ; explicitly specifying the normalization prevents an apparent one-order discrepancy. Suppose the map satisfies the local Lipschitz boundFor the error recurrence isIteration, or the discrete Gronwall inequality, yields for . Stable propagation converts an order- local formula into global error , provided starting data are equally accurate. Consistency is the weaker requirement that the normalized local defect tend to zero.
For a linear multistep method, zero-stability concerns the recurrence at . Its roots must have modulus at most one, and unit-modulus roots must be simple. Roots outside the circle amplify errors exponentially in the number of steps; repeated unit roots introduce polynomial growth. The requirement is stronger than bounded propagation for one fixed number of steps: as on a fixed physical interval there are steps. Under the usual Lipschitz assumptions and consistent starting values, the Dahlquist equivalence theorem says consistency plus zero-stability is equivalent to convergence. Its sufficiency combines a bounded discrete recurrence propagator with the sum of local defects, while necessity follows by exciting an unstable homogeneous root or by observing the persistent error of an inconsistent formula.
For example, satisfies the first-order consistency identities, but its root polynomial is . For , a small starting error can excite a mode and destroy convergence as the number of steps increases. In contrast, simple parasitic unit roots such as the root minus one of a two-step centered method need not destroy zero-stability: they remain bounded, though they can create unwanted oscillations and affect practical behavior. Accurate starting procedures and suppression of accumulated parasitic error remain relevant.
Absolute stability asks a different question: for , does the discrete solution decay or stay bounded for a specified finite ? The Forward Euler method has and, for real , requires . It converges as , but a stiff decay mode can impose a severe practical step restriction unrelated to the accuracy needed for slowly varying components. The Backward Euler method has , hence is A-stable and L-stable. The trapezoidal rule has , is A-stable, but tends to minus one on a very stiff negative mode and can retain alternating transients rather than damping them rapidly.
Zero-stability therefore does not imply unrestricted absolute stability; the three-step family analyzed earlier in this paper is a particularly strong illustration. Conversely a stable large step need not be accurate. This distinction matters for a stiff equation. The Second Dahlquist barrier limits A-stable linear multistep methods to order at most two, whereas implicit Runge-Kutta methods can have much higher order and still be A-stable. That barrier concerns the specified method class, not every numerical time integrator.
Finally, the mathematical order depends on smoothness: nonsmooth solutions or forcing can lower observed rates. Roundoff, imperfect implicit solves and inaccurate derivative evaluations introduce additional defects. Smaller steps increase the number of such perturbations; truncation error alone does not describe arbitrarily fine computation. The useful organizing principle is consistency supplies vanishing defects, stability bounds their accumulation, convergence follows, and order quantifies its rate under the stated regularity and starting-error assumptions.
Past exam of the mathematics course of the University of Cambridge 2008 ii Paper 3 38C a Solution Created 2026-09-24 Updated 2026-10-14
Convergence of a numerical method means that, for every fixed final time and admissible initial-value problem, the maximum grid error tends to zero:
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 1 a Solution Created 2026-10-03 Updated 2026-10-14
Multiply by a test function vanishing at the endpoints and apply integration by parts. The positive operator is , so the forcing changes sign. The weak formulation of this forced Airy boundary-value problem is: find such thatHere is the zero-boundary Sobolev space and can be equipped with . The interval Poincaré inequality states , so this norm makes a Hilbert space and is equivalent to its usual Sobolev norm. The form is symmetric and satisfiesThe Lax-Milgram theorem says that a bounded coercive bilinear form on a Hilbert space and a bounded linear functional determine exactly one weak solution. All its hypotheses have just been verified. Moreover, gives on the interval; the right-hand side is then continuous, so this weak solution is the classical solution with the prescribed endpoint values.
Since the form is symmetric, the equivalent Ritz method minimizesIndeed, stationarity gives the weak equation andwith equality only at . This proves the minimization equivalence, including the sign of the linear term.
Restricting to a conforming finite element space gives a unique discrete solution and Galerkin orthogonality, for every . The Céa lemma states that if the continuity and coercivity constants are and , then . For this symmetric problem the exact best-approximation constant in the energy norm is one. The piecewise-linear finite element interpolation estimate on regular finite element meshes therefore gives convergence of a numerical method of the Ritz method, with first-order error in the energy norm.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 2 a Solution Created 2026-10-03 Updated 2026-10-14
For this two-step family with a third-order member, use the exponential-symbol order criterion for a multistep method. Expanding the exact-solution residual symbol givesThe constant, linear and quadratic coefficients vanish for every parameter. ThusAt the exceptional value the fourth-degree coefficient is , so there is no further increase. This means an unscaled exact-solution residual of order , or a residual divided by the step of order .
The first characteristic polynomial factors as . The root condition for a multistep method requires every root to have modulus at most one and each unit-modulus root to be simple. The root is allowed because it is distinct from the simple root one; is not, since it makes one a double root. Hence zero-stability holds exactly forOn this interval, and establish consistency of a numerical method. The Dahlquist equivalence theorem, for a fixed-step consistent linear multistep method applied to an ordinary differential equation with a Lipschitz continuous right-hand side with convergent starting values and well-defined small-step updates, says that convergence of a numerical method is equivalent to zero-stability. Therefore the same interval is exactly the convergence of a numerical method range. With sufficiently accurate starting values the convergent members have the orders just computed.
At the Taylor expansion still gives a formal order-two residual, but and the double root prevents a convergent method. Canceling the common factor produces the common-factor cancellation defect in a multistep recurrence and changes the starting relations and cannot repair convergence of a numerical method of the original recurrence. At , cancellation of a zero root instead reveals the ordinary trapezoidal rule; it is consistent with the order-two result.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 6 Solution Created 2026-10-03 Updated 2026-10-14
The eigenvalue stability analysis of a finite difference method reduces a linear evolution discretization to its modal behavior, but it must retain the norm and the dependence on the mesh. For a homogeneous system obtained by the method of lines, , the solution is . A one-step time discretization gives ; for a Runge-Kutta method, where its stage matrices are invertible, . With a multistep method one instead uses an amplification matrix on the augmented vector of several time levels.
The relevant finite-time stability estimate iswith independent of the refining spatial mesh and allowed time steps. Similarly, semidiscrete stability requires for . The norm should represent the continuum problem, such as the discrete L2 norm in one dimension. A fixed finite matrix having decaying solutions as is not by itself a mesh-uniform result for the partial differential equation.
If , thenThus eigenvalues of modulus at most one give a uniform bound when the diagonalizing bases have uniformly bounded condition numbers. For a normal matrix in the chosen inner product, the spectral theorem for normal operators supplies an orthonormal basis, so the condition number is one and the norm of is exactly . For a self-adjoint or skew-adjoint spatial matrix, applying a scalar stability function preserves this favorable modal structure. This is the setting where eigenvalue calculations provide especially clean, reliable step restrictions.
A precise fixed-matrix statement is also useful: a matrix is power bounded for all nonnegative integers if and only if all its eigenvalues lie in the closed unit disk and every Jordan block at a unit-modulus eigenvalue has size one. Indeed, powers of an interior Jordan block contain a polynomial in times a decaying geometric factor and are bounded; a larger block on the unit circle produces unbounded polynomial growth. For a family of matrices, the resulting bounds must still be uniform. Moreover, finite-time stability versus power boundedness distinguishes this all-time condition from the physical-time estimate above. For example , , has , bounded for despite a nontrivial Jordan block at one. Even the scalar update is stable on fixed intervals, since , although it represents a growing equation rather than a contraction.
For a constant-coefficient periodic difference operator, Fourier modes diagonalize the spatial matrix. The discrete Fourier transform is a unitary operator, so Parseval's identity identifies its modal maximum with the operator norm. The eigenvalue stability analysis of a finite difference method then becomes von Neumann stability analysis. For the Dirichlet discrete Laplacian, a discrete sine transform plays the same role. These facts explain its advantages: a large matrix calculation becomes a scalar symbol or a known spectral interval, and the extremal eigenvalue directly determines a safe time step.
As a first example, centered space discretization of the heat equation has eigenvaluesForward Euler method gives with . Requiring all factors in yields for all periodic meshes. In two dimensions the corresponding uniform bound is . Because these are normal matrices, these scalar bounds prove contraction rather than merely suggest it.
Backward Euler method has , so the centered discretization of the heat equation is contractive for every . The Crank-Nicolson method has and is likewise contractive for these negative real modes. However, its factor tends to for very stiff modes, leaving high-frequency oscillations weakly damped; Backward Euler method tends to zero. The eigenvalues therefore expose the presence of stiff differential equations and damping as well as binary stability. Unconditional stability does not remove accuracy requirements.
For an advection equation example, the upwind finite difference scheme for , , has factor , with . Sinceit is a contraction in the periodic discrete L2 norm exactly for . In contrast, Forward Euler method with centered advection has factor . Its modulus exceeds one at nonzero active frequencies, and repeated amplification makes it unstable under fixed nonzero Courant refinement. A much smaller scaling can bound its finite-time growth, demonstrating again that exact contraction and the most general stability estimate are different claims.
The major limitation is the possible presence of a nonnormal matrix. For example,Both eigenvalues are negative, yet at the second unit vector is amplified by at least . This proves that negative spectra do not imply uniform semidiscrete stability. Ill-conditioned eigenvectors, Jordan normal form and transient amplification can invalidate a spectral-only argument. Direct energy estimates or estimates for the resolvent can supply the missing norm control.
Boundary conditions are another limitation. A periodic symbol proves a periodic or whole-line result, not an arbitrary initial-boundary-value problem. Boundary closure of a difference scheme can introduce growing modes or mesh-dependent amplification. A spatial operator with variable coefficients can still be studied through its assembled matrix, but then whether it is a normal matrix, its condition number and the physical inner product must be checked rather than borrowed from a Fourier stability analysis. For the finite element method the natural mass matrix inner product often turns a generalized eigenvalue problem into a self-adjoint one.
For time-dependent or split updates, separate spectra are insufficient to control products. For instance, and each have only zero eigenvalues, while has eigenvalue . For , alternating the two is unstable. A common contractive norm would control the products, but their individual eigenvalues do not.
Finally, stability and consistency of a numerical method have different roles. The Lax equivalence theorem states that, for a well-posed linear initial-value problem and a consistent finite difference method on compatible grid spaces, stability on every fixed time interval is equivalent to convergence of a numerical method as the admissible meshes refine. Bounded grid representation and the correct initial and boundary setup are part of that framework. An eigenvalue estimate can establish its stability hypothesis in the favorable settings described above; it neither proves consistency of a numerical method nor bypasses its uniformity requirements. The method is therefore a powerful modal tool, provided its spectral calculation is connected to a genuine norm estimate.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 72 7 Solution Created 2026-10-03 Updated 2026-10-14
A fixed-step linear multistep method for uses several previous solution and derivative values:The coefficients are fixed independently of the step size. It is explicit when and implicit otherwise. Its characteristic polynomials of a linear multistep method are and . The contraction mapping theorem gives a uniquely solvable implicit step under a Lipschitz continuity bound whenever , by contraction of the new-value equation on the appropriate solution region. A suitable starting procedure must supply the first values; the method alone does not determine them.
Order is defined by inserting a smooth exact solution into the recurrence. If the residual is and its first nonzero coefficient occurs at that degree, the method has order ; dividing the residual by gives an local truncation error. Taylor expansion gives the exact order conditions for a linear multistep methodwith the right side interpreted as zero at , and failure at for exact order. Equivalently,The basic consistency of a numerical method conditions are , ; for the ordinary nondegenerate consistent formulation this common value is nonzero. Exactness on constants and linear functions does not control propagation of numerical perturbations.
That propagation is the role of zero-stability. On the homogeneous recurrence is . Its modes are , with powers of determined by root multiplicities. The theorem on the root condition for a multistep method states that zero-stability is equivalent to every root of having modulus at most one, with every unit-modulus root simple. Interior repeated roots are permitted, since geometric decay dominates their polynomial factors. An exterior root amplifies perturbations geometrically; a repeated unit root amplifies them polynomially and violates a step-independent perturbation bound.
The Dahlquist equivalence theorem states that a fixed-step consistent linear multistep method is convergent exactly when it is zero-stable. This concerns ordinary differential equations with a uniformly Lipschitz continuous right-hand side on the solution region over a fixed finite interval, convergent starting values, and the well-defined nearby branch of each small-step implicit solve. For order convergence of a numerical method, the solution must have the required smoothness and the starting errors must be .
The mechanism can be sketched explicitly. The root condition for a multistep method bounds the recurrence's discrete Green function. For an order- exact-solution defect , the Lipschitz continuity error equation then gives an estimate of the formThe current-step term can be absorbed for small . The discrete Gronwall inequality says that a bound implies . There are defects on a fixed interval, so their sum is and this yields the claimed global order. Conversely, testing with vanishing starting perturbations in exterior-root or repeated-unit-root modes proves that convergence of a numerical method fails without the root condition for a multistep method.
For example, the two-step Adams-Bashforth method hasIt is explicit, order two and zero-stable, hence convergent with order-two starting values. By contrast, a recurrence with has solutions on the zero differential equation. Starting differences tend to zero yet become unbounded at a fixed positive time, since is of order . A small local defect or formal high order cannot rescue this mode. Canceling a common factor may remove it only by changing the allowed starting relations, as the parameter endpoint in Question 2 illustrates.
Absolute stability addresses a different limit: apply the method to the Dahlquist test equation and put . The amplification roots satisfyAll roots must satisfy the disk condition, with unit roots simple; one cannot inspect only the root that tends to one as . The degree and solvability of the recurrence must also be preserved. The resulting set of is the domain of absolute stability. A-stability means that it includes the whole closed left half-plane, so the numerical solutions of every Dahlquist test equation with are stable for every positive step size. It is a linear test-equation property, not a proof of arbitrary nonlinear contractivity or high accuracy at large steps.
Forward Euler method has order one and factor , so its stability region is the disk . Backward Euler method has factor and is A-stable. The trapezoidal rule is order two with factor ; its modulus is at most one throughout the left half-plane. These one-step methods are included as the simplest multistep examples. For the two-step Adams-Bashforth method, the negative-real stability interval is : its polynomial is , and the root reaches at . It therefore imposes a step restriction when applied to strongly decaying modes.
The genuinely two-step BDF2 method isIt has order two, roots at zero step and is A-stable. For its normalized polynomials , , the unit-circle boundary locus hasThe leading coefficient has no zero in the left half-plane, and the roots at a small negative are both inside the disk. Root continuity then proves open-half-plane stability; on the imaginary boundary the only possible unit root is the simple root one at . This gives a direct proof of the stated A-stability rather than relying on a boundary plot.
Two sharp order barriers explain the tradeoff. The first Dahlquist barrier states that a consistent zero-stable real linear -step method using only first derivatives has order at most for odd and for even ; an explicit method has order at most . The Second Dahlquist barrier states that an irreducible A-stable real linear multistep method has order at most two. These statements concern fixed constant coefficients and the ordinary first-derivative multistep class, not multiderivative methods or arbitrary variable-step formulations. Thus higher order alone is not a route to unconditional stiff stability. Question 2 provides a concrete illustration: its third-order member is zero-stable but not A-stable.
No nontrivial consistent explicit multistep method is A-stable. Its amplification polynomial of a multistep method has a fixed highest coefficient, while at least one lower coefficient grows without bound as real . Were all roots uniformly in the unit disk, their elementary symmetric polynomials would keep all the monic coefficients bounded, a contradiction. This is the coefficient argument behind explicit multistep methods cannot be A-stable.
In practice, selecting a method therefore involves accuracy, startup, the presence of a stiff differential equation, implicit-solve cost and step-size control. Zero-stability handles propagation as the step tends to zero; consistency of a numerical method supplies a vanishing defect; A-stability handles the numerical solutions of all decaying Dahlquist test equations at finite steps. None substitutes for the others, and variable steps or PDE discretizations require additional uniform stability arguments appropriate to their setting.
Past exam of the mathematics course of the University of Cambridge 2013 ib Paper 2 19C Solution Created 2026-09-24 Updated 2026-10-07
Convergence of a numerical method on means that its grid error obeys as , with consistent initial values.
First, the implicit step of Backward Euler method is well-defined for : the map is a contraction mapping on , so the Banach fixed-point theorem gives a unique solution. Let , finite under the stated smoothness. The exact solution's step defect isso . Subtract the exact and numerical step equations. The Lipschitz condition givesWith exact initial data, sum this geometric progression to obtainFor and , , so the bracket is at most . Thus the global error is , uniformly on , and Backward Euler method converges with order one. A vanishing initial error adds only .
Order one is sharp: for , and , .
For the Dahlquist test equation , the stability function is , . Therefore its linear stability domain isThe strict inequality gives decay; equality gives bounded amplification. The whole closed left half-plane lies in this region, so Backward Euler method is A-stable.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 68 1 a Solution Created 2026-10-03 Updated 2026-10-06
The characteristic polynomials of a linear multistep method areThe consistency of a numerical method conditions hold for every real :Both roots of a polynomial of , namely and , are simple and have modulus one. The root condition for a multistep method therefore gives zero-stability for every . The Dahlquist equivalence theorem now gives convergence for every fixed . As usual, this means convergence of a numerical method on each fixed finite interval for a sufficiently regular ordinary differential equation with a Lipschitz continuous vector field and starting values tending to the exact starting values. When , the implicit time-stepping method update is locally uniquely solvable for sufficiently small , for example by a contraction mapping if . Zero-stability does not assert that a large fixed step is suitable for a stiff differential equation.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 68 7 Solution Created 2026-10-03 Updated 2026-10-18
Consider an initial value problem on , with a Lipschitz continuous vector field in the solution variable and enough smoothness for the stated error expansions. Convergence of a numerical method meanswith consistent starting values. An order of a numerical method quantifies this approximation: with sufficiently accurate starting data and the required stability, the global error is . Stability of a numerical method controls the amplification and accumulation of perturbations; it is the link between a small local defect and small global error.
For a one-step formula , define the unscaled local truncation errorThe method has local order if uniformly along sufficiently smooth solutions. If the defect is divided by , its order is instead ; the convention must be specified. Assume also the perturbation estimateThe global error then satisfiesIterating, or applying the discrete Gronwall inequality, givesThere are steps on a fixed interval, so stable propagation turns local defects into accumulated error. Starting error is needed to retain order . This explains why matching an exact Taylor expansion is insufficient unless errors are controlled during repeated steps.
For a fixed-coefficient linear multistep method, writeThe consistency of a numerical method conditions are and . The higher order conditions for a linear multistep method arewith right side zero for ; exact order means first failure at . They come from inserting the exact solution and comparing its Taylor expansion.
Errors at follow the homogeneous recurrence determined by . Zero-stability is equivalent to the root condition for a multistep method: all roots of a polynomial have modulus at most one, and every unit-modulus root is simple. Roots outside the disk give exponential growth in the number of steps; repeated unit roots give polynomial growth in that number. Repeated interior roots are harmless because their polynomial factors are dominated by decay. Under the usual Lipschitz continuity and initialization assumptions, the Dahlquist equivalence theorem givesFor a zero-stable order- linear multistep method, local defects and starting errors of the stated orders yield global error by a recurrence bound and the discrete Gronwall inequality. Every required starting value matters.
A concrete failure of “consistency implies convergence” isHere and , so and : the method is consistent, of order one. But its root violates zero-stability. For with exact solution zero and starting values , , the computed solution is . These starting errors vanish, yet at the error diverges. Local accuracy cannot compensate for an unstable recurrence.
A different meaning of stability concerns a fixed step on decaying equations. The Dahlquist test equation introduces . A one-step method gives and is absolutely stable when . For a linear multistep method, the corresponding amplification polynomial of a multistep method is , and every root must satisfy the bounded root condition, not just the root approximating . Strict asymptotic decay requires the roots to have modulus less than one for . This distinction matters at reducible methods with an undamped parasitic mode, as in question 1(c).
The Forward Euler method has order one and , so its linear stability domain is . For , with , it requires . It converges as , yet an excessively large step can produce growing oscillations on an exactly decaying problem. The Backward Euler method has the same order, but makes it A-stable and L-stable. For a stiff differential equation, fast decay can impose a severe explicit time-step restriction even when accuracy of the slow dynamics would permit a much larger step.
The trapezoidal rule has order two and is A-stable, but is not L-stable, since its stability function tends to along the negative real axis. The Second Dahlquist barrier limits an irreducible A-stable linear multistep method to order at most two. This does not limit implicit Runge-Kutta methods: question 4's Lobatto IIIA method is fourth-order and A-stable. Conversely, question 1's fourth-order member is convergent but not A-stable. These examples show that order of a numerical method, zero-stability and A-stability answer different questions.
For nonlinear dissipative problems, B-stability controls distances between numerical solutions; algebraic stability of a Runge-Kutta method is a sufficient coefficient criterion. Question 4 shows that A-stability alone does not imply that coefficient criterion. Variable time steps require additional analysis of step ratios and error propagation, and stiff problems may require uniform-in-stiffness error estimates beyond the fixed-problem convergence result. The useful chain is local accuracy plus the appropriate perturbation bound, giving global accuracy; absolute and nonlinear stability then determine which practical time steps preserve the intended dynamics.
Past exam of the mathematics course of the University of Cambridge 2016 ib Paper 1 18D a Solution Created 2026-09-24 Updated 2026-10-06
Convergence of a numerical method on a fixed interval means that, as the step size tends to zero and the starting approximations tend to the exact initial values,For a vector-valued ordinary differential equation, replace the absolute value by a norm. The interval remains fixed as ; a small error at only one step is insufficient.
The order of a numerical method is measured by its defect on a smooth exact solution. With the unscaled residual convention for a linear multistep method, order at least means local residual ; equivalently, the residual divided by is . Order exactly means the next coefficient does not vanish in general. For a zero-stable method, under the usual smoothness and Lipschitz continuity assumptions and with starting errors , this yields global error on the fixed interval. Local order by itself does not imply convergence without stability.
Past exam of the mathematics course of the University of Cambridge 2016 ib Paper 1 18D c Solution Created 2026-09-24 Updated 2026-10-06
The Dahlquist equivalence theorem states that a linear multistep method has convergence of a numerical method if and only if it is consistent and zero-stable, under the standard assumptions for the initial value problem and convergent starting values. Consistency of a numerical method means order at least one, orThe root condition for a multistep method expresses zero-stability: every root of has modulus at most one, and every root with modulus one is simple. Usual hypotheses include a well-posed ordinary differential equation with continuous in time and Lipschitz continuous in the solution variable, a valid step equation, and starting approximations converging to the exact values.
On the vector space of nodal values with zero endpoints define the discrete Sobolev normIt is a norm because it is the Euclidean norm of the scaled list of nodal values and first finite differences, and vanishes only for the zero list. It is the discrete counterpart of the Sobolev space norm. Here has zero endpoints, so this definition applies directly.
Set , finite by the assumed continuity. Taylor's theorem with fourth-order remainders gives, for suitable and ,Adding the two expansions cancels the odd derivatives, soConsequently . Doubling the bound in (c) gives , and thereforeThus is a valid nonnegative constant. To satisfy the request for a strictly positive constant even when , take , independent of . This proves second-order convergence of a numerical method in a discrete Sobolev norm, including control of the backward difference operator applied to the error.
Two-step family with a third-order member 2026-10-14
The exponential-symbol order criterion for a multistep method gives leading defect , so the family has order two except at , where it has order three. The root condition for a multistep method holds exactly for , and the convergent A-stable members are exactly . At it reduces to the trapezoidal rule after removal of a zero root. At a repeated root one destroys convergence of a numerical method of the original recurrence despite a common polynomial factor and a formally vanishing second-order residual.