First integral of an ordinary differential equation Created 2026-10-14 Updated 2026-10-18
A first integral of is a differentiable function whose value is constant along solutions through every time and state in its domain. The chain rule makes this equivalent to the displayed pointwise identity. For with symmetric , it becomes . This identity at the implicit stage is what proves exact Runge-Kutta conservation of quadratic invariants for the implicit midpoint rule. Invariance asserted only on the image of one initial-time flow needs that image to contain the stage under consideration.
Implicit midpoint rule Created 2026-09-28 Updated 2026-10-14
The implicit midpoint rule advances an autonomous ordinary differential equation byIt is a second-order, A-stable, time-symmetric numerical method.
The implicit midpoint rule is the midpoint method with . It is a one-stage implicit Runge-Kutta method.
Midpoint method Created 2026-10-14 Updated 2026-10-18
The midpoint method advances an ordinary differential equation using a derivative evaluated at a temporal midpoint. Its explicit form predicts that midpoint from the initial derivative, while the implicit midpoint rule solves for the derivative at the mean of the endpoint states.
Past exam of the mathematics course of the University of Cambridge 2003 iii Paper 67 1 a Solution Created 2026-10-03 Updated 2026-10-14
Introduce one stage with , and update . This is the implicit midpoint rule as a one-stage Runge-Kutta method, with Butcher tableauFor a smooth vector field, write . Expanding its stage equation giveswhich matches the exact Taylor expansion through degree two. The method therefore has order at least two. On the Dahlquist test equation , its stability function isThe third coefficient differs from the exponential's , so the order is exactly two.
There is no pole in , andThus throughout the closed left half-plane:This conclusion is A-stability, not strong damping of arbitrarily stiff modes: along the negative real axis.
Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 68 1 b Solution Created 2026-10-03 Updated 2026-10-14
Use the Gauss collocation coefficient construction. Find the polynomial roots of the shifted Legendre polynomial in , and formThen setThese are explicit polynomial integrals. For example, if , calculate and . The resulting implicit Gauss collocation method has order ; its Gaussian quadrature nodes integrate polynomials through degree exactly. The one-stage example is the implicit midpoint rule, with and . No search over nonlinear Runge-Kutta order conditions systems is needed.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 71 2 c Solution Created 2026-10-03 Updated 2026-10-14
Define the stage states , so . Skew symmetry gives , and henceInsert this into the preceding norm identity and symmetrize the double sum, using . The result is the Runge-Kutta conservation of quadratic invariants identityThuswhich proves the sufficient condition for every well-defined step and then for all by induction. For example the implicit midpoint rule, with and , has and preserves this norm exactly. The condition is sufficient, and need not be necessary for a particular matrix or a particular solution.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 71 6 Solution Created 2026-10-03 Updated 2026-10-14
A collocation Runge-Kutta method approximates an ordinary differential equation by a polynomial whose derivative agrees with the vector field at selected times. Let distinct nodes be , and consider the possibly nonautonomous equation . On a step from , choose a polynomial of degree at most , with , such that . Here is scaled time; the numerical endpoint is .
Let be the Lagrange interpolation polynomial equal to one at and zero at the other nodes, and set . Interpolation of the polynomial derivative givesEvaluating at the nodes and endpoint derives the Runge-Kutta method coefficients:Thus collocation is a specific family of generally implicit RK methods, not a separate update mechanism. The identity gives and , the collocation tableau row-sum identity. For sufficiently small , a vector field with Lipschitz constant gives a contraction of the stage map when , on a suitable bounded neighborhood. The Banach fixed-point theorem then gives a unique nearby stage solution. Equivalently smooth stage equations have identity derivative in the stage variables at , so the inverse function theorem gives a smooth nearby branch. Arbitrarily large-step solvability is a separate issue for an implicit Runge-Kutta method.
Order analysis has two levels: polynomial accuracy at stages and extra accuracy at the endpoint. Integration of interpolated powers gives the stage moment identitiesAn induction in powers of , using these identities in the stage equations, shows that the collocation polynomial agrees coefficientwise with the exact Taylor polynomial through degree :For example, the coefficient of each new stage term is integrated exactly because its node dependence is a polynomial of degree at most . This proves stage order and bounded actual-time derivatives of the collocation polynomial up to degree . Assuming the vector field is sufficiently smooth on a fixed compact solution neighborhood, its composition with this polynomial has uniformly bounded derivatives of all finite orders needed below.
The endpoint weights define the interpolatory quadrature rule . Suppose it is exact through degree , but not through degree . Necessarily : interpolation integrates degrees below exactly, while the nonzero polynomial , with , has positive integral but quadrature value zero and degree . Exactness also implies the nodal-polynomial criterion for quadrature exactnessbecause the integrand has degree at most and vanishes at every node.
Here is the endpoint-error argument underlying the collocation order theorem. Let and be its residual. It vanishes at the collocation times, and if , then , where is interpolation at the nodes. Taylor expansion in actual time givesThe vector coefficients are bounded. Each bracket has the factor , with quotient degree . In particular the residual is throughout the step.
Write for the exact flow from time and state to . Differentiating gives : the derivative with respect to the starting time cancels the vector field by the flow composition identity. Integration therefore gives the exact local endpoint errorFor , the residual already gives . For , Taylor-expand the smooth matrix weight as . Every product term with integrates to zero: its polynomial factor is times a polynomial of degree . All remaining terms are before the time integration, including both remainders. HenceThis is collocation endpoint superconvergence by quadrature orthogonality. For the global assertion, the stage contraction estimate gives a one-step Lipschitz bound on a fixed solution neighborhood. Thus the propagated error satisfies , and the discrete Gronwall inequality gives on a fixed time interval. The order cannot generically exceed : for , each collocation step reduces to the same quadrature rule, whose first nonexact moment yields a nonzero local error and composite error.
The usual node families illustrate the result. Gauss collocation methods use interior Gaussian nodes and have , the maximum possible order. Right-endpoint Radau nodes give the Radau IIA method of order . Including both endpoints with Lobatto quadrature gives the Lobatto IIIA method of order for . One-stage Gaussian collocation is the second-order implicit midpoint rule, while collocation at the right endpoint is the first-order Backward Euler method. The two-stage Gaussian nodes give anda fourth-order method. Node placement, rather than just stage count, controls the superconvergent endpoint order.
There is also a structural link with Question 2. For Gaussian nodes, let . The derivative of has degree at most , so Gaussian quadrature is exact on it. The integral is , while evaluating at the nodes gives . Thus Gaussian collocation satisfies and has Runge-Kutta conservation of quadratic invariants. For the scalar test equation, any RK method has stability function . For implicit midpoint this is ; the identity proves A-stability. High order, stage solvability, invariant preservation and damping are distinct design considerations, so no stability conclusion should be inferred from collocation order alone.
Past exam of the mathematics course of the University of Cambridge 2014 iii Paper 66 6 Solution Created 2026-10-03 Updated 2026-10-18
A stiff differential equation can contain rapidly decaying modes as well as a slowly changing solution of interest. An explicit scheme may need a very small step solely to keep those already small fast modes from numerical growth. A-stability addresses this restriction through the Dahlquist test equation , whose exact solution decays when .
For a one-step method, write , . Its linear stability domain consists of the points where the update is defined and . A-stability means that this domain contains the closed left half-plane. This is a scalar linear stability property, not an order condition, an existence theorem for an implicit solve, or a general nonlinear contractivity assertion.
For a rational approximation to the exponential, consistency requires , and order requires . Poles must be absent from the relevant half-plane. The Forward Euler method has and the disk , so negative real modes require ; it is not A-stable. The Backward Euler method has , and on the left half-plane, so it is A-stable. The trapezoidal rule and the implicit midpoint rule both have, on the scalar linear problem,They are second-order and A-stable despite being different nonlinear methods. No nonconstant polynomial approximation is A-stable, because its modulus grows without bound on the negative real axis. In particular every nontrivial explicit Runge-Kutta method has a bounded-step stability restriction.
A-stability prevents growth but need not eliminate extremely stiff modes: the trapezoidal factor tends to minus one as . L-stability additionally requires within the left half-plane. Backward Euler is L-stable; trapezoidal and implicit midpoint are not. The distinction explains persistent alternating transients in otherwise stable Crank-Nicolson calculations. Accuracy still constrains useful step sizes even for an A-stable method.
A linear multistep method is characterized by polynomials , and its scalar modes satisfy . There is generally no single scalar amplification factor: every root must lie in the closed unit disk and unit roots must be simple. At , this is the zero-stability root condition. Consistency plus zero-stability gives convergence by the Dahlquist equivalence theorem, with suitable starting values. A-stability demands the amplification root condition throughout the left half-plane, including the zero-step condition. The Second Dahlquist barrier says that an irreducible A-stable linear multistep method has order at most two, and an explicit linear multistep method cannot be A-stable.
Examples include backward Euler, trapezoidal, and the second-order backward differentiation formulaIts zero-step roots are . Its unit-circle boundary quotient has real part , and the leading coefficient is nonzero on the left half-plane, giving A-stability by the same continuation argument as in Question 2. Conversely the third-order member of that question fails A-stability. A formal high order without zero-stability, or after silently cancelling a problematic unit factor, does not evade the barrier.
For an implicit Runge-Kutta method, the stages on the test equation satisfy . Whenever these stages are solvable, its stability function isThis rational function is used to test scalar A-stability; the Butcher order conditions separately establish nonlinear order. The Lobatto IIIA method in Question 3 is an A-stable fourth-order example with the diagonal degree-two Padé approximant. More generally the -stage Gauss--Legendre Runge-Kutta method has order and is A-stable, with the diagonal Padé approximation to ; its stiff-limit factor is nonzero. The -stage Radau IIA method has order and is L-stable. Thus Runge-Kutta stages permit arbitrarily high A-stable order, unlike irreducible linear multistep formulas.
For a normal matrix, scalar amplification bounds transfer through unitary diagonalization. For a non-normal matrix, eigenvalue information alone does not assert Euclidean contraction: transient growth and eigenvector conditioning can matter. Direct energy method arguments, such as the dissipative Cayley-transform proof in Question 1, use the symmetric part and are more informative in that setting.
For nonlinear dissipative vector fields, the stronger B-stability property asks that distances between two numerical solutions not increase. A standard sufficient condition for Runge-Kutta methods is algebraic stability: andis positive semidefinite. It follows from the Runge-Kutta contractivity identity when the implicit stages exist. The three-stage Lobatto IIIA method is A-stable but has the first diagonal entry of that matrix equal to , so scalar A-stability should not be confused with that sufficient nonlinear condition. Stage solvability of an implicit Runge-Kutta method remains a separate issue and computational cost of the implicit equations must be considered. A-stability removes a scalar decay-mode stability restriction; order, stiff damping, nonlinear stability and solvability remain distinct properties.
Past exam of the mathematics course of the University of Cambridge 2017 iii Paper 341 6 Solution Created 2026-10-03 Updated 2026-10-18
A Runge-Kutta method advances through stagesThe Butcher tableau records , normally with . Linear absolute stability tests the amplification of a linear decay mode; nonlinear B-stability compares distances between two solutions of a dissipative vector field. Both describe propagation of perturbations, but they impose different conditions.
For the Dahlquist test equation, elimination of stages givesThe linear stability domain consists of for which the step is defined and . Poles or singular stage systems must be excluded, even if an output formula has a formal cancellation. For a scalar test equation, the proof is : the powers are bounded exactly when . For , the update is . If is a normal matrix, unitary diagonalization of a normal matrix makes the operator norm equal to the largest scalar amplification modulus. For a diagonalizable matrix, powers are bounded by the condition number of the eigenvector matrix times the maximal scalar power. These constants must remain uniform for mesh-dependent systems. A defective unit-modulus eigenvalue can instead produce a growing Jordan block; the scalar spectral test alone does not control a general matrix.
An A-stable method accepts the entire closed left half-plane. The Explicit Euler method has and a disk of stability , so it is not A-stable. No nonconstant polynomial stability function can be A-stable, since it is unbounded on the negative real axis; this excludes all consistent explicit Runge-Kutta methods. The Backward Euler method has , and when , proving A-stability. It is also L-stable, because for large left-half-plane .
The implicit midpoint rule and the trapezoidal rule have the same scalar stability function,The identity proves A-stability. On the imaginary axis their amplification has unit modulus, and along the negative real axis it tends to . Thus neither is L-stable; very stiff decay can persist as alternating numerical values. In contrast, the two-stage Radau IIA method has , with the explicit nonnegative modulus-gap proof in question 1, and is L-stable. This illustrates why L-stability matters beyond A-stability for a stiff differential equation.
For nonlinear problems, assume a real or complex Euclidean inner product and the dissipativity hypothesisfor all relevant states at each common time. Exact solutions satisfyA B-stable Runge-Kutta method reproduces this nonexpansion of distances whenever its stages exist. Put , , and . Then . Expansion of the output squared norm, followed by substituting in its linear terms, proves the Runge-Kutta contractivity identityIf and is a positive semidefinite matrix, the first sum is nonpositive by dissipativity, and the second is nonnegative: expand each coordinate of the stage vectors to express it as a sum of nonnegative quadratic forms. These are exactly the conditions for algebraic stability of a Runge-Kutta method. Hence algebraic stability implies B-stability. Applying B-stability to the linear dissipative problem , or its two-dimensional real form, also proves A-stability whenever stages are well defined.
The Backward Euler method has , hence ; the implicit midpoint rule has , , hence . Both are algebraically stable and B-stable. For the two-stage Radau IIA method,a positive semidefinite matrix, while both weights are positive. It therefore combines third-order accuracy, B-stability, and L-stability. The distinction between stability and solvability is essential: for Lipschitz continuous , the stage map is a contraction when , so the contraction mapping theorem proves small-step unique solvability. The preceding algebraic stability proof is an estimate for existing stages; it is not a theorem asserting stage existence for arbitrary step sizes and domains.
Linear A-stability is insufficient for nonlinear B-stability. The trapezoidal rule fails B-stability, even though its scalar stability function is identical to that of the B-stable implicit midpoint rule. Its Runge-Kutta method coefficients areFailure of this sufficient algebraic stability test alone would not prove failure of B-stability. An actual counterexample does: take and . Dissipativity follows fromThe unique step map obeys , because the left-hand side is strictly increasing and onto. At , , and implicit differentiation givesNearby initial states expand in distance. This proves a true nonlinear failure rather than merely failure of a coefficient criterion.
Finally, stability of a numerical method on finite intervals connects these contractivity properties to accuracy. If a one-step map is nonexpansive and its exact one-step defect has norm at most , then the error satisfies , hence for . A Lipschitz step bound gives the same order using the discrete Gronwall inequality. For a stiff differential equation, the value of B-stability is that the propagation estimate need not grow with a large negative dissipative rate. The accuracy constant still needs appropriate smoothness and uniform derivative bounds; stability alone does not establish a mesh-uniform error order.
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 341 7 Solution Created 2026-10-03 Updated 2026-10-05
An -stage Runge-Kutta method for is defined byThe Butcher tableau records , and ; internal consistency usually sets , and first-order consistency requires . A strictly lower triangular gives an explicit method, while other stage dependencies generally require an implicit Runge-Kutta method. The stage solvability of an implicit Runge-Kutta method must be checked separately: if is globally Lipschitz continuous in with constant , the stage fixed-point map is a contraction in the maximum stage norm whenever . This is a sufficient small-step condition, not a restriction intrinsic to the definitions of A-stability or B-stability.
Linear stability begins with the Dahlquist test equation . Solving the stages givesThe linear stability domain consists of test values for which the stage system is well defined and . A-stability means this includes the closed left half-plane. For , this gives stability with no scalar decay-mode step restriction. For a normal matrix in , unitary diagonalization of a normal matrix reduces the norm estimate to these scalar factors. For a non-normal matrix, eigenvalues alone do not establish a uniform norm bound: eigenvector conditioning and transient amplification matter. Mesh-uniform estimates for discretized PDEs must control operator powers, not only their spectra.
Every consistent explicit Runge-Kutta method has a nonconstant polynomial stability function and therefore cannot be A-stable, since that polynomial is unbounded on the negative real axis. For example, Forward Euler method has , stability disk , and restriction for . For a pure imaginary mode , , so it is unstable for every positive step. The classical fourth-order Runge-Kutta method instead hasIt is stable on the imaginary axis exactly for , an illustrative conditional stability range for oscillatory evolution.
Backward Euler method has and is A-stable. L-stability adds as in the left half-plane; backward Euler satisfies this and strongly damps unresolved rapidly decaying modes in a stiff differential equation. The implicit midpoint rule and the trapezoidal rule both have , so they are A-stable but not L-stable. They preserve the modulus of a pure imaginary test mode, but their stiff-decay limit is , leaving oscillatory numerical remnants. The three-stage Lobatto IIIA method has the fourth-order rational function found in Question 2 and likewise lacks L-stability. Thus high order and A-stability do not themselves imply efficient stiff damping.
Nonlinear stability measures differences between solutions of the same equation. A one-sided Lipschitz condition isDifferentiating the squared difference and applying the Gronwall inequality gives . A dissipative vector field has and is contractive. A B-stable method preserves this property for every positive step size for which the stages are well defined:This includes time-dependent vector fields when dissipativity holds at each common time argument. Applying it to scalar linear dissipative fields shows that B-stability implies A-stability when the linear stages are well defined; the converse fails.
The standard sufficient theorem is algebraic stability implies B-stability, subject to stage solvability. Define and . Algebraic stability of a Runge-Kutta method means and is a positive semidefinite matrix. To prove the theorem, set , and . Expanding the output difference and using yields the Runge-Kutta contractivity identityDissipativity makes the first sum nonpositive, while positive semidefiniteness makes the last quadratic form nonnegative. The latter follows by factoring and writing it as a sum of squared norms of linear combinations of the . This proves the claimed contraction. It is a sufficient theorem; absence of algebraic stability is not, by itself, a proof of failure of B-stability for every representation.
Several examples make the distinctions concrete. For backward Euler, , , so : it is both L-stable and B-stable. For implicit midpoint, , , so : it is B-stable and preserves squared norms for a skew-Hermitian linear equation, but lacks stiff damping. For the two-stage Gauss--Legendre Runge-Kutta method,the matrix vanishes as well. The collocation theorem gives order four, and its stability function is exactly the same as the three-stage Lobatto IIIA function. Yet the Gauss method is algebraically stable, whereas that Lobatto method is not. Identical scalar linear stability functions need not imply identical nonlinear stability properties.
An example combining stiff damping and nonlinear contraction is the two-stage Radau IIA method, withIts positive weights and positive semidefinite prove B-stability; its rational function has denominator roots and, for , satisfiesThus it is A-stable; the limit then proves L-stability. The standard Radau IIA collocation theorem gives order , here three. These properties explain its usefulness for stiff nonlinear equations.
Finally, A-stability alone does not imply B-stability. The trapezoidal rule fails B-stability even for the scalar dissipative equation . With , its step map is uniquely defined byAt , . Implicit differentiation givesThus nearby starting values are separated by approximately twice their original distance after one step, although the exact flow is contractive. This example and the contractivity theorem show why scalar linear analysis, stiff damping and genuinely nonlinear norm estimates answer different stability questions.
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 341 6 Solution Created 2026-10-03 Updated 2026-10-05
A Runge-Kutta method with stage matrix , weights and step size isIts order measures accuracy as , while stability concerns how errors or stiff components propagate. Linear A-stability, strong stiff damping through L-stability, and nonlinear B-stability address different questions.
For the Dahlquist test equation , elimination of the stages gives the stability functionThe linear stability domain is . The method is A-stable when it contains the closed left half-plane, and L-stable when it is also true that as there. These conditions describe, respectively, stability for every non-growing scalar linear mode and damping of very rapidly decaying modes.
The Forward Euler method has , so it fails A-stability, for example at . In fact no nontrivial explicit Runge-Kutta method is A-stable: its stability function is a nonconstant polynomial, which is unbounded along the negative real axis. The Backward Euler method has . For , , and the function tends to zero at infinity, proving both A-stability and L-stability. The implicit midpoint rule has . The identity proves A-stability, but its limit rules out L-stability.
For nonlinear equations, a dissipative vector field satisfies . The corresponding exact solutions contract because the time derivative of their squared distance is twice that inner product. A B-stable method preserves this contraction for every , whenever its stages are well defined.
Let , , and . Expanding the update's squared norm, substituting , and symmetrizing the double sum proves the Runge-Kutta contractivity identityIf and the matrix is a positive semidefinite matrix, the first sum is nonpositive by dissipativity. The second double sum is nonnegative: sum the quadratic form of over each coordinate of the . Thus algebraic stability implies B-stability. Applied to complex scalar linear equations with the real part of the Hermitian inner product, the same argument also implies A-stability, where the stages are defined.
The Backward Euler method has , hence , and is algebraically stable. One can prove its nonlinear contraction directly: gives . The implicit midpoint rule has , and , so it is B-stable even though it is not L-stable.
Linear A-stability does not by itself imply nonlinear B-stability. The ODE trapezoidal rule has the same stability function as the implicit midpoint rule, but take the dissipative scalar field and . For any positive starting value, its trapezoidal update is . Thus two positive starting values have their distance doubled, violating B-stability. Its algebraic stability matrix also has a negative first diagonal entry. The field is globally Lipschitz continuous, so this is a well-defined nonlinear counterexample.
These examples distinguish accuracy, scalar stiff-mode stability, nonlinear contraction, and rapid stiff-mode damping. For implicit methods, solvability of the stage equations remains an additional requirement; a formal stability function alone does not establish it for arbitrary nonlinear problems.
Past exam of the mathematics course of the University of Cambridge 2022 iii Paper 341 Section A 3 c Solution Created 2026-09-28 Updated 2026-10-14
Apply the implicit midpoint rule, equivalently the Crank-Nicolson method, to the semidiscrete equation:It has order two. Its amplification matrix is the Cayley transformBecause is Hermitian, is unitary. Hence exactly.
An -stage Runge-Kutta method has stages and updateOn the Dahlquist test equation , elimination of the stages gives the stability functionThe linear stability domain is the set where . A method is A-stable when this domain contains , so every exactly decaying scalar linear mode remains bounded for every step size. It is L-stable when it is A-stable and as in the left half-plane; this extra limit strongly damps unresolved stiff modes.
The rational function makes several useful conclusions immediate. No explicit Runge--Kutta method is A-stable because its stability function is a nonconstant polynomial and is therefore unbounded on the negative real axis. The implicit midpoint rule has and is A-stable, but , so it is not L-stable. The Backward Euler method has and is L-stable. More generally, a rational with no pole in the closed left half-plane is A-stable if and only if for every real ; this follows by applying the maximum modulus principle on expanding left half-disks.
Scalar linear stability does not by itself control nonlinear perturbations. Suppose the vector field is dissipative in the sense thatA method is B-stable if it preserves the resulting contractivity: two numerical solutions satisfy . A practical sufficient condition is algebraic stability of a Runge-Kutta method: andTo prove the implication, let and . Expanding the squared distance and substituting the stage equations gives the Runge-Kutta contractivity identityThe dissipativity inequalities make the middle sum nonpositive, and positive semidefiniteness of makes the final quadratic form nonnegative before its minus sign. The distance therefore cannot increase. In particular, algebraic stability implies B-stability and, by applying contractivity to the real two-dimensional form of , implies A-stability.
Important collocation families illustrate these notions. Gauss methods are A-stable, symmetric, and have order , but they do not damp infinitely stiff modes. Radau IIA methods have order , are algebraically stable, and are L-stable. These properties explain why A-stability controls unrestricted linear decay, L-stability is useful for stiff transients, and algebraic or B-stability is the stronger tool for nonlinear dissipative equations.
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 341 1 b Solution 2026-09-28
Set . The implicit midpoint rule readsTaking the inner product with givesThe last equality again follows from skew-symmetry. Mathematical induction therefore yields
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 341 1 c Solution 2026-09-28
Write . The trapezoidal rule isTaking the inner product with givesThe two quadratic terms vanish because each is skew-symmetric. Moreover . HenceUnlike the implicit midpoint rule, the trapezoidal rule evaluates at two different states, so the mixed terms need not cancel.
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 341 5 b 3 Solution 2026-09-28
The Butcher tableau has one stage with and , so it is the implicit midpoint ruleAgain, interchanging the endpoints and changing to leaves the equation invariant. Hence .