Bang-bang control Created 2026-10-05 Updated 2026-10-06
A control input taking only extreme admissible values except possibly on a switching or singular set. If the Hamiltonian of an optimal-control problem is affine in a scalar control , a nonzero coefficient selects or ; a zero coefficient does not determine the control.
Costate 2026-10-05
An adjoint variable enforcing the state dynamics in optimal control. In the normal minimization convention it satisfies for the Hamiltonian of an optimal-control problem, with terminal conditions determined by the endpoint constraints.
Free-terminal-time transversality condition Created 2026-10-05 Updated 2026-10-14
For a smooth normal optimal control problem with freely variable terminal time, fixed terminal state independent of that time and terminal cost , the optimized Hamiltonian of an optimal-control problem at completion satisfies . It follows by varying the terminal time in the augmented objective; restrictions on terminal time or a moving endpoint introduce additional terms or inequalities.
Past exam of the mathematics course of the University of Cambridge 2007 ii Paper 2 29I Solution Created 2026-09-24 Updated 2026-10-14
For fixed terminal time and fixed endpoint, use the maximizing form of the Pontryagin maximum principle. For dynamics and running cost , there are multipliers , not all zero, with , and Hamiltonian of an optimal-control problem . Along an optimum, , , and the chosen control maximizes over admissible controls almost everywhere. Fixed terminal state imposes no prescribed terminal value of ; fixed time imposes no free-time condition . The normal case scales ; abnormal extremals have .
For this problem the normal Hamiltonian of an optimal-control problem isMaximization gives , . The costate equations give , , hence , . Nonzero velocities rotate at constant angular rate, and rotational symmetry permits , . For a closed path, , with integer . Then , so the required positive endpoint has , and cost .
To prove a global minimum rather than only classify stationary extremals, write and subtract its time average; this changes neither its derivative nor . The resulting closed mean-zero path satisfies the periodic Wirtinger inequality . This follows immediately by its Fourier expansion: each nonzero mode of the derivative has squared multiplier at least . The Cauchy-Schwarz inequality now givesThe argument extends to square-integrable controls by the periodic Sobolev/Fourier interpretation. Thus the cost is at least for every feasible control. Equality is attained byThese satisfy every endpoint and have cost . Therefore the minimum is , an area-constrained quadratic control cost. The global inequality also prevents an overlooked abnormal candidate from lowering it; in fact an abnormal finite maximizing Hamiltonian of an optimal-control problem would force both linear control coefficients to vanish and then force zero velocity, incompatible with .
Past exam of the mathematics course of the University of Cambridge 2009 ii Paper 4 28I a Solution Created 2026-09-24 Updated 2026-10-14
Maximize . Along the positive- trajectory use Hamiltonian of an optimal-control problem . The terminal costate is , andThus . Maximizing over gives as long as . The state equation integrates to , and the adjoint equation gives , validating the maximization. HenceThis is globally optimal, not just an extremal: whenever , . If a competitor reaches and later becomes positive, apply that bound after its last zero; it has even less remaining time to attain a positive terminal height. A negative terminal height cannot improve this positive maximum. Therefore the minimum objective is .
Past exam of the mathematics course of the University of Cambridge 2010 ii Paper 4 28J i Solution Created 2026-09-24 Updated 2026-10-14
The requested properties are not properties of the optimum under the printed assumption . We first derive their origin, and then solve the actual constrained problem.
Put , so , and write the Hamiltonian of an optimal-control problemFor an interior stationary control, givesThis proves the printed identity only as a necessary stationarity condition for an interior candidate.
It fails the required maximization condition. For fixed positive and fixed , maximization over givesSince , this is strictly convex in . Its maximum on is at an endpoint, not at its interior stationary point. Thus the actual optimum uses , or . On any consumption interval the printed relation would require , although the actual optimal consumption varies with time.
Past exam of the mathematics course of the University of Cambridge 2017 ii Paper 4 29K Solution Created 2026-09-24 Updated 2026-10-05
Assume a finite optimum with and continuous price near its completion time. With costate for the remaining-file state, the minimization Hamiltonian of an optimal-control problem is . It is independent of , so is constant. By the Pontryagin maximum principle, pointwise minimization over givesThis is a bang-bang control away from equality. At equality partial transmission or either endpoint rate is allowed. This also follows by exchanging a small amount of transmission from a more expensive time to a cheaper unused time. The free-terminal-time transversality condition is . Since , it forces and terminal transmission at rate one, yieldingWithout regularity/existence hypotheses an arbitrary known price need not have a finite differentiable optimum; the equality is the interior terminal-time condition used here.
For , , feasible completion requires for finite cost. The price decreases to its minimum at one and then increases. Its cheapest unrestricted interval of length one has endpoints of equal price, giving and . For , the cheapest length-one subset of is the terminal interval : its left endpoint has at least the price of its right endpoint, and the earlier times are still more expensive. For the transmission minimum is unchanged from that unrestricted interval, while the delay cost increases, so no optimum lies beyond .
For the terminal-interval policy the total cost isIts derivative is strictly increasing on , since . It is negative near one and positive at , so the unique global optimum isThere is exactly one positive root: none lies in because the left side is negative, and the strictly monotone comparison gives exactly one in . Its threshold is .
Pontryagin maximum principle 2026-10-05
For a regular finite-horizon optimal control problem, an optimal trajectory admits nontrivial multipliers and a costate obeying adjoint equations, together with pointwise optimization of the Hamiltonian of an optimal-control problem. In the normal minimization convention , the conditions are , and minimization of over admissible controls; endpoint and state constraints change the terminal conditions. Abnormal extremals use a zero cost multiplier and must not be silently excluded.