Hamiltonian of an optimal-control problem 2026-10-05
In a normal minimization convention for optimal control, the running cost and dynamics define . The multiplier is a costate; this Hamiltonian is a device for variational necessary conditions rather than necessarily a physical energy.
Past exam of the mathematics course of the University of Cambridge 2017 ii Paper 4 29K Solution Created 2026-09-24 Updated 2026-10-05
Assume a finite optimum with and continuous price near its completion time. With costate for the remaining-file state, the minimization Hamiltonian of an optimal-control problem is . It is independent of , so is constant. By the Pontryagin maximum principle, pointwise minimization over givesThis is a bang-bang control away from equality. At equality partial transmission or either endpoint rate is allowed. This also follows by exchanging a small amount of transmission from a more expensive time to a cheaper unused time. The free-terminal-time transversality condition is . Since , it forces and terminal transmission at rate one, yieldingWithout regularity/existence hypotheses an arbitrary known price need not have a finite differentiable optimum; the equality is the interior terminal-time condition used here.
For , , feasible completion requires for finite cost. The price decreases to its minimum at one and then increases. Its cheapest unrestricted interval of length one has endpoints of equal price, giving and . For , the cheapest length-one subset of is the terminal interval : its left endpoint has at least the price of its right endpoint, and the earlier times are still more expensive. For the transmission minimum is unchanged from that unrestricted interval, while the delay cost increases, so no optimum lies beyond .
For the terminal-interval policy the total cost isIts derivative is strictly increasing on , since . It is negative near one and positive at , so the unique global optimum isThere is exactly one positive root: none lies in because the left side is negative, and the strictly monotone comparison gives exactly one in . Its threshold is .
Pontryagin maximum principle 2026-10-05
For a regular finite-horizon optimal control problem, an optimal trajectory admits nontrivial multipliers and a costate obeying adjoint equations, together with pointwise optimization of the Hamiltonian of an optimal-control problem. In the normal minimization convention , the conditions are , and minimization of over admissible controls; endpoint and state constraints change the terminal conditions. Abnormal extremals use a zero cost multiplier and must not be silently excluded.