Bang-bang control 2026-10-05
A control input taking only extreme admissible values except possibly on a switching or singular set. If the Hamiltonian of an optimal-control problem is affine in a scalar control , a nonzero coefficient selects or ; a zero coefficient does not determine the control.
Costate 2026-10-05
An adjoint variable enforcing the state dynamics in optimal control. In the normal minimization convention it satisfies for the Hamiltonian of an optimal-control problem, with terminal conditions determined by the endpoint constraints.
Free-terminal-time transversality condition 2026-10-05
For a smooth normal optimal control problem with freely variable terminal time, fixed terminal state independent of that time and terminal cost , the optimized Hamiltonian of an optimal-control problem at completion satisfies . It follows by varying the terminal time in the augmented objective; restrictions on terminal time or a moving endpoint introduce additional terms or inequalities.
Past exam of the mathematics course of the University of Cambridge 2017 ii Paper 4 29K Solution Created 2026-09-24 Updated 2026-10-05
Assume a finite optimum with and continuous price near its completion time. With costate for the remaining-file state, the minimization Hamiltonian of an optimal-control problem is . It is independent of , so is constant. By the Pontryagin maximum principle, pointwise minimization over givesThis is a bang-bang control away from equality. At equality partial transmission or either endpoint rate is allowed. This also follows by exchanging a small amount of transmission from a more expensive time to a cheaper unused time. The free-terminal-time transversality condition is . Since , it forces and terminal transmission at rate one, yieldingWithout regularity/existence hypotheses an arbitrary known price need not have a finite differentiable optimum; the equality is the interior terminal-time condition used here.
For , , feasible completion requires for finite cost. The price decreases to its minimum at one and then increases. Its cheapest unrestricted interval of length one has endpoints of equal price, giving and . For , the cheapest length-one subset of is the terminal interval : its left endpoint has at least the price of its right endpoint, and the earlier times are still more expensive. For the transmission minimum is unchanged from that unrestricted interval, while the delay cost increases, so no optimum lies beyond .
For the terminal-interval policy the total cost isIts derivative is strictly increasing on , since . It is negative near one and positive at , so the unique global optimum isThere is exactly one positive root: none lies in because the left side is negative, and the strictly monotone comparison gives exactly one in . Its threshold is .
Pontryagin maximum principle 2026-10-05
For a regular finite-horizon optimal control problem, an optimal trajectory admits nontrivial multipliers and a costate obeying adjoint equations, together with pointwise optimization of the Hamiltonian of an optimal-control problem. In the normal minimization convention , the conditions are , and minimization of over admissible controls; endpoint and state constraints change the terminal conditions. Abnormal extremals use a zero cost multiplier and must not be silently excluded.