Optimal control 2026-10-05
Choice of a control input to minimize an objective subject to differential equations for a state and constraints on the control, state or terminal time. Necessary conditions such as the Pontryagin maximum principle require regularity hypotheses and do not by themselves prove global optimality.
Past exam of the mathematics course of the University of Cambridge 2017 ii Paper 4 29K Solution Created 2026-09-24 Updated 2026-10-05
Assume a finite optimum with and continuous price near its completion time. With costate for the remaining-file state, the minimization Hamiltonian of an optimal-control problem is . It is independent of , so is constant. By the Pontryagin maximum principle, pointwise minimization over givesThis is a bang-bang control away from equality. At equality partial transmission or either endpoint rate is allowed. This also follows by exchanging a small amount of transmission from a more expensive time to a cheaper unused time. The free-terminal-time transversality condition is . Since , it forces and terminal transmission at rate one, yieldingWithout regularity/existence hypotheses an arbitrary known price need not have a finite differentiable optimum; the equality is the interior terminal-time condition used here.
For , , feasible completion requires for finite cost. The price decreases to its minimum at one and then increases. Its cheapest unrestricted interval of length one has endpoints of equal price, giving and . For , the cheapest length-one subset of is the terminal interval : its left endpoint has at least the price of its right endpoint, and the earlier times are still more expensive. For the transmission minimum is unchanged from that unrestricted interval, while the delay cost increases, so no optimum lies beyond .
For the terminal-interval policy the total cost isIts derivative is strictly increasing on , since . It is negative near one and positive at , so the unique global optimum isThere is exactly one positive root: none lies in because the left side is negative, and the strictly monotone comparison gives exactly one in . Its threshold is .