Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2018/ii/paper-4/30k/b/solution

Completing the square in the Hamilton-Jacobi-Bellman equation shows that the minimizing feedback is
This is a linear-quadratic optimal control problem, so set . The equation and terminal condition become
This Riccati equation is separable and gives
Consequently the general optimal feedback law is
When is constant,
Along the corresponding optimal trajectory, , so the open-loop control is constant: for .

New to topics? Read the docs here!