Past exam of the mathematics course of the University of Cambridge / 2018 / ii / Paper 4 / 30K / b / Solution

Completing the square in the Hamilton-Jacobi-Bellman equation shows that the minimizing feedback isThis is a linear-quadratic optimal control problem, so set $F(x,t)=a(t)x^2$. The equation and terminal condition becomeThis Riccati equation is separable and givesConsequently the general optimal feedback law isWhen $c_t=c$ is constant,Along the corresponding optimal trajectory, $x_s=x(c+h-s)/(c+h-t)$, so the open-loop control is constant: $u_s^{\ast }=-x/(c+h-t)$ for $s\in [t,h]$.