Discrete Riccati recurrence 2026-10-05
A backward scalar or matrix recurrence for the quadratic coefficients in a value function for a linear-quadratic optimal control problem. It results from completing the control square in the Bellman equation. Multiplicative noise modifies the quadratic coefficients through its second moments.
Hamilton-Jacobi-Bellman equation Created 2026-10-03 Updated 2026-11-05
For a controlled ordinary differential equation , running cost and terminal cost , a smooth optimal value function satisfiesThis is the continuous-time Bellman equation. Split the cost into a short initial interval and the optimal continuation. Expanding the continuation by the chain rule, dividing by the interval length and taking its limit yields the equation. The optimization acts on the control at the current state and time.
For and running cost , the minimized expression is . Completing the square gives the minimizing control and the equation . The quadratic ansatz leads to linear-quadratic optimal control. [ref]
Underactuated Robotics by Russ Tedrake. Underactuated Robotics, chapter8, basic HJB derivation and finite-horizon formulation
For a controlled diffusion process , the corresponding equation adds inside the infimum. A value function need not be differentiable; the viscosity solution formulation handles many such cases. A classical verification argument additionally requires the candidate feedback to be admissible and to attain the indicated infimum.
Past exam of the mathematics course of the University of Cambridge 2018 ii Paper 4 30K b Solution Created 2026-09-24 Updated 2026-10-03
Completing the square in the Hamilton-Jacobi-Bellman equation shows that the minimizing feedback isThis is a linear-quadratic optimal control problem, so set . The equation and terminal condition becomeThis Riccati equation is separable and givesConsequently the general optimal feedback law isWhen is constant,Along the corresponding optimal trajectory, , so the open-loop control is constant: for .
Russ Tedrake 2026-11-05
Russ Tedrake authored Underactuated Robotics by Russ Tedrake, developing mathematical methods for controlling systems with fewer independent actuators than degrees of freedom. Its treatment of the linear-quadratic optimal control derives feedback gains from a Riccati equation. This connects a local dynamical model and a quadratic performance objective with an explicit stabilizing control law under appropriate assumptions.[ref]
Underactuated Robotics by Russ Tedrake. Chapter 8, Basic Derivation and Finite-horizon LQR