Past exam of the mathematics course of the University of Oxford / 2017 / Prelims / Mathematics IV resit / 7 / b / i

For an unconstrained differentiable function of two real variables, an interior local minimum must solve the simultaneous stationary point equationsApply Newton's method in optimization to this gradient equation. The Jacobian matrix of the gradient is the Hessian matrixAt $p_n=(x_n,y_n{)}^T$, solve the linear system $H(p_n)s_n=-\nabla f(p_n)$, then set $p_{n+1}=p_n+s_n$. When the Hessian matrix is invertible, this isThis follows by setting the first order Taylor expansion $\nabla f(p_n+s_n)\simeq \nabla f(p_n)+H(p_n)s_n$ equal to zero. Solving the linear system avoids explicitly computing a matrix inverse. A stationary point need not be a local minimum: for example, a positive-definite matrix $H(p)$ suffices to classify a stationary point as a strict local minimum, whereas an indefinite Hessian matrix identifies a saddle point of a scalar function.