Past exam of the mathematics course of the University of Oxford / 2017 / Prelims / Mathematics IV resit / 7 / b

For an unconstrained differentiable function of two real variables, an interior local minimum must solve the simultaneous stationary point equationsApply Newton's method in optimization to this gradient equation. The Jacobian matrix of the gradient is the Hessian matrixAt $p_n=(x_n,y_n{)}^T$, solve the linear system $H(p_n)s_n=-\nabla f(p_n)$, then set $p_{n+1}=p_n+s_n$. When the Hessian matrix is invertible, this isThis follows by setting the first order Taylor expansion $\nabla f(p_n+s_n)\simeq \nabla f(p_n)+H(p_n)s_n$ equal to zero. Solving the linear system avoids explicitly computing a matrix inverse. A stationary point need not be a local minimum: for example, a positive-definite matrix $H(p)$ suffices to classify a stationary point as a strict local minimum, whereas an indefinite Hessian matrix identifies a saddle point of a scalar function.

Expanding and taking partial derivatives gives the gradient and Hessian matrixAt $p_0=(-1,0{)}^T$, these are $\nabla f(p_0)=(-6,2{)}^T$ andThus the Newton step solvesThe second equation gives $s_y=1-2s_x$; substituting into the first gives $22s_x=10$. HenceAt $p_{\ast }=(-1/2,-1/2{)}^T$, however,The eigenvalues of this Hessian matrix are $-1$ in direction $(1,1)$ and $7$ in direction $(1,-1)$. It is invertible but indefinite. Thus the Newton step is zero, andThis illustrates that stationary points are fixed points of Newton's method. Here the fixed point is a saddle point of a scalar function, not a local minimum. Indeed, direct substitution along the two eigenvector directions givesFor sufficiently small nonzero $t$, one direction decreases $f$ and the other increases it. The global minimum is instead zero: the sum of squares vanishes at $(0,0)$ and $(-1,-1)$. These are the only real zeros, since $x=-y^2$ and $y=-x^2$ imply $y(y^3+1)=0$. Thus a zero gradient is an insufficient stopping certificate for minimization problem without classifying the stationary point.