A Newton step for Newton's method in optimization is the displacement solving the displayed linear system, where is the Hessian matrix and the gradient. The next iterate is . This makes the first order Taylor expansion of the gradient at the new point vanish. An invertible Hessian matrix determines a unique step; it need not give a descent direction when the Hessian matrix is indefinite.
New to topics? Read the docs here!