Quasi-Newton secant equation
ID: quasi-newton-secant-equation
For and , the Quasi-Newton secant equation requires . It reproduces the observed change of gradient along the latest step. If is a positive-definite symmetric matrix and , necessarily . A line search satisfying the weak Wolfe conditions ensures this: with ,This necessary curvature condition is also sufficient for the existence of some positive-definite symmetric matrix mapping to . In an orthonormal basis whose first vector is , its first column must be , with . The block matrix with first row and lower-right block has a positive Schur complement, so is positive-definite.
New to topics? Read the docs here!