Quadratic minimization along a line

ID: quadratic-minimization-along-a-line

For a symmetric positive-definite matrix and a nonzero vector , minimizing over , where , gives the displayed optimizer. Put . Expansion gives , a strictly convex quadratic function of . At its minimum,
Strict decrease is therefore equivalent to . This is minimization over a full line, so the optimizer can be negative. For an exact line search restricted to a nonnegative step size, the optimizer is instead .

New to topics? Read the docs here!