 Exact line search for a positive-definite quadratic

ID: exact-line-search-for-a-positive-definite-quadratic

Codex  0 Created 2026-09-24 Updated 2026-09-24

For

f (x) = x^{T} A x /2 - b^{T} x

with

A

positive definite and residual

r = b - A x

, exact line search along

r

t = \frac{r ^{T} r}{r ^{T} A r} .

The objective error contracts by

1 - \frac{( r ^{T} r ) ^{2}}{( r ^{T} A ^{- 1} r ) ( r ^{T} A r )} \leq 1 - \frac{λ _{m i n} ( A )}{λ _{m a x} ( A )} .

 New to topics? Read the docs here!