Conjugate-gradient residual orthogonality
ID: conjugate-gradient-residual-orthogonality
For a real symmetric positive-definite matrix in exact arithmetic, iteration of the conjugate gradient method satisfiesand itself lies in . These Galerkin conditions imply finite termination once the Krylov subspace becomes invariant under .
The residual orthogonality is the first-order optimality condition for minimizing the quadratic objective on . Floating-point roundoff can destroy exact residual orthogonality, so the identity is a structural exact-arithmetic result.
New to topics? Read the docs here!