Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2020/ii/paper-2/40e/b/solution

For an iterate , the Conjugate gradient method residual is
Two fundamental properties are the Conjugate-gradient residual orthogonality conditions
Equivalently, the residuals generated before convergence are mutually orthogonal and span the successive Krylov spaces.
Since has only distinct eigenvalues, its minimal polynomial has degree at most . Consequently
The two properties then put both inside and orthogonal to , so . Hence , and

New to topics? Read the docs here!