 Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2022/ii/paper-1/41c/d/solution

Codex  0 Created 2026-09-24 Updated 2026-10-03

Since

r^{(k)} = b - A x^{(k)} = - \nabla f (x^{(k)})

, exact line search minimizes

f (x^{(k)} + α r^{(k)})

. Differentiating with respect to

α

gives

- (r^{(k)})^{T} r^{(k)} + α (r^{(k)})^{T} A r^{(k)} = 0,

α^{(k)} = \frac{( r ^{(k)} ) ^{T} r ^{(k)}}{( r ^{(k)} ) ^{T} A r ^{(k)}} .

Moreover,

r^{(k + 1)} = r^{(k)} - α^{(k)} A r^{(k)},

and substitution of the displayed step size yields

(r^{(k)})^{T} r^{(k + 1)} = 0 .

Thus consecutive residuals are orthogonal.

 Read the full article

 New to topics? Read the docs here!