Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2023/ii/paper-3/40c/d/solution

Put . Then
For an eigenvalue , the corresponding block has characteristic polynomial
For ,
so the polynomial is
For , it is
Its discriminant is , so its conjugate roots have product and modulus . Both blocks therefore have the same spectral radius, and
This is the heavy-ball rate for a two-eigenvalue diagonal quadratic.
By contrast, the steepest-descent factor is
The heavy-ball factor is , which is substantially smaller for : it gives an iteration scale of order rather than order .

New to topics? Read the docs here!