Heavy-ball rate for a two-eigenvalue diagonal quadratic Created 2026-09-24 Updated 2026-11-05
Let with , choose , and put and . The two-by-two heavy-ball error propagation matrix for a scalar eigenvalue has characteristic polynomial
At , its middle coefficient is , giving a repeated root . At , the polynomial is , whose roots are complex conjugates with modulus . Thus the full propagation matrix has spectral radius exactly .
The repeated root can produce an error term , so the spectral radius is an asymptotic rate and does not assert a stepwise error bound with one fixed constant times . For , the parameters reduce to , and the identity-matrix problem is solved in one update. Values are outside the displayed rate convention.
Because , the error obeys
Thus the heavy-ball error propagation matrix is
If , permute the coordinates from
to
For the corresponding permutation matrix ,