For the quadratic objective with a real symmetric matrix , the Heavy-ball method takes
Multiplying by and adding gives
Under the usual zero-initial-momentum choice , one has , so induction expresses every residual as a polynomial in applied to . It belongs to the associated Krylov subspace. With two arbitrary starting iterates, the general expression instead combines polynomials applied to both starting residuals; a single-residual polynomial claim then needs an additional relation between them.

Articles by others on the same topic (0)

There are currently no matching articles.