For the quadratic objective with a real symmetric matrix , the Heavy-ball method takesMultiplying by and adding givesUnder the usual zero-initial-momentum choice , one has , so induction expresses every residual as a polynomial in applied to . It belongs to the associated Krylov subspace. With two arbitrary starting iterates, the general expression instead combines polynomials applied to both starting residuals; a single-residual polynomial claim then needs an additional relation between them.
Articles by others on the same topic
There are currently no matching articles.