Heavy-ball method
= Heavy-ball method
{c}
The heavy-ball iteration adds momentum to gradient descent:
$$
x_{k+1}=x_k-\alpha\nabla F(x_k)+\beta(x_k-x_{k-1}).
$$
= Heavy-ball method
{c}
The heavy-ball iteration adds momentum to gradient descent:
$$
x_{k+1}=x_k-\alpha\nabla F(x_k)+\beta(x_k-x_{k-1}).
$$