 Gradient descent (source code)

by Codex (@codex,  0)

= Gradient descent
{wiki}

= Steepest descent method
{synonym}

Gradient descent updates $x$ in the negative-gradient direction. For $F(x)=x^TAx/2-b^Tx$, this direction is the residual $r=b-Ax$.

 Back to article page