Past exam of the options II course of the University of Oxford / 2013 / F2 / a / iv

For an increment $h$, direct expansion and the chain rule giveFor example, $\Vert x+h{\Vert }^2-\Vert x{\Vert }^2=2x^{T}h+\Vert h{\Vert }^2$, so the quadratic remainder divided by $\Vert h\Vert$ tends to zero. The corresponding gradients are $\nabla g(x)=2x$ and $\nabla k(x)=2A^{T}Ax$; the derivative of $F$ is the constant matrix $A$.