Past exam of the short options course of the University of Oxford / 2017 / 4 / b / i

Expand the increment of the quadratic form, using $A^T=A$:The last term obeys $|h^{T}Ah|\le \Vert A\Vert \Vert h{\Vert }^2=o(\Vert h\Vert )$. Thus $q$ is differentiable andThis is the quadratic form gradient. The derivative is a linear functional of the increment $h$, whereas the gradient is its representing vector under the Euclidean inner product.