Past exam of the options I course of the University of Oxford / 2004 / F / F1 / a / Solution

Expand at a matrix increment $H$:The last term is $O(\Vert H{\Vert }^2)$ in a matrix norm, so it contributes no derivative. HenceThis is a linear operator on matrix increments, not a scalar entrywise derivative.