 Solution

At a critical point $p$ of a twice continuously differentiable function, the linear term in the Taylor expansion vanishes:The real symmetric Hessian matrix has an orthonormal basis of eigenvectors. If all its eigenvalues are positive, its quadratic term is bounded below by a positive multiple of $\Vert h{\Vert }^2$, giving a strict local minimum. If all are negative, it gives a strict local maximum. If positive and negative eigenvalues both occur, directions along their eigenvectors give values on both sides of $f(p)$, so the point is a saddle point of a scalar function. The non-singularity assumption excludes zero eigenvalues; with them the quadratic test may be inconclusive and higher-order terms are needed.