Hessian of a sum of functions of linear forms

ID: hessian-of-a-sum-of-functions-of-linear-forms

For twice differentiable , constant vectors and constant scalars , let , and let row of be . The chain rule gives
The second formula is the displayed matrix product because entry is the same weighted sum . Signed diagonal factors do not ensure a positive-definite Hessian matrix. The factorization also gives an efficient matrix-free Hessian-vector product.

New to topics? Read the docs here!