Writing , the th partial derivative at is the vector limit
when it exists. The total derivative is a linear map satisfying
The Jacobian matrix has entries . If the total derivative exists, its matrix in the standard bases is precisely , because substitution of identifies every column. Existence of the partial derivatives alone does not in general imply existence of the total derivative.
For a scalar-valued differentiable function, its gradient is the column vector
It represents the total derivative by the Euclidean inner product:
Thus is a row matrix; the gradient and the total derivative represent the same first-order information but have different types.
The chain rule states that is differentiable at and
In terms of Jacobian matrices,
The factors have dimensions and , respectively, giving the required Jacobian matrix.
Differentiating the reciprocal of gives the gradient
At the gradient is . Therefore the total derivative is the linear map
represented by the Jacobian matrix .
The total derivative of sends a scalar increment to
Since , the function composition is constantly , so . Directly, the Jacobian matrix product is
This verifies the chain rule at every .
The partial derivatives satisfy a global bound of in absolute value. For example,
because and ; the same argument applies to . Apply the one-dimensional mean value theorem first along a horizontal segment and then along a vertical segment:
Thus is Lipschitz with constant for the coordinate-sum norm.

Articles by others on the same topic (0)

There are currently no matching articles.