Writing , the th partial derivative at is the vector limitwhen it exists. The total derivative is a linear map satisfyingThe Jacobian matrix has entries . If the total derivative exists, its matrix in the standard bases is precisely , because substitution of identifies every column. Existence of the partial derivatives alone does not in general imply existence of the total derivative.
For a scalar-valued differentiable function, its gradient is the column vectorIt represents the total derivative by the Euclidean inner product:Thus is a row matrix; the gradient and the total derivative represent the same first-order information but have different types.
The chain rule states that is differentiable at andIn terms of Jacobian matrices,The factors have dimensions and , respectively, giving the required Jacobian matrix.
At the gradient is . Therefore the total derivative is the linear maprepresented by the Jacobian matrix .
The total derivative of sends a scalar increment toSince , the function composition is constantly , so . Directly, the Jacobian matrix product isThis verifies the chain rule at every .
The partial derivatives satisfy a global bound of in absolute value. For example,because and ; the same argument applies to . Apply the one-dimensional mean value theorem first along a horizontal segment and then along a vertical segment:Thus is Lipschitz with constant for the coordinate-sum norm.
Articles by others on the same topic
There are currently no matching articles.