Let be normed vector spaces, open, and . The Fréchet derivative of at is a bounded linear map such that
The approximation is uniform over directions: the error divided by the size of the whole increment must vanish, rather than merely vanishing on each fixed line. Boundedness of the linear map is part of the definition.
The Fréchet derivative is unique. If both satisfy the remainder condition, substitute for each fixed vector , divide by , and let to obtain . Existence also implies continuity of at , since and is bounded. In finite dimensions the Jacobian matrix represents this linear map; mere existence of directional derivatives need not supply one.
For a positive integer , the negative matrix power is differentiable on the open general linear group. The Neumann series gives locally around any invertible matrix. Applying the product rule to the factors of this inverse gives the displayed Fréchet derivative. Each summand chooses one inverse factor to differentiate while keeping the others in order.
The factor order matters. Only when and commute does the sum simplify to . This is a useful example of why scalar differentiation rules for powers cannot be transferred to matrices without accounting for noncommutativity.
For on , continuity of on gives a bounded Fréchet derivative in the displayed form. Fixing and restricting to a bounded neighborhood confines all intermediate pairs to a compact range up to null sets. Uniform continuity of the partial derivatives bounds the integrated first-order remainder by , where . This is little-oh of the Sobolev norm. The result needs no continuous derivative representative for ; essential boundedness suffices.
Suppose and . If , then . The boundedness of is also preserved, and the same argument in reverse proves equivalence of differentiability. The derivative is the same linear map, not a norm-dependent replacement.
A map on a subset of a normed vector space is Hadamard differentiable at if its directional difference quotients converge to a continuous linear map uniformly along all convergent sequences of directions: , , and in the domain imply . Tangential differentiability restricts the limit directions to a specified subspace. This is the regularity used by the functional delta method.
For a Hadamard differentiable functional with continuous linear derivative , define . For every compact and positive , some positive make whenever and . If this failed, choose , directions within of and remainders at least . Compactness gives a convergent subsequence of nearby points of , hence convergent directions. The derivative definition and continuity of give remainder tending to zero, a contradiction. With a tight weak limit, the Portmanteau theorem makes random directions lie near a suitable compact set with arbitrarily large probability. Thus this lemma proves the functional delta method without assuming separability of the entire normed space or uniform differentiability on its whole unit ball.
On bounded continuously differentiable functions with uniformly bounded total variation of a function, the map is Hadamard differentiable in the supremum norm with derivative . Use weak convergence of bounded-variation integrators for the first term and integration by parts for the remaining terms. No derivatives of the limiting continuous directions are required.
A map is Fréchet differentiable at if it admits a bounded linear first-order approximation: for a continuous linear map .
On the open set of invertible square matrices, the inversion map is differentiable and

Ancestors (8)

  1. Differentiable map
  2. Multivariable calculus
  3. Calculus
  4. Real analysis
  5. Analysis
  6. Area of mathematics
  7. Mathematics
  8. Home

Discussion (0) New discussion

There are no discussions about this article yet.

Articles by others on the same topic (0)

There are currently no matching articles.