Let for every , and let differ from only at , where . Under the left shift, the unique defect of lies at coordinate . Every fixed finite coordinate set eventually avoids the defect, so
in the product topology. If a metric induces this topology, convergence and the triangle inequality imply . But left shift invariance would give
for every , a contradiction. Thus no compatible metric invariant under the left shift exists. The discrete metric is shift invariant, but it induces the discrete topology rather than the product topology; compatibility is the essential restriction.
For in the domain of the exponential map at , let be the unique geodesic with initial data and define . The domain consists of initial velocities whose geodesics exist on ; it is open, contains zero, and need not be the whole tangent space. The ordinary differential equation theorem used here says that a smooth vector field has unique maximal integral curves, with an open flow domain and smooth dependence on initial point and time. Applied to the geodesic equation on , it gives smoothness of the exponential map. Rescaling the parameter gives and hence . The inverse function theorem makes a diffeomorphism from a neighbourhood of zero to one of . Coordinates in an orthonormal tangent basis transported by this map are geodesic normal coordinates.
The geodesic sphere of radius is . For small , it is , a smooth compact hypersurface; larger distance spheres need not be smooth. The Gauss lemma states
In particular radial and angular directions are orthogonal and the radial coordinate measures arc length.
For a piecewise smooth path , put . The Riemannian distance is over such paths from to . Connectedness makes it finite. Reversal and concatenation give symmetry and the triangle inequality; positivity and compatibility with the manifold topology follow locally from geodesic normal coordinates and the Gauss lemma.
Choose so that is a diffeomorphism on a neighbourhood of the closed tangent ball of radius . For , radial geodesics realize the distance from on that ball. Indeed, Gauss lemma bounds any path remaining in the normal ball below by its radial change, while a path leaving the radius- ball already has length at least . Thus the radius- sphere is the compact exponential image described above.
Given , take . The continuous function attains its minimum at some . Every path from to crosses that sphere, since the distance from is continuous. Splitting at a crossing gives length at least . Taking the infimum over paths, and using the triangle inequality in the other direction, proves the distance splitting through a small geodesic sphere equality
This compact local argument does not assume completeness or the existence of a globally minimizing geodesic to .
For the Lie-group clause, a bi-invariant Riemannian metric has adjoint-invariant identity inner product. Differentiating this invariance gives . The Koszul formula for left-invariant vector fields has no metric-derivative terms, and this skew-adjointness reduces it to
This is the Levi-Civita connection of a bi-invariant metric.
Let be the integral curve through the identity of the left-invariant field with identity value . Uniqueness and left translation show wherever the local curves are defined. The field is complete: a fixed local existence interval about the identity translates to an equally long interval at every point of the group. Restarting the curve before any proposed finite endpoint extends it beyond that endpoint. Thus exists on , and uniqueness now gives the group law for every .
Since , this integral curve is a geodesic. Conversely any geodesic starting at the identity has the same initial data as one of these curves and agrees with it by uniqueness. Therefore the geodesics of a bi-invariant metric are one-parameter subgroups conclusion is
The zero velocity gives the constant, trivial subgroup. Here is the Exponential map of a Lie group; for this metric it agrees at the identity with the Riemannian exponential.
Use the closed genus version of Teichmüller's uniqueness theorem. Let be a Teichmüller map: for a nonzero holomorphic quadratic differential , normalized by , and ,
The value at a zero of is irrelevant to the Beltrami coefficient, which is defined almost everywhere. For every quasiconformal map preserving orientation and homotopic to , the conclusion is
The normalized is also uniquely determined when .
We use the following analytic input, stated with its hypotheses. The Reich–Strebel inequality says that if has the displayed Beltrami coefficient and a competitor has the same target and homotopy class, then, for ,
This is the standard fundamental inequality for an integrable holomorphic quadratic differential; it also holds on a finite-type punctured surface with the homotopy fixing the punctures. Its formulation is given in Gardiner and Hu, §5. We quote this analytic inequality as the lecture result used in the proof.
Put . Pointwise, away from the isolated zeros of ,
Integrating against the probability density function proves . If , all these inequalities are equalities almost everywhere. The strictly increasing last function forces almost everywhere; equality in the triangle inequality then forces . Therefore
Two quasiconformal maps with the same Beltrami coefficient differ by postcomposition with a biholomorphism, by the local chain rule for the Beltrami equation. Consequently is a biholomorphism from to itself homotopic to the identity.
For completeness, such a biholomorphism is the identity when . Apply the uniformization theorem and choose the lift of the homotopy to starting at the identity. Its endpoint lift commutes with every deck transformation. It is a real Möbius transformation. The compact quotient has no parabolic Möbius transformations in its deck group, and freeness excludes elliptic Möbius transformations. Two distinct hyperbolic axes exist: a discrete free group preserving just one axis would be cyclic, contradicting the fundamental group of a closed surface of genus at least two. Commutation with two deck transformations represented by hyperbolic Möbius transformations having distinct axes makes it fix their boundary endpoints individually; there are at least three such endpoints. A Möbius transformation fixing three points is the identity. Hence and .
If is another unit-area differential for the same map, then , so is positive real wherever defined. This meromorphic function is constant by the open mapping theorem, and normalization makes the constant one. Without normalization, positive multiples of describe the same map. At , uniqueness of the map still holds in genus at least two, but there is no distinguished . In genus one, translations supply nontrivial biholomorphisms homotopic to the identity, so equality determines the map only up to those biholomorphisms; the genus hypothesis cannot be omitted.
Retain the metric geodesic subdivision and orbit-density parts of the usual Milnor–Švarc lemma proof. Drop the step using proper discontinuity and compactness to prove that the displacement-bounded generating set is finite.
More explicitly, let and . Subdivide a metric geodesic from to into segments of length at most one. Choose orbit points within distance of the subdivision points, choosing the endpoints exactly: , . Then
so every nonidentity increment lies in . Their telescoping product is , and hence
This also covers , when the one increment may be a nontrivial stabilizer element. Conversely, for any word in , the triangle inequality and invariance under the isometric action give
Taking the shortest word gives the other inequality. Thus the proof works unchanged except that the resulting generating set may be infinite. Neither local compactness nor a finite stabilizer is used in this weaker argument.
Let and be Radon-Nikodym derivatives. Use the following normalizations of the Kullback-Leibler divergence, total variation distance and unnormalized Hellinger distance:
We use and assign infinite Kullback-Leibler divergence if , where denotes absolute continuity of measures. Common domination alone also suffices for the inequalities with the extended-value convention. The negative part of the logarithmic integral is integrable: on , . Thus the extended-value integral defining the Kullback-Leibler divergence is well-defined. These expressions do not depend on which common dominating measure is chosen. The Kullback-Leibler divergence is generally asymmetric and therefore fails a defining property of a metric.
For completeness, the integral formula for total variation distance follows by taking : since , the positive and negative parts of have the same integral, and this set attains the supremum.
Put , by the Cauchy-Schwarz inequality. A second application gives
The logarithmic inequality in the hint implies for . Apply it to on :
Multiplying by and integrating proves
If on a set of positive -measure, the right side is finite but the Kullback-Leibler divergence is infinite, so the inequality is immediate. Thus
This total variation–Hellinger–relative entropy inequality requires the stated Hellinger distance normalization for its first constant. With the alternative convention , the correct comparison is and . In particular, and have .
Here is a testing form of the Le Cam two-point lemma. Suppose two parameter values in a metric space have separation , and let be the corresponding observation laws. Every estimator satisfies
To prove it, classify by the closer of the two parameters, breaking a tie in favour of one. Let . On , the triangle inequality implies , while on it implies . Hence the sum of the two probabilities in the display is at least
At least one is at least half the sum, proving the claim. It also gives a lower bound for the maximum expected metric loss.
For absolute-error loss, or any loss given by a metric, there is a stronger expectation form. Take densities relative to and use the triangle inequality under their overlap:
Therefore the Le Cam lower bound under absolute-error loss is
Both arguments are valid for randomized estimators as well, by adjoining the independent randomization to the observation; doing so does not change total variation distance.
For the normal distribution model, assume the usual nondegenerate convention and use the full product observation laws. Choose
For one observation, its Gaussian log likelihood ratio is
Under the first law, and . Thus the Kullback-Leibler divergence between normal distributions is
For the independent and identically distributed random variables, the joint log likelihood ratio is the sum of the individual ones, so the Kullback-Leibler divergence of the two full statistical samples is . The comparison just proved implies . Applying the expectation form of the Le Cam two-point lemma gives
This is a Gaussian location minimax lower bound under absolute-error loss. The constant may depend on the fixed known , but neither on the estimator nor on . If a signed nonzero scale were used, the same result holds with in place of . If zero noise were allowed, would estimate exactly, so a positive lower bound would be false; positive variance is necessary.
For probability distributions on a finite set, the total variation distance is
The equality follows by taking : the positive and negative parts of have the same mass, since its total mass is zero.
Use the stationary distribution identity . For each initial state ,
The triangle inequality for total variation distance, followed by the definition of the pairwise mixing diameter, gives
Taking the maximum over proves . This particular inequality only needs a stationary distribution; it does not require an irreducible Markov chain or an aperiodic Markov chain.
The Cameron-Martin space of a Gaussian random variable in a Banach space is most conveniently defined using the first Gaussian chaos. Work over the real separable Banach space , with continuous dual space . For a centered Gaussian random variable in a Banach space, define
The set inside the closure is already a linear subspace. Every is a centered Gaussian random variable. The Bochner integral defining exists: Fernique's theorem states that for some , , and then Cauchy-Schwarz inequality gives .
The map is injective. Indeed, implies for all . Density of these observations in then implies . Define the Reproducing-kernel Hilbert space by
The injectivity makes the inner product unambiguous, and the completeness of makes a Hilbert space. The embedding into is continuous since
For put . The reproducing property is
This defines the Banach-space Gaussian RKHS even for a degenerate Gaussian measure.
For , write . There is a measurable coordinate on , obtained as a limit in L2 space of continuous linear observations, and has normal distribution . The Cameron-Martin theorem for a Gaussian measure, in its real separable Banach space form, states that if is the probability law of , then the probability law of is an equivalent probability measure to precisely when . For such a shift,
For the two laws are mutually singular measures. The coordinate need not be a continuous functional on , and the sample need not belong to .
Apply this theorem to the shift . With , it gives
Choose the measurable coordinate so that on a symmetric set of full -measure. This is possible by taking an almost-surely convergent subsequence of the approximating linear observations and intersecting its convergence set with its negative. Alternatively the joint law of is invariant under simultaneous negation, directly from those observations and their mean-square convergence. Since and the centered Gaussian measure is symmetric, the two exponential integrals with signs and agree. Consequently
because . The symmetric Gaussian translation lower bound is therefore
Only symmetry and Borel measurability of are required; convexity is not needed.
There is one degenerate flaw in the last printed claim. The separable Banach space with has dense in , and all positive-radius balls have probability one. Nevertheless for every . Thus the statement needs the additional hypothesis . If the course convention excludes the zero space, this hypothesis is already implicit.
Under this necessary hypothesis, density of implies that contains a nonzero vector. Given , scale that vector to obtain with , and choose . The triangle inequality gives
The centered closed ball is a symmetric Borel set. Apply the symmetric Gaussian translation lower bound to get
Hence the Gaussian norm distribution is strictly increasing when is nonzero. This proves the strict increase of a Gaussian norm distribution without assuming that its distribution has a density or that spheres have zero probability.
For a linear regularization, add and subtract the exact-data reconstruction:
The triangle inequality gives the noise-bias decomposition for linear regularization:
The two summands are noise amplification and approximation bias. Increasing the strength of regularization typically decreases noise amplification and increases bias; reducing regularization has the opposite effect. These are qualitative tendencies and bounds, not a claim that each realized noise error is monotone for every noise vector.
For the one-sided differentiation example, the bounds are and . Their sum has an interior balance point when the second-derivative bound is positive and the optimum lies in the permitted interval. The following original sketch plots these bounds against :
Figure 1.
Balancing approximation and noise-amplification errors
.
For the Volterra operator, the identity requires in addition to the printed hypothesis. The constant function is a counterexample to the unrestricted domain assertion: it is not in . The estimate below is valid for derivatives of every function, and estimates the Moore–Penrose reconstruction when this missing boundary condition holds.
Let . Apply separately to the two halves defining differentiation by one-sided difference quotients:
The two translated intervals cover each point at most twice; this proves the factor six. The shifts act on almost-everywhere equivalence classes, so no undefined pointwise data sampling is involved.
For exact data, write the forward difference as and the backward difference as . If , either differs from by at most . The interval has length one, so this also bounds the approximation error. The triangle inequality proves the error bound for one-sided differentiation:
For , uniform Lipschitz- means that one constant satisfies for every . The resulting Hölder space has norm
For the subsequent estimates at general , use the higher-order Hölder class convention: write with an integer and , and require with uniformly Lipschitz-. Thus
At integer , this uses ; the alternative classical convention is stronger on this compact closed interval and also suffices for the estimates.
For exponents above one, a first-difference inequality alone forces the function to be constant. Partition into equal pieces and use the triangle inequality: . Consequently a nontrivial higher-order definition is needed for the full range of exponents in the later wavelet estimates. Equivalently, higher-order Hölder class gives a local Taylor polynomial with remainder bounded by .
It is equivalent to minimize or its th power , because taking the th root is strictly increasing. For , this is an Lq quasi-norm, while gives the L1 norm.
Assume the Lq null space property of order . Let have support of a vector with , and let be any distinct feasible vector. Then . The triangle inequality for complex magnitudes and the subadditivity give
For the same inequality follows directly from the triangle inequality. Since off ,
Thus is the unique minimizer.
Conversely, suppose every -sparse vector is the unique minimizer for its measurements. Fix and any with . The vectors and are distinct and satisfy , since . Uniqueness for this therefore implies , exactly the required strict inequality. Hence
The quantifier is uniform over the entire sparse class. Recovery of one particular signed vector alone would not imply this null space property.
For a fully discrete linear partial differential equation evolution, write in a specified discrete norm. Finite-time stability of a numerical method means
with independent of the allowed meshes. For a multistep method, augment the state with its time-history values and include a stable starter. Bounds may grow as when the continuous problem has growth; demanding decay for all time would be a stronger assertion. The treatment of initial data, forcing, Dirichlet boundary conditions, and the norm is part of the hypothesis, not a detail supplied by an interior calculation.
For constant coefficients on an infinite or periodic uniform grid, Von Neumann stability analysis substitutes the Fourier mode . The discrete Fourier transform and the Parseval identity turn a uniform multiplier estimate into a discrete L2 norm estimate. In a one-step scalar scheme, proves contractivity, while gives finite-time stability. In a multilevel scheme, every root of a polynomial in its amplification polynomial of a multilevel finite difference scheme matters, as does uniform control of the associated companion matrix.
For the Forward Euler diffusion scheme with ,
Thus for all frequencies exactly when
Sufficiency follows since ; necessity follows from the highest-frequency mode on even periodic grids. This gives the usual parabolic mesh restriction . For the Backward Euler diffusion scheme,
so every is stable. The Crank--Nicolson method has
again of modulus at most one for all , but stiff modes approach rather than zero. These are PDE manifestations of the A-stability and L-stability distinctions for time integration.
For advection , assume and set . The upwind finite difference scheme is , with
It is contractive when . This also has a direct maximum-norm proof: each newest value is a convex combination of two old values. The resulting Courant–Friedrichs–Lewy condition expresses that the numerical domain of dependence covers the physical one. For negative , the upwind direction must be reversed. By contrast, Forward Euler method time stepping with the centered first finite difference has and for nonzero . Under fixed nonzero refinement it is unstable, since a fixed nontrivial mode grows geometrically over steps. This is not a claim of instability under every imaginable mesh coupling: instead bounds its spurious finite-time growth, since .
The leapfrog advection scheme illustrates a multilevel subtlety. Its amplification polynomial of a multilevel finite difference scheme is
For , both roots of a polynomial have unit modulus and separation at least . A uniformly conditioned eigenbasis of the companion matrix then proves power boundedness of a two-level Fourier scheme for arbitrary history data. At and a grid admitting , the roots coincide on the unit circle, and a Jordan block produces growth. Thus the endpoint fails the ordinary arbitrary-history root condition for a multistep method; checking only that both moduli equal one misses the instability. Restricting the starter or filtering the parasitic mode is an additional hypothesis.
The energy method handles variable coefficients and finite boundaries for which Fourier stability analysis may be unavailable. For the Backward Euler diffusion scheme with homogeneous Dirichlet boundary conditions, define . The discrete summation by parts identity is
Take the inner product of with . The elementary identity gives
This proves unconditional contractivity including the actual boundary treatment. More generally, a dissipative operator gives of operator norm at most one: with , dissipativity implies , and the Cauchy-Schwarz inequality gives . In finite dimensions this also proves invertibility. For the second-order backward differentiation formula, the BDF2 discrete energy identity used in question 4 controls both time levels and proves unconditional diffusion stability. A repeated root strictly inside the disk is harmless here; the energy argument supplies the uniform bound without a singular eigenvector formula.
A second technique is eigenvalue stability analysis of a finite difference method. Under the method of lines, a time integrator advances by . If is a normal matrix, the scalar linear stability domain criterion on all controls its powers exactly in the corresponding L2 norm. For the centered Dirichlet discrete Laplacian, its eigenvalues lie between and zero; intersecting this interval with a time integrator's stability interval determines its mesh restriction. A uniform bound on the diagonalization of a matrix is needed for nonnormal diagonalizable systems. Eigenvalues alone can be misleading. For example,
has both eigenvalues inside the disk for , but the upper-right entry of is . Taking , , this grows like . Hence stable scalar eigenvalues do not give mesh-uniform stability. Boundary closures can introduce precisely the extra growth that an interior Fourier symbol overlooks, so boundary stability of a finite-difference method must be checked separately.
For nonlinear spatial discretizations, a useful replacement for Fourier stability analysis is a convexity argument. If the Forward Euler method map is nonexpansive in a chosen norm for , the second-order strong stability preserving Runge-Kutta method
is also nonexpansive under the same restriction. Indeed, for two inputs, the triangle inequality gives . Its Taylor expansion is , proving order two. Such strong stability preserving Runge-Kutta methods transfer suitable forward-step bounds without relying on a linear spectral calculation.
Finally, consistency of a numerical method explains what stability buys. For a linear Hadamard well-posed problem, the Lax equivalence theorem equates convergence of a consistent discretization with its stability, under the stated approximation-space and norm hypotheses. Directly, if the error satisfies , iteration gives the discrete Duhamel principle
Thus vanishing normalized local truncation error and initial error yield convergence. With a nonlinear Lipschitz step estimate, the discrete Gronwall inequality plays the same role. A stable but inconsistent stencil, such as the literal defective formulas in questions 3 and 4 under their usual refinement, is not rescued by any amplification bound. The decisive checks are a mesh-uniform evolution bound, a valid boundary closure, and consistency with the actual PDE.
A map is Lipschitz continuous with Lipschitz constant when
for all .
Fix . The Lipschitz inequality and the triangle inequality imply
while choosing gives a finite upper bound. Hence the infimum defining is a real number.
If , then for every , while gives the reverse inequality after taking the infimum. Thus . For arbitrary ,
Taking infima gives ; interchanging gives
This is the McShane extension theorem: extends without increasing its Lipschitz constant.
Two norms are equivalent norms when constants satisfy
for every .
For , the reverse triangle inequality gives
by the Cauchy-Schwarz inequality. Hence is Lipschitz continuous, and therefore continuous.
On the compact Euclidean unit sphere, is positive and continuous, so the extreme value theorem gives . Homogeneity then yields
Thus every norm on a finite-dimensional vector space is equivalent to the Euclidean norm; comparing two such bounds proves any two norms on are Lipschitz equivalent.
The L1 norm properties of absolute homogeneity and the triangle inequality follow from the corresponding properties of the absolute value and the integral. If , the nonnegative continuous function has zero integral. Were , continuity would make it bounded below by a positive number on a nontrivial interval, contradicting the zero integral. Thus , proving positive definiteness.
Put and choose the continuous cutoff function
Then , , and is supported in the two endpoint intervals of total length . Therefore
Now suppose for every . Apply this to the above . By the uniform norm bound,
Hence , and continuity again gives .
A metric space metric satisfies positivity, exactly when , symmetry, and the triangle inequality. A subset is an open set when every has some with the open ball .
Both and are open. An arbitrary union of open sets is open because a point lies in one member supplying a ball. A finite intersection is open because the minimum of the finitely many available radii supplies a ball. Thus the metric-open sets satisfy the topology axioms.
For , the Cauchy-Schwarz inequality gives , so the topology is at least as fine as the topology. To see strictness, define the continuous triangular spikes
Then
Thus converges to zero in the L1 norm but not in the L2 norm. The two metrics induce different topologies.
Take and the Fourier transform convention . Write the scalar polynomial as , with homogeneous of degree . The principal symbol of the constant-coefficient linear partial differential operator is . It is an elliptic differential operator exactly when
Complex coefficients are allowed, but the frequency is real.
By compactness of the unit sphere, . Homogeneity gives , whereas the lower-degree terms are bounded by for . The triangle inequality then gives the high-frequency lower bound for an elliptic polynomial:
for sufficiently large . Thus
The Japanese bracket is . If , a nonzero constant satisfies the same assertion directly.
For real , the Sobolev space is the tempered distribution space
One may include in the squared norm for this Fourier transform normalization; it does not change the space. The Local Sobolev space is
where multiplication of a distribution by a smooth function is followed by extension by zero.
If is a compactly supported distribution, choose a cutoff function equal to one near its compact support. The finite order of a distribution gives an integer and a bound
for a fixed compact set . This also makes a tempered distribution. Its Fourier transform of a compactly supported distribution is the smooth function
The Leibniz rule gives the last estimate, and parameter differentiation under the finite-order pairing proves smoothness of this Fourier transform. Therefore the negative Sobolev regularity of a compactly supported distribution is
Indeed is integrable precisely when . This proves the claimed existence of a sufficiently negative Sobolev space index.
We use three elementary Sobolev space facts: differentiation of order maps continuously into ; for ; and Sobolev multiplication by a smooth cutoff is bounded on for every real . The first two follow directly from the frequency weights. For the third, multiplication of a distribution by a smooth function becomes convolution with the rapidly decaying , and
together with Young's convolution inequality gives the bound. These facts apply after localization as well.
The high-frequency lower bound for an elliptic polynomial gives a useful global implication. If and , split its Fourier transform into and . The low-frequency part is controlled by , while the high-frequency part is controlled by . Thus, for arbitrary real ,
The conclusion that is obtained directly by integrating these frequency bounds; it is not an assumption made to state the estimate.
For the cutoff bootstrap for local elliptic regularity, fix . A cutoff function equal to one near makes a compactly supported distribution after multiplication, so the preceding negative-index argument gives for some finite . Suppose inductively that . For any test function ,
The Leibniz rule shows that this commutator has order at most , with smooth functions as coefficients, all with compact support:
A second cutoff function equal to one near lets us apply the stated Sobolev space bounds to every term. Hence , while . For , the global estimate yields
This holds for every such , so it improves the Local Sobolev space index by one until is reached. A finite number of iterations starting at proves
Since was arbitrary, the conclusion holds throughout . For , division by the nonzero constant proves it immediately. This is the asserted elliptic regularity, proved without assuming an initial nonnegative Sobolev space index.
A first-order example on is the first-order Cauchy-Riemann operator
It is an elliptic differential operator with complex coefficients. In one real variable, is already a first-order elliptic differential operator.
There is no scalar elliptic differential operator of odd order in three variables. If its order were odd, its principal symbol would satisfy on . Regard the continuous map
The Borsuk-Ulam theorem gives for some . Oddness then gives , contradicting ellipticity. This is the odd-order obstruction for scalar elliptic operators in at least three dimensions; restricting to a three-dimensional subspace proves the higher-dimensional case too. For real coefficients alone, the same obstruction follows from the intermediate value theorem along a path between antipodal points.
The scalar qualification matters. An elliptic system of differential equations can be first order in three variables: with the Pauli matrices, the matrix symbol satisfies and is invertible for . This does not contradict the scalar polynomial obstruction.