Completeness of Lp spaces 2026-10-14
From an Lp norm Cauchy sequence choose a subsequence with successive difference norms at most . Minkowski inequality and monotone convergence theorem make the sum of the absolute differences an function, hence finite almost everywhere. The telescoping series defines an limit; the geometric bound on its tail proves norm convergence of the subsequence, and the original Cauchy property proves convergence of the whole sequence. No sigma-finiteness assumption is needed.
For and , interpolate the two-coordinate map between norm one and norm . This proves the scalar inequality with factor . Integrating that estimate and applying Minkowski inequality to in gives the displayed function inequality.
For and nonzero elements of the same real or complex Lp space, equality in the Minkowski inequality holds if and only if
Equivalently, almost everywhere for a single positive real number . The multiplier must be constant across ; matching signs at each input alone is insufficient. For complex numbers, an arbitrary complex scalar multiple is also insufficient: gives for nonzero . If either element is zero in Lp space, equality holds automatically, even if a representative has nonzero values on a null set.
The reason is strictly convex normed space geometry. Normalize to unit Lp norm and use weights and . Distinct normalized functions give a convex combination of Lp norm strictly below one. This follows by integrating the strict convexity of on the real numbers or complex numbers; equality therefore forces the normalized functions to agree almost everywhere.
At , equality instead means almost everywhere: the nonnegative difference has zero integral. For real functions, this is almost everywhere. For complex functions, their nonzero values must have the same argument wherever both are nonzero, but their magnitude ratio may vary. The disjoint-coordinate vectors and illustrate equality without constant proportionality.
At , no such constant proportionality condition is necessary: and have L-infinity norms one and a sum of L-infinity norm two. Nor must an essential supremum be attained: under Lebesgue measure on , give equality , although neither function takes the value one. The endpoint Lp spaces need not be strictly convex normed spaces.
For , write to emphasize that this is a quasi-norm, as in the Lq quasi-norm branch. On two coordinates with counting measure, and give , but . At , this is the explicit failure in the right panel of the diagram. The midpoint has , so the corresponding unit sublevel set is not a convex set.
A useful replacement survives: for nonnegative real numbers , . Together with the scalar triangle inequality, this yields
Consequently is a metric on the equivalence classes of measurable functions with finite , even though itself need not be a metric. Do not replace the failed Minkowski inequality by a universal reversed bound for signed or complex functions: would give a zero sum but two positive separate sizes.
Integrated second-order kernel bias bound Created 2026-10-07 Updated 2026-10-14
For a nonnegative symmetric unit-integral kernel for density estimation and , the integral Taylor remainder and Minkowski inequality give . Translation preserves the L2 norm. For a signed kernel the same proof requires the absolute moment .
Minkowski inequality Created 2026-10-05 Updated 2026-10-14
For measurable functions with values in the real numbers or complex numbers on the same measure space , and , membership in the same Lp space gives
Thus adding two functions cannot make their combined Lp norm exceed the sum of their separate Lp norms. The measure need not be finite or a probability measure. The hypotheses require finite Lp norms; uses the essential supremum of the absolute value, not an ordinary pointwise supremum. For complex numbers, the absolute value is the complex modulus. As usual, Lp spaces identify functions equal almost everywhere. [ref]
The Minkowski inequality makes the Lp norm a workable notion of size: it supplies the triangle inequality needed to turn into a metric on Lp space. Applied to , it says that travelling through an intermediate function cannot shorten the direct distance measured by this metric. Applied to two error functions, it gives a bound on the total error even when the errors reinforce one another; Minkowski inequality for error aggregation gives explicit examples.
The geometry is already visible in the Euclidean plane. Under counting measure on two coordinates, the closed unit balls for the L1 norm, Euclidean norm, and L-infinity norm are respectively , , and . Every one is a convex set: if have Lp norm at most one, the Minkowski inequality and absolute homogeneity of a norm give for . The Euclidean norm has no flat boundary segments, whereas the other two norms do. This is the distinction captured by a strictly convex normed space and developed in equality in Minkowski inequality.
Figure 1. . The red point is the midpoint of the two marked unit vectors. It lies inside the disk, but on the flat edge of the diamond or square. All three unit balls are convex sets; only the disk gives a strictly convex normed space among these planar examples. Details.
A short Hölder's inequality proof outline handles . First , so has finite Lp norm before any division. With conjugate exponents and , set ; then . The scalar triangle inequality followed by Hölder's inequality gives
Divide if ; otherwise the desired bound is immediate. For , integrate . For , the almost everywhere bounds and give the result by the essential supremum. The same scalar triangle inequality works for real numbers and complex numbers.
Suppose an approximation is compared with a target through an intermediate approximation , with both error functions in the same Lp space. The identity and the Minkowski inequality combine two error budgets without any independence assumption. The L1 norm controls aggregate absolute error, the L2 norm controls the square root of aggregate quadratic loss, and the L-infinity norm controls the largest error almost everywhere. For equally weighted samples with the probability measure on each coordinate, the L2 norm is the root mean square error; the inequality still applies when this normalization is used consistently.
For example, two signed error vectors and have Euclidean norms and , while . Reinforcing errors and attain the bound ; opposing errors and cancel completely. The Minkowski inequality always allows reinforcement. A smaller combined budget requires additional information about the errors, not just their separate norms.
Iteration gives for every finite sum. For an infinite series, if all belong to one fixed Lp space with and , its partial sums form a Cauchy sequence in the full Lp norm. Completeness of this Banach space then gives norm convergence to an element of the same Lp space. A finite sum bound alone does not establish convergence, and completeness is an additional ingredient beyond the Minkowski inequality. [ref]
For vectors or , counting measure turns the Minkowski inequality into
For , replace each displayed norm by the maximum of its coordinate absolute values. Take and . Both vectors have Lp norm one for every , but their sum has L1 norm , Euclidean norm , and L-infinity norm . Thus the same vector addition gives equality at , strict inequality at , and strict inequality at .
By contrast, and give equality for every : absolute homogeneity of a norm yields . At , the three sizes are , , and . Opposite vectors behave very differently: , so the inequality is strict whenever is nonzero. Cancellation is allowed; the bound describes the largest possible total size.
Figure 1.
Strict Minkowski inequality, equality for positive multiples, and quasi-norm failure
. Arrows show , the translated step , and their sum. Left: perpendicular unit vectors give for the Euclidean norm. Middle: and give . Right: and give for the Lq quasi-norm at . Pale curves show the corresponding unit level sets. Details.
Minkowski integral inequality Created 2026-09-24 Updated 2026-10-14
This is the integral version of the Minkowski inequality.
For suitable measurable and ,
Pair the left side with a unit vector in the dual space, use Tonelli's theorem, and apply Hölder's inequality in .
Let be a Cauchy sequence in the L2 space , choosing measurable representatives. There is a subsequence with
Write and . Repeated Minkowski inequality gives . As increases pointwise, the monotone convergence theorem gives
Hence is finite almost everywhere and represents an L2 function. Define
where the series converges, and set on the exceptional Lebesgue null set. It is a measurable function, and almost everywhere, so Minkowski inequality gives .
For fixed , Fatou's lemma applied to squares of finite tails and then Minkowski inequality give
Thus the subsequence converges to in norm. Given , choose a sufficiently late with and with for every sufficiently large , using the original Cauchy sequence property. The triangle inequality then gives . Therefore
This proves the needed instance of completeness of Lp spaces without assuming the result being proved.
Use Lebesgue measure restricted to the Lebesgue measurable set . For , start with the measurable real-valued functions on satisfying . Define an equivalence relation by when almost everywhere, and let consist of their equivalence classes. Addition and scalar multiplication are defined using representatives. The Lp norm is
For , use measurable functions bounded almost everywhere, apply the same identification, and define the L-infinity norm by
These expressions are independent of the representative. For finite , zero norm is equivalent to almost everywhere: each set must have measure zero, and their union is . The same implication follows from the essential supremum for . Absolute homogeneity is immediate; Minkowski inequality proves the triangle inequality and closure under addition. Thus these are normed vector spaces. Using complex-valued representatives gives their complex versions by the same construction.
Minkowski inequality states that on a measure space , for and measurable real or complex of finite Lp norm,
For , integrate the scalar triangle inequality . For , the almost everywhere bounds and give the same result by taking the essential supremum.
For , first ensure that the left side is finite. The convex function on gives
so has finite Lp norm. Set and . Since , Holder inequality gives
If the result is immediate; otherwise divide by . This proves the triangle inequality for every claimed exponent.
Consider the complex-linear two-coordinate map . The triangle inequality shows that its operator norm from to is one; equality is attained at . The complex parallelogram identity
shows that its norm from to is . Interpolate these endpoint bounds by the Riesz-Thorin theorem with parameter . Then
Dividing the output norm by proves the scalar estimate:
Apply it pointwise to and integrate its th power. With , this gives
By Minkowski inequality, the expression on the right is at most
Therefore the requested function inequality holds, namely the dual-exponent Clarkson inequality.
Completeness means that every norm-Cauchy sequence has a limit belonging to the same Lp space, with . To prove it, choose a subsequence with . The functions
have -norm bounded by , by Minkowski inequality. They increase to , and Fatou's lemma gives . Thus is finite almost everywhere, so the subsequence telescopes absolutely there to a measurable limit with and .
The same argument on the tails gives . Given , choose such a subsequence term beyond the Cauchy threshold and use . This proves convergence of the full sequence and completeness for every , on an arbitrary measure space.
The Minkowski inequality states the triangle inequality for every norm with . Apply it to and then to . The two bounds combine to
Thus norm convergence implies convergence of the norms themselves.
The real L2 space on a probability space consists of equivalence classes of measurable functions satisfying , where two random variables represent the same element if they are equal almost surely. Its norm is
Passing to equivalence classes makes this a genuine norm: exactly when almost surely. The Minkowski inequality gives the triangle inequality.
Let be a Cauchy sequence in this norm. Choose an increasing sequence of indices such that
This is possible by choosing beyond a Cauchy threshold for tolerance . Set . The Cauchy-Schwarz inequality on a probability space gives . By Tonelli theorem,
Thus the series of absolute differences is finite almost surely. Define on this probability-one event, and give it the value zero on its complement. It is a measurable function, and almost surely.
For , the Minkowski inequality gives
Apply the Fatou lemma to the squared difference as . It follows that
In particular , and therefore by the Minkowski inequality. This proves convergence in L2 of the subsequence. To recover the entire sequence, for a prescribed choose a Cauchy threshold for , then choose with and . For every ,
Hence , proving completeness of Lp spaces for without assuming the desired completeness in the argument.
Concavity of gives because . Exponentiating proves Young inequality
with equality precisely when . Equivalently it follows from convexity of the exponential.
Define with . Positivity, definiteness and homogeneity are immediate. Summing Young inequality for normalized sequences gives Hölder's inequality . For a finite truncation , it yields
Dividing and passing to larger truncations proves Minkowski inequality and shows , so this is a normed vector space.
Let be a norm-Cauchy sequence. Each coordinate is Cauchy because , and let its limit be . The sequence norms are bounded by some . For every finite , passage to coordinate limits gives , so . Given , choose with for . Letting in finite truncations and then gives for . Thus is complete, hence a Banach space.
Apply Hölder's inequality to the finite sum with the second sequence :
Divide by the last power if the sum is nonzero. The resulting bound is independent of , so passing to the limit proves both membership in and the Minkowski inequality
The Lp space is the vector space of equivalence classes, modulo equality almost everywhere, of measurable functions with , equipped with . To prove it is a Banach space, let be Cauchy in this norm. Choose a subsequence such that
Take measurable representatives and put , . The Minkowski inequality gives . By the monotone convergence theorem, satisfies . Consequently is finite almost everywhere, and the telescoping series
converges absolutely almost everywhere. Define it arbitrarily on the null exceptional set. The bound puts in .
For the tails, monotone convergence and Minkowski again give
Since the original sequence is Cauchy, the triangle inequality then gives in norm, not merely along the subsequence. Hence
This proof needs no finiteness or sigma-finiteness assumption on the measure space.
Use the usual probability-kernel convention: , , and , in addition to symmetry and compact support. These conditions are needed for the stated finite bound; symmetry and compact support by themselves do not impose normalization or nonnegativity. Interpret the differentiability assumption in the usual Sobolev space sense , or assume classical regularity sufficient for the integral Taylor remainder. The kernel density estimator is
The bias-variance decomposition of mean squared error, followed by Tonelli theorem, yields
Independence and a change of variables give the exact integrated variance of a kernel density estimator
All changes of integration order are justified either by nonnegativity or by the displayed finite integrals.
For the bias of a kernel density estimator, symmetry gives . Taylor's integral remainder, with translations understood in , gives
The Minkowski inequality and translation invariance of the L2 norm imply
where . Consequently we obtain the slightly stronger conclusion
Since , this proves the requested bound. For signed kernels, the same argument has in place of ; the printed bound is not generally justified merely by signed-kernel symmetry. For example, let and . This symmetric compactly supported signed kernel has integral one and , but its fourth moment is nonzero. For a normal density its convolution has nonzero bias at any fixed positive bandwidth. Sending would therefore contradict a bound containing only the integrated variance term.
Writing the requested bound as , differentiation gives when . Thus gives mean integrated squared error of order . With the sharper constant one instead has ; the rate is identical.
A direct heuristic for is to choose a twice differentiable pilot kernel , estimate by the second derivative kernel density estimator
and integrate its square. Its integrated variance contains a diagonal term , which should not be mistaken for the target. A useful corrected U-statistic removes that diagonal:
Its expectation is . Thus smoothing bias of an estimator, rather than the diagonal contribution, remains. For a smooth compactly supported probability pilot kernel, the same variance calculation gives
The second term tends to zero because convolution with a shrinking probability kernel approximates every function. Thus and make the raw squared pilot estimate consistent for the quadratic density derivative functional. If , then
so the diagonal-corrected U-statistic is consistent under the same choice. Consistency already uses the assumed ; the additional third-derivative hypothesis is relevant to more ambitious rate heuristics.
Three bounded continuous derivatives do not justify a general root- estimation rate for . For a smooth perturbation with compact support, the directional derivative is
where the last expression requires a fourth derivative in the appropriate weak sense. A regular root- argument would need an influence function proportional to , with finite variance under . Three derivatives do not supply that condition.
For a more quantitative heuristic, impose the additional assumption , use a smooth Fourier cutoff of width , and estimate the quadratic functional by its off-diagonal U-statistic. The tail bias of an estimator is because the Plancherel theorem weights this functional by frequency to the fourth power. The degenerate part of its standard deviation is : the squared norm of the quadratic kernel scales as . At , these two terms balance at and have size , already slower than ; any additional first-order variance cannot improve that balance. To make both terms requires and , which are compatible only when . This is an illustrative smoothness calculation under extra Sobolev and moment assumptions, not a rate theorem asserted solely from bounded third derivatives. Particular much smoother probability density functions may of course permit root- estimation.