Block mixed norm 2026-10-06
The block mixed norm sums the norm of each block, for . Its dual norm is , where for and for . Apply Holder inequality blockwise and choose a norming block to attain equality. Absolute values are essential for signed components.
Coercive bilinear form Created 2026-09-24 Updated 2026-10-14
A real bilinear form on a normed vector space is coercive when there is one constant such that
The lower bound uniformly controls every direction in the chosen norm. Unlike the upper bound defining a bounded bilinear form, it forces positive diagonal values at every nonzero vector. No symmetry is assumed. For complex Hilbert spaces, the usual analogue uses a sesquilinear form and ; it is not the same assertion for a complex bilinear form.
A concrete bounded and coercive example on , with the Euclidean norm, is
Its quadratic form is
The best lower constant is , attained at . Nevertheless, and , so coercivity does not imply a symmetric bilinear form. The symmetric part of a matrix determines , while the skew-symmetric matrix part changes mixed pairings without changing . This is the symmetric and alternating parts of a bilinear form decomposition.[ref]
For the upper constant, direct multiplication gives . Its eigenvalues are , so the optimal upper constant, the spectral norm, is . The two constants answer different questions: how large a mixed pairing can be, and how small a self-pairing can be relative to squared norm.
Figure 1.
Bounded saddle and flat-direction quadratic forms contrasted with a uniformly coercive bowl
. Details.
The plotted quadratic forms show the mechanism: descends in one direction, leaves one direction uncontrolled, and controls both. These are self-pairings; their level sets cannot reveal the skew-symmetric matrix part. Calling a quadratic energy here refers to this diagnostic quantity, not to a claim that a nonsymmetric equation comes from minimizing an energy functional.
On a real finite-dimensional vector space with any norm, strict positivity for every nonzero does imply coercivity. Indeed the quadratic form is continuous, and its positive minimum on the compact unit sphere supplies . If is also a symmetric bilinear form, this is positive definiteness. For general , it is the symmetric and alternating parts of a bilinear form decomposition that isolates the positive part. Switching between equivalent norms preserves coercivity, but usually changes its constant.
The infinite-dimensional vector space distinction is explicit on the real l2 sequence space:
The Cauchy-Schwarz inequality gives boundedness with , and for every nonzero vector. But with , so no positive works. On the span of , the best lower constant is : each finite restriction is coercive, but the control disappears as grows. Strict positivity is therefore weaker than a uniform lower bound.
The practical payoff is a stability estimate for a weak formulation. Assume is a real Hilbert space, is both a bounded bilinear form and a coercive bilinear form, and the load is a bounded linear functional. The Lax-Milgram theorem gives a unique satisfying for all , including nonsymmetric .[ref] The dual norm measures load size. Testing with gives the short energy estimate
For the bound holds directly; otherwise divide by . Subtracting the equations for two loads and using the same argument gives . Thus a positive lower constant limits the response to load errors. The upper bound and completeness of the Hilbert space enter the existence theorem; the estimate itself uses the lower bound and the load's dual norm.
For the displayed matrix , take . Then for every means , not , with this ordering of the bilinear form. Since ,
For , the exact response is and . For , it is , with norm . The actual maximal amplification is the operator norm : the coercivity estimate is valid but need not be sharp for a nonsymmetric bilinear form.
Figure 2.
Solutions for unit loads lie inside the coercivity bound, and response grows at most linearly with load norm
. Details.
Dual norm Created 2026-10-06 Updated 2026-10-18
A dual norm measures how strongly a bounded linear functional can respond to a unit-sized input. If is a bounded linear functional on a normed vector space , write and define
It is the operator norm of when its scalar output is measured by absolute value. On , represent using a coefficient vector . The unit ball is symmetric, so maximizing gives the same value as maximizing : negate an input whenever its output is negative.[ref]
For an original two-coordinate example, fix , so . The input norm changes the allowable unit ball and hence the dual norm:
Under the L1 norm, , and attains the bound. Under the Euclidean norm, the Cauchy-Schwarz inequality gives , with equality at the displayed normalized vector. Under the maximum norm, each coordinate can reach unit absolute value, so ; attains it. Thus the dual norms of these three vector norms are respectively the maximum norm, the Euclidean norm, and the L1 norm. For , Lp norms on a finite coordinate space pair with their Holder conjugate exponents.[ref]
Figure 1.
The same linear functional has three dual norms on three input unit balls
. Original geometry for . The orange supporting line touches each unit ball at the marked maximizing point. Blue regions use the L1 norm, Euclidean norm and maximum norm, respectively. Details.
This geometry explains the usefulness of a dual norm: it translates a bound on inputs into the sharp bound on a linear output. The support function of the unit ball gives its value in the coefficient direction . Changing the input budget changes the set of possible inputs; the three different answers do not conflict. In finite dimensions a closed unit ball is compact, so a continuous linear functional achieves its maximum absolute value. In an infinite-dimensional normed vector space, the supremum remains the definition and need not be achieved.
Suppose a perturbation satisfies , with . Absolute homogeneity of a norm and the dual norm definition give
For nonzero , divide it by its norm to obtain an input in the unit ball; for zero perturbation the inequality is immediate. This is an exact error bound for a linear functional, for every perturbation in the stated input set.
For and a budget , the sharp output-error bounds are for , for , and for . Scale the maximizing vectors from the preceding example by to attain the positive endpoints; their negatives attain the negative endpoints. The L1 norm budget constrains a total absolute error; the maximum norm budget permits each coordinate to have that error separately. These budgets define nested sets and carry different information.
Figure 1.
Dual norms give exact worst-case errors for the same linear functional
. Original bounds for . Lines show the sharp error magnitude as the stated input norm budget increases. The right panel gives the full possible error intervals at ; these are the full feasible intervals for the stated deterministic bounds. Details.
The coordinates must use the stated scale and units. Rescaling one coordinate changes both its coefficient in and the meaning of its input budget. For a nonlinear differentiable function with scalar values, its Fréchet derivative at the base point is a linear functional governing the first-order response. An exact finite-perturbation error bound additionally needs control of the Taylor remainder or of the Fréchet derivative along the path.
We prove existence by the direct method in the calculus of variations, making the step with weakly compact sets explicit. For and , introduce the functional
It is finite by part (b)(i). Hölder's inequality and the Sobolev embedding theorem give
Thus is a coercive function, bounded below, and every minimizing sequence is bounded in .
The space is a reflexive Banach space: it is isomorphic to a closed linear subspace of the finite product of the reflexive spaces recording the function and its weak derivatives. A bounded sequence in a reflexive Banach space has a weakly convergent subsequence. Hence, after passing to a subsequence, a minimizing sequence satisfies in . The continuous linear maps into and into preserve weak convergence, so
The norm in any Banach space has weak lower semicontinuity, since it is the supremum of absolute values of bounded linear functionals of dual norm at most one, by the Hahn-Banach theorem. Therefore the two nonnegative norm powers in have weak lower semicontinuity. Also belongs to and is continuous for weak convergence. It follows that
For any , the real function has a minimum at . Its derivative there is
This differentiation is justified directly by finite polynomial expansions: the fourth power of the Euclidean norm of and the eighth power of have integrable coefficients by Hölder's inequality. Thus , giving existence of a weak solution.
If are two weak solutions, testing the difference by and using part (b)(iii) gives
Hence
No sign assumption on or on the weak solution is required.
For maximization of subject to and , the Lagrangian sufficiency theorem says: if a feasible globally maximizes , where , and , then globally maximizes over the feasible set. Indeed, at every feasible ,
This requires a global maximum of the optimization Lagrangian; a stationary point alone is not sufficient without additional concavity or another justification.
Put and . If every , the maximum is zero and every feasible vector is optimal. Otherwise set
Since , . For , the optimization Lagrangian is . Its gradient vanishes at because
The function is a strictly convex function for , so is a strictly concave function. Its supporting-hyperplane inequality proves that this stationary point is its global maximum. Complementary slackness and feasibility hold, so the sufficiency theorem applies. Substitution gives
The maximizing vector is unique when . It is the norming vector for Holder inequality, and the value is the corresponding dual norm.
For any vectors ,
Thus, among directions with , . Equality is achieved by
For these minimizing directions have infinity norm one. The strongest decrease per unit infinity-norm step is , illustrating the dual norm pairing between the infinity norm and the one-norm.
To match the unnormalized convention in part (a), minimize . At fixed , its minimum is , attained at . One conventional choice is therefore , with zero entries where . Its ray agrees with the unit direction just computed.