The useful form is Talagrand's convex distance inequality. Let be standard probability spaces, let carry the product measure , and let be a measurable event with . For , form the mismatch vectors
The Talagrand convex distance is the distance from zero to their closed convex hull:
Equivalently, by the Hahn-Banach separation theorem for two convex sets,
Nonnegative weights suffice because every mismatch vector has nonnegative coordinates. Talagrand's convex distance inequality states
In particular, Markov's inequality gives the product-space concentration inequality
The same conclusion is interpreted with outer probabilities if a distance set is not measurable; the continuous geometric function used below has measurable level sets. A median of a real random variable means that and . Applying the displayed concentration inequality to suitable level sets will control deviations around a median.
The Hahn-Banach separation theorem for two convex sets states that disjoint nonempty convex sets in a real locally convex space, with open, admit a nonzero continuous linear functional and such that
There need not be a positive uniform gap between the two sets.
For a proof, set . It is open and convex, and . Choose , let , and let be the Minkowski functional of . Because is open, convex and contains zero, is a finite sublinear functional, and . Put . Since , . On define . For this equals ; for it is nonpositive and hence at most . The Hahn-Banach theorem extends it to a linear with . Both and are bounded near zero, so this domination makes continuous; it is nonzero because . For ,
Thus for every . Define , which is finite because any fixed bounds it above. Openness of and nonzeroness of ensure for every , and for every . This proves the stated separation.
For the sequence criterion, suppose and . If each , then
Conversely, the assumed inequality implies that every convex combination of the has norm at least . Hence is disjoint from . Apply the separation theorem with the open set to obtain and
Then has norm one and satisfies for every . Therefore
The PDF confirms the “if and only if” that is garbled in the TeX transcription.
The Hahn-Banach separation theorem for two convex sets states that if and are disjoint nonempty convex subsets of a real locally convex space and is open, then there are a continuous linear functional and a real number such that
To prove it, form
This is open and convex and does not contain zero. The separation of a point and an open convex set, proved from the Minkowski functional and the Hahn-Banach theorem, gives a nonzero continuous with for every . Hence for all . Taking between and gives the stated form.
For a dual pair , the topology has a neighbourhood base at zero consisting of
Every is continuous by definition. Conversely, if a linear functional is continuous, some such neighbourhood lies in . Therefore . Elementary linear algebra then gives . Thus
For a normed space , the weak topology is ; on the weak-star topology is , using the canonical image of in . If is reflexive, , so the weak and weak-star topologies on coincide. Conversely, if they coincide, every is weak-star continuous. The dual-pair result says that every such functional is evaluation at some , so is onto and is reflexive.
For , every and zero satisfy every inequality defining , so . The latter is an intersection of weakly closed convex half-spaces, hence contains
If , choose an open convex neighbourhood of zero with . Applying the separation theorem to and gives with
Because , the supremum is nonnegative. After multiplying by a positive scalar, on while . Thus but . We conclude with the Bipolar theorem for a dual pair: