Coupling characterization of total variation distance Created 2026-09-24 Updated 2026-10-14
A coupling of probability distributions is a pair of random variables with those marginal distributions. On a finite set, and more generally on a standard Borel space, the least achievable mismatch is
A maximal coupling attains the minimum; maximal here refers to agreement. An arbitrary coupling can have a much larger mismatch.[ref]
For the four-outcome example, assign the following joint probability mass: gets , gets , gets , and gets . The remaining must have ; place on and on . Row sums give , column sums give , and the diagonal contains . Agreement can reach 70%; mismatch cannot fall below 30%.
Figure 1. . The original joint-mass example retains all common probability mass on its diagonal. The two off-diagonal entries account for the minimum mismatch . Details.
To see the lower bound, for any event ,
The two indicator functions agree whenever . To attain the bound on a finite set, keep mass at and couple the remaining excesses. The two residual probability distributions live on disjoint subsets, so their part necessarily mismatches. When the probability distributions are identical, the residual part disappears entirely.
This is a choice of joint construction, not a claim that independently drawn observations are usually equal. Two independent random variables with the same continuous probability distribution can disagree with probability one even though their total variation distance is zero. The construction of a maximal coupling deliberately introduces statistical dependence to reveal how similar the marginal laws are.
Coupling inequality for total variation Created 2026-09-24 Updated 2026-10-14
For any coupling of random variables, the coupling characterization of total variation distance gives , where denotes the law of a random variable. If two coupled Markov chains stay identical after their coalescence time , then and
The persistent agreement is essential: a first meeting time does not give this bound if the chains can separate again. A coalescing coupling turns a difficult comparison of probability distributions into a concrete question about how long a joint simulation takes to merge.
Maximal coupling Created 2026-09-24 Updated 2026-10-14
A maximal coupling of two probability distributions maximizes the agreement probability among all their couplings. Equivalently, it minimizes . The coupling characterization of total variation distance identifies the minimum mismatch with the total variation distance of the two marginal laws. The term maximal concerns agreement, rather than the size of a correlation coefficient or closeness in a geometric metric.
On a finite set, retain all common probability mass at equal pairs and match the excesses elsewhere. The explicit four-outcome example in coupling characterization of total variation distance realizes this construction and checks its marginal distributions. A maximal coupling need not be unique: different joint arrangements of the residual mass can have the same optimal mismatch.
Let be the number of open edges, the number of connected components in the open subgraph, counting isolated vertices, and . Summing the joint weight over spins requires a constant spin on every open component. There are exactly choices. Thus the edge marginal is
This is the random-cluster measure, and the joint normalizing constant is .
Summing instead over edge configurations factors independently over edges. For a fixed spin configuration the resulting weight is
since . The factor is independent of the spins. Hence the spin marginal is exactly the ferromagnetic Potts measure in the convention
Its partition function satisfies .
Conditionally on , edge states are independent: an edge with different endpoint spins is closed with probability one, while one with equal endpoint spins is open with probability . Conditionally on , color its open components independently and uniformly from . Equivalently, every compatible spin configuration has conditional probability , and all incompatible configurations have probability zero. These are the two conditional laws of the Edwards-Sokal coupling.
If belong to the same open component, their colors agree surely; otherwise the two independent component colors agree with probability . Therefore
Rearranging proves the spin-connectivity identity for the Potts model:
Phase transitions refer to infinite-volume limits, not a single finite graph. The identity shows that connectivity is exactly the excess spin agreement above its independent-color baseline. More directly, use a wired random-cluster boundary condition and fix the corresponding boundary spin to color . Its component has color , while every finite component has a uniform color. In the compatible infinite-volume coupling,
Consequently normalized spontaneous magnetization is
The onset of a wired infinite cluster and the onset of spontaneous magnetization in the Potts model are the same transition under , giving . This also transfers any jump or continuity of that order parameter between the two descriptions; it makes no assumption about behavior exactly at the critical point.
Fix and a finite epsilon-net in . Choose a Borel map with , for example the nearest point with ties broken by index. Its cells give discrete probability measures with masses and . Let
The feasible set is nonempty and compact, so the minimum exists. Pushing any coupling forward by changes its cost by at most , hence . Conversely, lift a discrete coupling by the measure
Terms with zero row or column masses vanish. This lift has marginals , and its cost differs by at most . Therefore
Here is the finite linear programming duality proof. Write and consider the convex cone
It is closed and finitely generated. One elementary justification of closedness is to reduce each nonnegative representation to linearly independent generators, eliminating a coefficient along any linear dependence; after choosing a subsequence using the same subset of generators, their independent coordinates have bounded, convergent coefficients whenever the represented vectors converge. For , the point lies outside . Separation from this closed convex cone gives coefficients with
If , summing the middle inequalities against any feasible contradicts the last one. Thus , and , obey with dual objective greater than . The weak inequality already proved gives the reverse bound. Letting proves finite strong duality.
Reduce this discrete dual to a single Lipschitz function. For a feasible pair put . The triangle inequality gives , while and . Consequently
Conversely, any -Lipschitz vector gives a feasible pair . Adding a constant leaves its objective unchanged, so impose . The resulting feasible set is compact, and its maximum is .
For a maximizing vector, the McShane extension theorem has the following explicit proof in this situation. Define
The triangle inequality proves that this extension is -Lipschitz, and the discrete Lipschitz condition makes . Thus is a continuous feasible pair. Because ,
Letting , together with part i, proves . The infimum defining is also attained: the set of couplings is a closed subset of the compact space of probability measures on , and integrating the continuous cost is continuous for the weak-star topology.
Use the Lipschitz constant convention in the final quantity; it is a seminorm, with constants having value zero. Also interpret the coupling space as . The printed has an undefined . The third quantity has a duplicated printed label; it is placed in part iii here, with the fourth in part iv.
First prove weak optimal transport duality. For any feasible continuous pair and any coupling of probability distributions with marginals ,
Taking the supremum over pairs and infimum over couplings gives . These quantities are finite: is a coupling and the continuous cost is bounded on the compact metric space . The zero pair is feasible, so .
The reverse inequality is established in part ii by finite approximation and a proof of the required finite linear programming duality. Parts iii and iv then show that all the dual formulations agree.