Coupling characterization of total variation distance Created 2026-09-24 Updated 2026-10-14
A coupling of probability distributions is a pair of random variables with those marginal distributions. On a finite set, and more generally on a standard Borel space, the least achievable mismatch isA maximal coupling attains the minimum; maximal here refers to agreement. An arbitrary coupling can have a much larger mismatch.[ref]
Markov Chains and Mixing Times, second edition by David A. Levin and others. §4.2, Example 4.6 and Proposition 4.7, printed pp. 49–52: finite-state coupling and common-mass construction
For the four-outcome example, assign the following joint probability mass: gets , gets , gets , and gets . The remaining must have ; place on and on . Row sums give , column sums give , and the diagonal contains . Agreement can reach 70%; mismatch cannot fall below 30%.
To see the lower bound, for any event ,The two indicator functions agree whenever . To attain the bound on a finite set, keep mass at and couple the remaining excesses. The two residual probability distributions live on disjoint subsets, so their part necessarily mismatches. When the probability distributions are identical, the residual part disappears entirely.
This is a choice of joint construction, not a claim that independently drawn observations are usually equal. Two independent random variables with the same continuous probability distribution can disagree with probability one even though their total variation distance is zero. The construction of a maximal coupling deliberately introduces statistical dependence to reveal how similar the marginal laws are.
Coupling inequality for total variation Created 2026-09-24 Updated 2026-10-14
For any coupling of random variables, the coupling characterization of total variation distance gives , where denotes the law of a random variable. If two coupled Markov chains stay identical after their coalescence time , then andThe persistent agreement is essential: a first meeting time does not give this bound if the chains can separate again. A coalescing coupling turns a difficult comparison of probability distributions into a concrete question about how long a joint simulation takes to merge.
Maximal coupling Created 2026-09-24 Updated 2026-10-14
A maximal coupling of two probability distributions maximizes the agreement probability among all their couplings. Equivalently, it minimizes . The coupling characterization of total variation distance identifies the minimum mismatch with the total variation distance of the two marginal laws. The term maximal concerns agreement, rather than the size of a correlation coefficient or closeness in a geometric metric.
On a finite set, retain all common probability mass at equal pairs and match the excesses elsewhere. The explicit four-outcome example in coupling characterization of total variation distance realizes this construction and checks its marginal distributions. A maximal coupling need not be unique: different joint arrangements of the residual mass can have the same optimal mismatch.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 38 3 Solution Created 2026-10-03 Updated 2026-10-14
Let be the number of open edges, the number of connected components in the open subgraph, counting isolated vertices, and . Summing the joint weight over spins requires a constant spin on every open component. There are exactly choices. Thus the edge marginal isThis is the random-cluster measure, and the joint normalizing constant is .
Summing instead over edge configurations factors independently over edges. For a fixed spin configuration the resulting weight issince . The factor is independent of the spins. Hence the spin marginal is exactly the ferromagnetic Potts measure in the conventionIts partition function satisfies .
Conditionally on , edge states are independent: an edge with different endpoint spins is closed with probability one, while one with equal endpoint spins is open with probability . Conditionally on , color its open components independently and uniformly from . Equivalently, every compatible spin configuration has conditional probability , and all incompatible configurations have probability zero. These are the two conditional laws of the Edwards-Sokal coupling.
If belong to the same open component, their colors agree surely; otherwise the two independent component colors agree with probability . ThereforeRearranging proves the spin-connectivity identity for the Potts model:
Phase transitions refer to infinite-volume limits, not a single finite graph. The identity shows that connectivity is exactly the excess spin agreement above its independent-color baseline. More directly, use a wired random-cluster boundary condition and fix the corresponding boundary spin to color . Its component has color , while every finite component has a uniform color. In the compatible infinite-volume coupling,Consequently normalized spontaneous magnetization isThe onset of a wired infinite cluster and the onset of spontaneous magnetization in the Potts model are the same transition under , giving . This also transfers any jump or continuity of that order parameter between the two descriptions; it makes no assumption about behavior exactly at the critical point.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 9 5 ii Solution 2026-10-14
Fix and a finite epsilon-net in . Choose a Borel map with , for example the nearest point with ties broken by index. Its cells give discrete probability measures with masses and . LetThe feasible set is nonempty and compact, so the minimum exists. Pushing any coupling forward by changes its cost by at most , hence . Conversely, lift a discrete coupling by the measureTerms with zero row or column masses vanish. This lift has marginals , and its cost differs by at most . Therefore
Here is the finite linear programming duality proof. Write and consider the convex coneIt is closed and finitely generated. One elementary justification of closedness is to reduce each nonnegative representation to linearly independent generators, eliminating a coefficient along any linear dependence; after choosing a subsequence using the same subset of generators, their independent coordinates have bounded, convergent coefficients whenever the represented vectors converge. For , the point lies outside . Separation from this closed convex cone gives coefficients withIf , summing the middle inequalities against any feasible contradicts the last one. Thus , and , obey with dual objective greater than . The weak inequality already proved gives the reverse bound. Letting proves finite strong duality.
Reduce this discrete dual to a single Lipschitz function. For a feasible pair put . The triangle inequality gives , while and . ConsequentlyConversely, any -Lipschitz vector gives a feasible pair . Adding a constant leaves its objective unchanged, so impose . The resulting feasible set is compact, and its maximum is .
For a maximizing vector, the McShane extension theorem has the following explicit proof in this situation. DefineThe triangle inequality proves that this extension is -Lipschitz, and the discrete Lipschitz condition makes . Thus is a continuous feasible pair. Because ,Letting , together with part i, proves . The infimum defining is also attained: the set of couplings is a closed subset of the compact space of probability measures on , and integrating the continuous cost is continuous for the weak-star topology.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 9 5 i Solution Created 2026-10-03 Updated 2026-10-14
Use the Lipschitz constant convention in the final quantity; it is a seminorm, with constants having value zero. Also interpret the coupling space as . The printed has an undefined . The third quantity has a duplicated printed label; it is placed in part iii here, with the fourth in part iv.
First prove weak optimal transport duality. For any feasible continuous pair and any coupling of probability distributions with marginals ,Taking the supremum over pairs and infimum over couplings gives . These quantities are finite: is a coupling and the continuous cost is bounded on the compact metric space . The zero pair is feasible, so .
The reverse inequality is established in part ii by finite approximation and a proof of the required finite linear programming duality. Parts iii and iv then show that all the dual formulations agree.
