A short concentration inequality argument explains the bound. For a fixed nonzero vector , the normalized row products are independent random variables with the standard normal distribution, soUse the moment-generating function of a chi-squared distribution and the Chernoff bound to obtainFor , elementary logarithm inequalities bound their sum by . Apply the union bound to the nonzero pair differences to get failure probability at most . Independence of different pairs is unnecessary; they use the same map. This combines fixed-vector concentration with a finite-set union bound. [ref]
Lecture notes on metric embeddings by Jiří Matoušek. Lecture notes on metric embeddings, §2.1, pp. 20–21, and proof of Lemma 2.3.1, pp. 25–26: fixed-vector concentration and union bound over pair differences
Hoeffding inequality Created 2026-09-24 Updated 2026-10-14
The Hoeffding inequality turns finite interval bounds and independence into exponentially small tail probabilities for a sum. It requires neither a normal distribution nor identical probability distributions. Let be independent essentially bounded real random variables, with deterministic finite bounds almost surely. Define the centered sum and its squared-width budget byFor and ,The union bound therefore gives . If , every is constant almost surely, so and both positive-threshold tail probabilities vanish. The equal-width version is stated in the authored Stanford notes.[ref]
The quantity is a sum of squared interval widths, not the variance of . Centering changes the endpoints to and , leaving each width unchanged. For example, independent random variables in and have , whatever their expected values or probability distributions. A deviation at least three above their total expected value has probability at most . If all widths equal , the sample mean satisfies
Independence is essential to this general guarantee. Take one Bernoulli random variable with success probability and set every . Each lies in , but for every the sample mean is either zero or one. Thus , whereas incorrectly inserting these dependent observations into the formula would give , less than one for . Some special dependent models have their own valid concentration inequalities; arbitrary statistical dependence cannot be ignored.
For the short proof, apply Markov's inequality to with , factor the expectation using independence, and apply the Hoeffding lemma to each factor:Minimizing this quadratic polynomial at gives the upper tail probability; applying it to gives the lower one. This is the Chernoff bound method. The original 1963 article is Probability Inequalities for Sums of Bounded Random Variables by Wassily Hoeffding; its publisher record identifies the article, but its full text was unavailable during this source check. The argument above is a direct derivation rather than a claim to have inspected that article's proof.
Past exam of the mathematics course of the University of Cambridge 2001 iii Paper 11 5 Solution Created 2026-10-03 Updated 2026-10-14
Replace by if necessary; this only weakens the hypothesis. We prove the result for finite graphs using a random proper partial graph coloring, then a deterministic completion. All constants below may depend on this fixed positive .
First record the extension of a partial colouring by neighbour-colour savings. If a partial colouring uses colours from a palette of size , let be the number of coloured neighbours of , their number of distinct colours, and the neighbour-colour saving. There are available colours and uncoloured neighbours. Thusat every vertex suffices for greedy completion: each subsequently coloured neighbour removes at most one available colour while reducing the uncoloured-neighbour count by one.
Call high-degree if . Its graph neighbourhood has at leastnonadjacent pairs for all sufficiently large . Assign independently to every vertex one of tentative colours. Erase the colour of every vertex having a neighbour with the same tentative colour. The remaining colouring is proper; erasure is based on the original assignments and is not an iterative cascade.
For each , define as the number of tentative colours assigned to at least one nonadjacent pair in its graph neighbourhood. Let count those same colours for which at least one neighbour of loses its colour. Then counts repeated colours with no erased occurrence among the neighbours, so .
For a particular nonadjacent pair , consider the event that both receive one colour and no vertex of receives that colour. This guarantees that its exactly two occurrences in both survive. Its probability is at leastHere , , and for . Different pairs cannot be counted by the same colour in this event, since each event specifies exactly two occurrences in the graph neighbourhood. Thereforefor every high-degree vertex. This is the expected colour savings from sparse neighbourhoods.
We need simultaneous concentration, not just a positive expectation. A single tentative-colour change can affect or only in the old and new colour categories, so each function changes by at most two. A witness for fixes two vertices for each of colours. A witness for fixes such a nonadjacent pair and an erased neighbour together with a same-coloured adjacent vertex, at most four vertices per colour. Thus both are certifiable functions with Lipschitz constant and certificate parameter at most . Both are bounded by .
To see exactly what concentration follows, let an integer-valued change by at most per coordinate and have certificates of size at most . For an input with , fix such a certificate . If has , form a hybrid agreeing with that input on and with outside . The hybrid has value at least , so at least certificate positions differ from . Equal weights on show that its Talagrand convex distance from is at least . Talagrand's convex distance inequality therefore gives the two-threshold concentration for certifiable functions,At an integer median , each median-side probability is at least . Taking thresholds or and using givesfor . Summing these tails gives . For sufficiently large , depending on , it follows thatApply this to and . Except with probability at most , .
A bad event at depends only on tentative colours at distance at most two. It is independent of the entire collection of bad events at distance greater than four. Its dependency graph of events consequently has maximum degree at most for large . The Lovász local lemma now makes all high-degree vertices good simultaneously: exponential decay beats this polynomial dependency bound.
The needed local-lemma step can be checked directly. If every bad-event probability is at most , induction on conditioning sets gives : split those events into non-neighbours of , independent of it, and at most neighbours, whose avoidance probability is at least by the induction. Multiplying the resulting conditional avoidance probabilities makes total avoidance positive. Taking works whenever , since . Our bound satisfies this criterion once .
Choose a successful partial colouring and set . This contains the original palette. High-degree vertices satisfyLow-degree vertices have after increasing if necessary. Greedy completion therefore gives . Finally, for ,The constants are deliberately conservative; existence of a fixed positive improvement is the point. The same proof uses an external maximum degree bound, so if infinite locally finite graphs are allowed, every finite subgraph has this uniform colouring bound and compactness extends the colouring to the whole graph.
For the stronger triangle-free result, the appropriate brief route is semi-random palette refinement for triangle-free colouring. Start with colours and repeatedly make small tentative random assignments, retain conflict-free choices, and update the uncoloured vertices' available lists. Triangle-freeness makes each graph neighbourhood independent. Track list size and average residual neighbour congestion per colour, prune unusually congested colours, and use concentration inequalities and the Lovász local lemma to preserve these invariants through the rounds. The ratio of residual congestion to list size decreases until a final completion using the Lovász local lemma or greedy coloring succeeds. Average control and pruning are important: four-cycles are allowed, so assuming tight uniform concentration for every individual colour load would be unjustified. With a sufficiently large absolute , this programme gives . The one-round fixed-fraction saving proved above alone does not establish that logarithmic improvement.
To show the order is best possible, let through integers and sample with . A Chernoff bound and union bound give maximum degree at most with probability tending to one. The expected triangle count is at most , so fewer than vertices need be deleted to remove all triangles with high probability. For , the expected number of independent -sets is at mostits logarithm is at most , which tends to minus infinity. The altered triangle-free graph thus has at least vertices and independence number below , giving for an absolute positive . Append a disjoint star graph whose centre has vertex degree if needed to make its maximum degree exactly . This proves the triangle-free chromatic lower bound at bounded maximum degree, , so the preceding order cannot be improved in general.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 12 2 ii Solution Created 2026-10-03 Updated 2026-10-14
Put , and define . The triangle inequality shows that is Lipschitz continuous with Lipschitz constant one. It vanishes on , and on . Let for a uniform permutation.
If , apply the lower-tail bound proved in part (i):If , apply its upper-tail bound:For the desired inequality is simply . Hence in all casesThis uses only the precise one-sided concentration inequality from part (i) and the Hamming distance triangle inequality. The normalization of the distance matters: it counts mismatching coordinates, rather than dividing their number by .
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 12 2 i Solution Created 2026-10-03 Updated 2026-10-14
Use the uniform probability measure on the symmetric group and the unnormalized Hamming distanceLet have Lipschitz constant for this distance. We will prove the one-sided concentration inequalitiesConsequently for . A zero Lipschitz constant makes constant, so that case is immediate.
Let be a uniform permutation, reveal successively, and define the Doob exposure martingaleFix the first images. For an available value , let be the conditional mean when . Given two available values , left-composition with the transposition exchanging is a bijection from completions with next image to completions with next image . It fixes the previously exposed images and changes exactly two coordinates of each complete permutation. Since conditional completions are uniform, averaging the Lipschitz condition over this pairing gives .
Thus, conditionally on the first images, has mean zero and takes values in an interval of length at most . We need the range-length version of the Hoeffding lemma: if a real random variable has mean zero and lies in an interval of length , thenHere is a proof. For , differentiation gives under the exponentially tilted probability distribution. Any distribution on an interval of length has variance at most , because its squared distance from the interval midpoint is at most . Since , integrating this second-derivative bound gives the lemma for both signs of . The same argument holds for every conditional distribution.
Apply it conditionally to each martingale difference and use the tower property of conditional expectation repeatedly:The exponential Markov bound now gives, for ,Choose to obtain the upper tail in the box, and apply the argument to for the lower tail. This proves concentration of Lipschitz functions on the symmetric group. Using only the bound in the absolute-increment Azuma-Hoeffding inequality would lose a factor four in the exponent; the conditional range length is what yields the constant needed in part (ii).
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 112 3 i Solution Created 2026-10-03 Updated 2026-10-06
The useful form is Talagrand's convex distance inequality. Let be standard probability spaces, let carry the product measure , and let be a measurable event with . For , form the mismatch vectorsThe Talagrand convex distance is the distance from zero to their closed convex hull:Equivalently, by the Hahn-Banach separation theorem for two convex sets,Nonnegative weights suffice because every mismatch vector has nonnegative coordinates. Talagrand's convex distance inequality statesIn particular, Markov's inequality gives the product-space concentration inequalityThe same conclusion is interpreted with outer probabilities if a distance set is not measurable; the continuous geometric function used below has measurable level sets. A median of a real random variable means that and . Applying the displayed concentration inequality to suitable level sets will control deviations around a median.
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 210 4 Solution Created 2026-10-03 Updated 2026-10-05
Let and . To prove the Hoeffding lemma, take a centered random variable and its cumulant-generating function . Under exponential tilting, is the variance of . The Popoviciu inequality on variances givessince under any such tilt the support remains , and . Because , integrating twice gives for ; applying the same argument to handles the opposite tail.
The independence of the gives . The Markov inequality, in the Chernoff bound argument, yieldswhere the minimum is at when . Apply the same argument to and add the bounds to obtain the Hoeffding inequality:If , every centered is identically zero and the tail probability is zero; the displayed exponential is interpreted by its zero-variance limit.
For the Bennett inequality, write , and first assume and . For , boundedness and centering giveFor , expanding the moment-generating function and using the permitted interchange of sum and expected value,Negative odd moments cause no difficulty because the estimate is an upper bound term by term. The independence of the and the Chernoff bound then giveThe derivative vanishes at , and substitution gives with the Bennett rate function . The same absolute bounds apply to , soIf , all centered are zero almost surely; if , the same is immediate. Handle those cases directly rather than divide by zero. Both derived concentration inequalities also hold with , by the same Markov inequality argument or by letting a smaller positive threshold increase to .
For the binomial distribution, write with independent and identically distributed random variables having the Bernoulli distribution with parameter . Then has range , width one, and variance . For large , , so and . Set .
The Hoeffding inequality givesAfter truncation at one, this is asymptotically the trivial probability bound. The Bennett inequality instead givesSince and by a Taylor expansion,Thus the Bennett bounds for sparse binomial fluctuations yieldThe Bennett inequality supplies the smaller raw exponential bound for every fixed and all sufficiently large . If , clipping probability upper bounds at one makes both eventually trivial; for , the Bennett inequality retains a nontrivial limiting bound. This distinction avoids claiming a probability improvement after clipping when both raw bounds exceed one.
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 324 2 a Solution 2026-09-28
Efficiently prepare the normalized amplitude encoding .
Apply quantum phase estimation to the simulated evolution , producing an approximation of each eigenvalue: Add one ancilla and perform an eigenvalue-controlled rotationwhere .
Uncompute the eigenvalue register. Conditional on measuring the ancilla as , the system register isThe postselection probability can be increased with amplitude amplification.
Apply quantum phase estimation to the simulated evolution , producing an approximation of each eigenvalue: Add one ancilla and perform an eigenvalue-controlled rotationwhere .
Uncompute the eigenvalue register. Conditional on measuring the ancilla as , the system register isThe postselection probability can be increased with amplitude amplification.
The ingredients used here are efficient sparse Hamiltonian simulation of and quantum phase estimation, which converts an eigenphase of that evolution into a binary approximation of . For sparsity , condition number , and error , the cost is polynomial in , , , and under the stated access assumptions.
Finally estimate by repeated measurement of an efficient observable decomposition of , or by a Hadamard test when is unitary. A general efficiently block-encoded Hermitian can similarly be measured through its block encoding. Repetition and a concentration inequality give additive sampling error after independent preparations.
Tail probability Created 2026-10-03 Updated 2026-10-14
For a real random variable , an upper-tail probability has the form and a lower-tail probability has the form . Each is the probability of an event lying beyond a chosen threshold in one direction. A tail probability need not be small: the threshold determines how much of the probability distribution it includes. A concentration inequality bounds such probabilities, often for deviations from an expected value.
Endpoint conventions matter. Write for the cumulative distribution function and . The complement rule of probability gives four distinct formulas:The strict upper-tail convention is the survival function . Its value differs from the inclusive upper tail probability by exactly the probability mass at the threshold:A singleton with positive probability mass is an atom of a measure. Thus excludes an atom of a measure at , whereas includes it. These endpoint identities follow directly from the cumulative distribution function properties in Kyle Siegrist, Distribution and Quantile Functions: endpoint probabilities and right tails.
As the threshold increases, both upper tail probabilities are nonincreasing functions. The strict survival function is a right-continuous function; the inclusive upper tail probability takes the upper endpoint value at a downward jump, equal to the left limit of the survival function. Both tend to zero as for a real random variable, but the speed of that decay differs across probability distributions. The cumulative distribution function properties and their proof from continuity of probability measures are given in MIT 6.436J, Lecture 4: random variables and cumulative distribution function properties.
For a fair six-sided die , the discrete uniform distribution assigns probability mass to each of . At threshold four,Between four and five, both upper tail probabilities equal . At the largest possible outcome the distinction is especially visible: , but . The diagram shows exact probabilities for this mathematical model; its dots specify which endpoints belong to each step function.
If a probability distribution has a probability density function , then every singleton has zero probability mass andFor an exponential distribution of rate two, for and zero otherwise, so for and for . Hence . This tail probability is an integral of the probability density function, not its height . A mixed probability distribution retains endpoint jumps even with a smooth component: give zero probability mass and choose this exponential distribution with probability . Then , , and for .
A two-sided tail probability can measure the absolute value of displacement from a specified center . For , the two extreme events are disjoint events, soFor strict displacement , replace the last expression by . The condition prevents overlap; at adding inclusive tails double-counts any probability mass at . For a uniform distribution on , take and : the two tail probabilities are each and their sum is . Equal tails follow from this symmetric probability distribution, not from the phrase two-sided alone; for a uniform distribution on with , the two tail probabilities are zero and .
The tail-sum formula for expectation turns a whole curve of tail probabilities into an expected value. For any nonnegative random variable , without assuming a probability density function or a finite expected value,For a proof outline, write pointwise and exchange the expected value and Lebesgue integral using Tonelli theorem; is an indicator function. The inclusive version has the same Lebesgue integral: positive probability masses occur at only a countable set of thresholds, which has Lebesgue measure zero. For a nonnegative integer-valued random variable , the tail-sum formula instead gives . The integer hypothesis is essential for these sums. The integral identity, its indicator function proof, and the integer version appear in Kyle Siegrist, Additional Properties of Expected Value: integration and summation of right tails.
For the fair die, this tail-sum formula yields , equal to the direct weighted arithmetic mean . For the rate-two exponential distribution, the area under the survival function is , its expected value. The first panel below shades an integral of the probability density function for a single threshold; the second shades an integral of the survival function across all nonnegative thresholds. These are analytical illustrations, with the displayed curves truncated at three; their exact total areas use an infinite integration range.
Nonnegativity is essential to interpreting the upper tail probability area as : for a general real random variable that area equals the expected value of its positive part. An integrable random variable satisfies , subtracting the expected value of its negative part; infinite terms cannot be canceled. Even when is finite almost surely, its expected value can be infinite. For the shape-one Pareto distribution on , on and for , so the area is . The finite versus infinite expected value distinction is illustrated in Kyle Siegrist, Definitions and Basic Properties: exponential and Pareto expected values.
Why are tail probabilities useful? They answer threshold questions directly, and a concentration inequality can bound them without knowing the full probability distribution. For nonnegative with finite expected value, Markov inequality gives for : a large threshold relative to the expected value forces rarity. The quantile function reverses the question by choosing a threshold for a prescribed cumulative level. If with , then ; an atom of a measure may prevent equality. For the die, , with strict upper tail probability zero and inclusive upper tail probability .
A tail probability describes rarity under a specified probability distribution; it is not automatically a conditional probability after extra information. For with ,because the threshold events are nested. Thus the die has but . Conditioning changes the sample space and renormalizes its probability measure; the same extreme outcomes can become common in that restricted population.

