For , expand the expectation under the weighted matching Markov chain stationary weights to obtain the displayed identity. If the largest matching in a graph has edges and , the observable lies in . Its sample mean has controlled error by the Hoeffding inequality. A product of ratios, each estimated to relative accuracy , approximates the full ratio to relative accuracy .
For a binomial distribution with and , the Bennett inequality at standard deviations tends to , whereas the Hoeffding inequality tends to two. The raw Bennett inequality bound is eventually smaller for any fixed ; after clipping at one it is nontrivial in the limit only when .
BQP error reduction 2026-10-06
Independent runs of a BQP algorithm with fresh ancilla qubits can be combined by a classical threshold rule. If completeness exceeds soundness by , a Hoeffding inequality bounds the error after runs by . Polynomial repetition handles inverse-polynomial gaps. This does not automatically preserve the restricted gate and measurement rules of a stoquastic circuit.
For a fixed positive sample size of independent and identically distributed Bernoulli random variables, let
The Hoeffding inequality makes a conservative confidence interval for : for every . Indeed, exclusion from the closed interval implies , an event contained in the deviation event bounded by . Clipping to retains coverage because already lies there. For , , and an observed frequency , , giving approximately .
Coverage concerns repeated independent samples: the unknown is fixed and the confidence interval is random. This fixed- guarantee does not justify repeatedly checking the same bound and stopping as soon as it looks favorable. The Hoeffding sample size for Bernoulli frequencies chooses in advance; guarantees across repeated inspection times require separate control of the additional events, for example through a union bound with an allocated failure probability at each time.
Hoeffding inequality Created 2026-09-24 Updated 2026-10-14
The Hoeffding inequality turns finite interval bounds and independence into exponentially small tail probabilities for a sum. It requires neither a normal distribution nor identical probability distributions. Let be independent essentially bounded real random variables, with deterministic finite bounds almost surely. Define the centered sum and its squared-width budget by
For and ,
The union bound therefore gives . If , every is constant almost surely, so and both positive-threshold tail probabilities vanish. The equal-width version is stated in the authored Stanford notes.[ref]
The quantity is a sum of squared interval widths, not the variance of . Centering changes the endpoints to and , leaving each width unchanged. For example, independent random variables in and have , whatever their expected values or probability distributions. A deviation at least three above their total expected value has probability at most . If all widths equal , the sample mean satisfies
Independence is essential to this general guarantee. Take one Bernoulli random variable with success probability and set every . Each lies in , but for every the sample mean is either zero or one. Thus , whereas incorrectly inserting these dependent observations into the formula would give , less than one for . Some special dependent models have their own valid concentration inequalities; arbitrary statistical dependence cannot be ignored.
For the short proof, apply Markov's inequality to with , factor the expectation using independence, and apply the Hoeffding lemma to each factor:
Minimizing this quadratic polynomial at gives the upper tail probability; applying it to gives the lower one. This is the Chernoff bound method. The original 1963 article is Probability Inequalities for Sums of Bounded Random Variables by Wassily Hoeffding; its publisher record identifies the article, but its full text was unavailable during this source check. The argument above is a direct derivation rather than a claim to have inspected that article's proof.
Hoeffding lemma Created 2026-09-24 Updated 2026-10-14
The Hoeffding lemma controls the entire centered moment-generating function using only an interval width. For an essentially bounded real random variable with finite deterministic bounds almost surely, every real satisfies
Equivalently, . This single-random variable statement needs no independence assumption; independence enters when applying it to the factors for a sum in the Hoeffding inequality. Both signs of are allowed, and equality holds at or when .[ref]
In the convention for a centered sub-Gaussian random variable , the Hoeffding lemma supplies . This upper parameter need not equal the actual variance. For a Bernoulli random variable of success probability ,
The actual variance is , whereas the supplied parameter is for every . This explains part of the conservatism visible in Hoeffding sample size for Bernoulli frequencies.
Figure 1.
Exponential tilting changes the weights but preserves the bounded interval
. The original three-point model has with probabilities and mean zero. Left: tilted masses proportional to for stay within . Right: its cumulant-generating function stays below the Hoeffding lemma bound . Its tilted variance is , smaller than the general width-only ceiling four. Details.
A short proof exposes why the constant is . Put and define exponential tilting by
The tilted probability measure has the same interval of possible values, and differentiating the cumulant-generating function gives . Boundedness justifies these derivatives for every finite . Under any such tilted law, Popoviciu's inequality on variances gives : the variance is no larger than the expected value of the squared distance from the interval midpoint, itself at most . Since , the integral form of Taylor's theorem yields
This expression handles either sign of without changing the argument.
The constant cannot be reduced uniformly over all essentially bounded real random variables. Equal endpoint probabilities at and give , a scaled Rademacher random variable, and
Thus the sharpness is already forced near zero by the variance; the bound need not be equality at nonzero parameters for a particular probability distribution.
Hoeffding lower-tail bound for Hamming balls Created 2026-10-06 Updated 2026-10-14
For a uniform vertex of the Hamming cube, distance from a fixed vertex is the sum of independent Bernoulli random variables with parameter . The lower-tail Hoeffding inequality implies that the fraction of vertices at distance at most , , is at most . Strict-radius balls satisfy the same upper bound.
Let be independent and identically distributed Bernoulli random variables with success probability , and let be their observed frequency, a sample mean. Since every interval width is one, . Substituting into the Hoeffding inequality gives
For tolerance and failure probability , solving yields the sufficient sample size
Here is the natural logarithm. For and , guarantees an error smaller than with probability at least , for every . The two-sided bound at this sample size is approximately . A specified single direction instead needs , or for these choices. Halving the tolerance multiplies the unrounded sufficient sample size by four; reducing the failure probability tenfold adds before rounding.
This is a conservative sufficient sample size, not a necessary minimum. For a specified , the count has a binomial distribution, whose exact upper tail probability is
For , the Hoeffding inequality bounds this by . An arbitrary frequency threshold uses ; if , the event is impossible. The discreteness of the count and its variance can make the exact tail probability substantially smaller. At , , , the exact upper tail probability is about , while the bound is . At , , the same deviation gives the same bound but an exact upper tail probability about .
Figure 1.
Exact binomial distribution tails compared with the Hoeffding inequality
. Two original specified models, each with independent Bernoulli trials. Each dot includes its integer threshold , with horizontal coordinate . Exact finite sums are evaluated with rational arithmetic before conversion for plotting. The Hoeffding inequality uses the width one in both panels; it does not use the smaller variance at . These are model probabilities, not measured frequencies. Details.
Let be the transition matrix of a finite irreducible Markov chain with at least two states, reversible with stationary distribution . Its Dirichlet form of a Markov chain is
The Discrete Poincare inequality states that for every real . Its optimal constant is , where is the second largest eigenvalue of . Indeed, detailed balance makes self-adjoint on . Expand in an orthonormal eigenbasis. Then and , proving the inequality and its sharpness.
The useful constructive version is the canonical paths Poincare bound. Choose transition graph paths between each ordered pair, write , and define
where counts occurrences of the directed transition. The Cauchy-Schwarz inequality along each path in a graph gives . Multiply by and sum. The identity proves .
For a lazy Markov chain this also proves the mixing time estimate
To see this, the centred initial density has norm at most ; laziness puts all nonconstant eigenvalues between zero and . Their powers contract that norm, and the Cauchy-Schwarz inequality bounds total variation distance by half the density's norm.
Here is a precise sufficient density condition for the permanent application: every row and every column has more than ones. Interpret the permanent of a matrix as the number of perfect matchings in its bipartite graph, with vertices per side. Write for the number of -edge matchings in a graph.
First prove the short augmenting paths in a dense bipartite graph bound. Given a nonperfect matching in a graph, choose unmatched on opposite sides. If either has an unmatched neighbour, augment with one edge. Otherwise the matched partners of and the neighbours are subsets of the same -element side whose total size exceeds . Their intersection gives an alternating path in a graph of length three, with a matching edge. Repeating proves . Choose augmentations by a fixed deterministic rule. A reverse augmentation is specified by at most four vertices, so a next-size matching in a graph has at most preimages. Therefore
Use the matching generating function and the weighted matching Markov chain on all matchings in a graph, with stationary weights . It stays put with probability ; otherwise it chooses a graph edge uniformly and proposes its deletion, its addition if both endpoints are unmatched, or its exchange for the unique incident matching edge if precisely one endpoint is matched. Other proposals stay put. Accept with probability . Reverse proposals use the opposite exchanged edge, so detailed balance holds. Deletions connect every state to the empty matching in a graph.
For completeness, the canonical paths for the weighted matching chain give a polynomial bound without assuming a mixing theorem. The symmetric difference consists of alternating graph paths and graph cycles. Order its components deterministically, orient open components from their smaller endpoint, and convert them from to by moving an unmatched endpoint with exchanges. If the first edge belongs to , delete it first. For a graph cycle, delete one -edge, move the unmatched endpoint around the opened cycle, then insert the last -edge. Each intermediate state is a matching in a graph, and each entire transition path in a graph has length at most .
Fix a directed transition with initial state . The complementary edge set agrees with one of the two matchings in a graph outside the active component and has at most two degree-two vertices on that component. Remove at most two offending edges to obtain a matching in a graph . Store those edges and one bit specifying the initial alternating colour of the active component. This encoding is injective for the fixed transition: it restores and , identifies the active component from the changed edges, and recovers the two colours using the fixed component order. Completed components have 's colour in , pending components have 's colour, and the stored bit resolves the active component. Common edges are .
There are at most auxiliary records per , where is the number of graph edges. If , then
Also . Sum over the encodings and use the path length bound to obtain
This is polynomial whenever and are polynomially bounded. Starting at the empty matching in a graph, , so the Discrete Poincare inequality gives polynomial-time sampling to any prescribed total variation distance. The addition/deletion/exchange construction is also described in Section 12.4 of Jerrum and Sinclair's survey.
It remains to turn sampling into a relative count; merely sampling perfect matchings would not do that. For , choose and . The elementary bounds above give
Choose a schedule whose successive ratios are at most . It has stages. The annealing ratios for a matching generating function satisfy
Each observable lies in , so the Hoeffding inequality gives relative accuracy with independent samples per stage. Run independent copies of the chain from the empty matching in a graph; make the total variation distance per sample at most , where is that sample count. The coupling characterization of total variation distance and the union bound make the entire sample collection coincide with exact stationary samples except with probability at most . Choose the sample-count constant so all stationary sample means are accurate except with probability at most .
Let be the product of the sample means, and output . On the successful event its multiplicative error relative to lies between and . Combining the two endpoint bounds proves
Activities, sample counts, simulation lengths and rational bit lengths are polynomial in . Thus this is a fully polynomial randomized approximation scheme. Small dimensions can be evaluated directly.
Identify the hypercube graph with , joining two sets when their symmetric difference has size one. Write for the closed graph neighbourhood of , and for its radius- neighbourhood in Hamming distance. In the simplicial order on the discrete cube, smaller sets come first, with lexicographic order within each rank: the smallest differing coordinate belongs to the earlier set. Let be the first vertices in this order. Harper theorem is
Equivalently, minimizes the external vertex boundary at fixed size. We will also obtain for every integer .
Here is a complete proof by simplicial section compression. First note two properties of the simplicial order on the discrete cube. Its restriction to either face obtained by fixing one coordinate is the corresponding order on the smaller hypercube graph. Also, the closed graph neighbourhood of an initial segment is an initial segment. To verify the latter, a nonempty initial segment contains every level below its last level , and a lexicographic prefix at level . For , its closed graph neighbourhood contains every set of size at most , and its only further members are the upper shadow of . An -set lies in this upper shadow exactly when its lexicographically earliest -subset lies in . That earliest subset is obtained by deleting the largest element. These earliest subsets vary monotonically in lexicographic order, so the upper shadow is another lexicographic prefix. For , the closed graph neighbourhood of is the union of levels zero and one. The empty initial segment causes no exception.
Induct on , with immediate. Fix a coordinate and write the sections of as , deleting from the latter section. Replace them by the initial segments with , . The sections of the old closed graph neighbourhood are
By induction their sizes are at least and , respectively. These are exactly the sizes of the new sections, because both sets in each new union are initial segments and hence nested. Thus simplicial section compression preserves size and never enlarges the closed graph neighbourhood.
Repeatedly compress any section that is not already an initial segment. Every change strictly reduces the sum of the global simplicial positions of the included vertices. This nonnegative integer decreases only finitely often, so the process ends at a family whose sections in every coordinate are initial segments. If itself is an initial segment, the induction is complete. Otherwise choose the earliest absent vertex and the latest present vertex , with . They cannot agree in any coordinate: agreement would put them in one compressed section, where an earlier absent vertex cannot precede a later present one. Hence . Nor can a vertex lie between them: if is present, pairing it with would force ; if absent, pairing it with would force . Thus are consecutive, and is obtained from by replacing its last vertex with the next vertex .
There are only two possibilities for these terminal families for simplicial section compression. If , consecutiveness makes the last -set and the first -set. Complementarity forces , and . For , the corresponding contains all sets of size at most except , and additionally . Every -set has at least two -subsets, so at least one belongs to . The missing has a -subset in . Consequently contains every set of size at most , which is exactly .
If , then . Since are complementary, the smaller one contains coordinate . Consecutiveness forces to be the last -set containing , and the first -set avoiding :
The initial segment consists of all sets of size less than and all -sets containing . Its closed graph neighbourhood contains all sets of size at most and all -sets containing . For , each such -set has -subsets containing , so removing only leaves one in . All sets of size at most are still in , because all levels below belong to . Hence again . For , the two families are related by exchanging coordinates and both have the whole as their closed graph neighbourhood. These comparisons finish the induction and prove Harper theorem.
For the radius- version, repeatedly use the one-step result. At each step the comparison family remains an initial segment, and its closed graph neighbourhood is monotone in its size. If , applying Harper theorem to therefore gives . Induction on proves the asserted extension.
A Lévy family of graphs has vanishing concentration of measure functions after distances have been scaled by the graph diameter. More explicitly, for connected finite graphs of diameter , use normalized graph distance and uniform probability measure. For every fixed , require
For this normalization is normalized Hamming distance , since its diameter is .
If , the corresponding initial segment contains the Hamming ball about of radius . The radius- version of Harper theorem implies
Use the precise Hoeffding inequality for . One can also derive this estimate directly: the moment-generating function of is ; the exponential Markov inequality followed by minimization at gives the bound. With , we have . Thus, whenever ,
This proves that the hypercube graphs form a Lévy family of graphs. The stronger fixed-positive-mass formulation follows as well. For any , choose with . The Chebyshev inequality for , whose variance is , makes the Hamming ball of radius have fewer than vertices. An initial segment of size at least contains that ball. Enlarging by and using the same Hoeffding inequality gives a complement proportion tending to zero uniformly over all such . The normalization matters: with unscaled unit Hamming distance, cubes do not satisfy the metric version at every fixed radius; for a radius below one, a half-cube has no enlargement.
Equality in Harper theorem does not determine a down-set up to isomorphism. In , take
This is a down-set of size nine. Its closed graph neighbourhood contains every set of size at most two, because all singletons belong to . Every triple contains an edge of the four-cycle among the listed pairs, so every triple also belongs to . The four-element set does not. Hence .
The size-nine simplicial order on the discrete cube initial segment is all sets of size at most one together with the pairs . Every triple contains one of these pairs, and the four-element set is again absent from its closed graph neighbourhood. Its neighbourhood therefore also has size , proving extremality of . Nevertheless the induced graphs are not isomorphic: in , the empty set has degree four, the four singletons have degree three, and the four pairs have degree two. The initial segment has two vertices of degree four, namely and . Since a graph automorphism preserves induced degree of a vertex, no automorphism of the cube can carry one family to the other. This gives nonunique down-set extremizers for Harper theorem even under the stronger test of induced graph isomorphism.
BQP consists of promise problems decided by a uniform family of polynomial-size quantum circuits. On input , with polynomially many zero-initialized ancilla qubits, a designated output measurement accepts with probability at least on YES inputs and at most on NO inputs. Uniformity means a classical polynomial-time procedure produces the quantum circuit description from the input length, or equivalently produces the verifier quantum circuit with supplied as input.
For BQP error reduction, run independent copies with freshly initialized registers. If the completeness and soundness thresholds are any constants , accept when the fraction of accepting trials exceeds . A Hoeffding inequality bounds either error by , with repetitions. The threshold need not be a simple majority when both and lie on the same side of .
Choosing sufficiently large gives the usual thresholds, or any other fixed separated thresholds. Even an inverse-polynomial gap can be amplified using polynomially many repetitions. Classical threshold evaluation can be incorporated into the uniform computation. Thus fixed separated acceptance probabilities define the same BQP class. This argument concerns unrestricted BQP quantum circuits and does not assume such amplification is available for restricted stoquastic circuits.
The Hoeffding inequality states that if are independent random variables with almost surely, then for
The same bound holds for the lower tail. Consequently the two-sided tail is at most twice this bound. When all ranges have length zero, the sum is deterministic and every positive tail probability is zero.
We construct an exponential packing of a Hamming cube. Choose an inclusion-maximal separated set in with separation at least for the Hamming distance. It exists by a finite greedy procedure: keep adding any vertex at distance at least from all selected vertices until none remains. By maximality, every vertex is within distance strictly less than of some member of . This is the principle that maximal separated sets give covers.
For a uniformly random vertex and any fixed vertex , the mismatch indicators in different coordinates are independent Bernoulli random variables with success probability . Hence has the binomial distribution with parameters . The lower-tail Hoeffding inequality gives
Thus the Hoeffding lower-tail bound for Hamming balls shows that every strict-radius ball has at most vertices. Using a strict ball handles noninteger without changing the required separation.
The strict balls centered at cover the entire Hamming cube. Counting their union by the sum of their sizes yields
Therefore
In particular this proves the assertion for every . Maximality here means that no further vertex can be added; finding a largest separated set is unnecessary.
Use an -qubit state as the witness. Uniformly choose a term and perform the two-outcome positive operator-valued measure . Regard the second outcome as an energy flag. For witness , its probability is
This is an efficient local-energy measurement verification: a unitary operator on the relevant qubits and one ancilla qubit can implement the measurement using the isometry
The local dimension is constant; the term matrices and the measurement can be approximated to inverse-polynomial accuracy. Uniform choice of and the classical threshold comparison also have polynomial overhead.
Set
In the nontrivial case , is inverse-polynomial. Cases outside this energy range are decided directly from .
Ask for witness registers, measure an independently sampled local term on each, and accept if the mean number of energy flags is at most . An honest product ground state on a YES instance has flag probability at most . The Hoeffding inequality gives failure at most . For completeness, the required Bernoulli concentration estimate follows by bounding the centered log moment-generating function : and is a tilted Bernoulli variance, at most . Hence ; exponential Markov's inequality optimized at yields , and the lower-tail version follows in the same way.
Soundness must also cover entangled witness registers. The averaged flag effect is . All its eigenvalues are at least on a NO instance. The repeated verifier's acceptance effect is a polynomial in the commuting tensor-factor operators and . In their product eigenbasis its eigenvalues are lower-tail probabilities of independent Bernoulli variables whose parameters are each at least . Their lower tail is bounded by the identical-parameter tail at , using the same uniform-variable coupling as in QMA parallel repetition with entangled witnesses. Therefore its operator norm is at most , which bounds acceptance for any entangled witness.
Choosing
gives completeness at least and soundness at most . A slightly larger constant absorbs implementation errors; for example, approximate each flag effect in norm to at most , retain a gap at least , and increase by a constant factor. The total witness length and circuit size are polynomial. Thus
Let and . The Lipschitz continuity of cosine and the Cauchy-Schwarz inequality imply
The centered expectation term contributes ; omitting it would leave the Lipschitz bound incomplete. In particular has continuous sample paths on the compact cube, so its maximum exists and is measurable.
Put
Choose a Cartesian finite net whose coordinate spacings are at most , including the endpoints. Every point of the cube is within Euclidean norm distance of , and
On the event , replacing any by a nearby grid point changes by at most . Since and , this is less than . Therefore
The Markov inequality bounds the first event by . At a fixed , the summands are centered, independent and identically distributed, and have absolute value at most . The supplied Hoeffding inequality, with , bounds each grid event by
A union bound now gives
The choice of balances the cost of a large random Lipschitz constant against the covering number of the cube: . Consequently works, with
This uses only the first moment and has a constant independent of . The finite net is deterministic even though the Lipschitz constant is random.
Put and . Use the scan statistic and the statistical hypothesis testing rule
The union bound and the Hoeffding inequality give , since . Conditional on index , accepting the null hypothesis implies . The assumed separation gives , so this threshold lies more than below the alternative expected value . The lower-tail Hoeffding inequality therefore gives . Averaging the conditional error over the mixture model gives as well.