Use the usual asymptotic convention: the output approaches the desired -copy pure target in trace distance, and any recorded failure probability tends to zero. Define the binary entropy
The entanglement entropies per source and target are and . The asymptotic pure-state entanglement conversion rate is
Both achievability and the upper bound matter here.
For entanglement concentration, expand sources in their correlated computational basis. Every pair of strings of Hamming weight has the same amplitude . Alice measures only this weight, without resolving the individual string. Bob's string has the same weight automatically. Conditional on , the normalized state is maximally entangled on correlated strings. Its outcome probability is , a binomial distribution. By the weak law of large numbers, in probability; Stirling's formula then gives . A uniform Schmidt vector on entries is majorized by a uniform vector on entries padded with zeros. Thus Nielsen's pure-state conversion theorem converts the conditional state into that many Bell pairs exactly. For any fixed , one obtains at least Bell pairs with probability tending to one.
For entanglement dilution, consider the Schmidt strings of targets with probabilities . The quantum typical subspace retains strings satisfying
The retained probability tends to one by the weak law applied to the independent variables . The number of retained strings is at most , because their probabilities sum to at most one. Normalize the target after truncation to those strings. Its squared overlap with the full target is . A uniform Schmidt vector of dimension , with , is majorized by the truncated target's Schmidt vector padded with zeros: the sum of its largest entries is at least . Hence Bell pairs prepare the truncated target exactly by LOCC. Its trace distance from the true target is . Combining concentration and dilution achieves any rate . Choosing margins tending sufficiently slowly to zero attains the ratio as a limiting rate.
For the converse, average monotonicity of pure-state entanglement entropy follows from Concavity of Von Neumann entropy: a measurement by one party leaves the other party's reduction unchanged on average, so its average conditional entropy cannot increase. Refine local measurement records, including local discarded systems, to obtain pure output branches on the output qubits of each party. Iterating the concavity argument gives
Let and let the squared-overlap error of the average output be . Define , the pure-state trace distance. Concavity of the square root gives . Partial trace cannot increase trace distance, so the reduced states are also within . The continuity bound for quantum conditional entropy, with trivial conditioning and local dimension , implies
Consequently
which excludes a limiting rate exceeding .
The vanishing-error convention is essential. If exact deterministic conversion were required for every finite block, majorization would also require the largest squared Schmidt coefficient to satisfy , hence
This can be strictly smaller than the entropy ratio: at , the two bounds are approximately and . Thus the boxed rate answers the standard asymptotic task, rather than imposing unmentioned exact zero-error conditions on every finite block.
Applying the optimal single-copy filter independently gives a random number of exact successful targets with binomial distribution
The weak law of large numbers gives in probability. In contrast, collective entanglement concentration and entanglement dilution yield asymptotically targets with vanishing output error. The improvement is strict, not just nonnegative. Differentiating binary entropy gives
Since , it follows that
This is collective advantage over independent two-qubit filtering. Independent filtering discards the entanglement in product-state failure branches; the collective reversible asymptotic procedure avoids that extensive loss. The separately filtered targets are exact conditional on success, whereas the collective statement uses the vanishing-error convention from the previous part. Here the counted outputs are target states ; that is also the notation in the original printed question.
A binary symmetric channel flips each transmitted bit independently with probability . A length- channel code specifies input words and a decoding rule; its rate is , and its error probability is the probability of a wrongly decoded message. The channel capacity is the supremum of asymptotically achievable rates with vanishing error. For , put , with . The Shannon second coding theorem here states
We prove achievability and the converse rather than using the formula as a substitute for a coding argument. Output complementation reduces to , so first assume .
Fix . Choose such that and . Independently choose uniformly random input words. Decode a received word to the unique codeword within Hamming distance , declaring error if there is none or more than one. The weak law of large numbers says the empirical fraction of independent Bernoulli- errors tends in probability to , so exceeding this distance has probability tending to zero.
For any independently chosen competing codeword, its probability of lying in this ball is , where
Indeed follows by bounding the probability of exactly successes in a binomial experiment with parameter by one, and increases on . A union bound therefore bounds the ensemble-average decoding error by
Some deterministic code is at least as good as this average. Expurgating the half of messages with greatest individual error makes the maximum message error at most twice the original average, and changes the rate by at most . This proves achievability even for maximum-error probability.
For the converse, take uniform messages and any deterministic code/decoder. The independent noise word has probability . Its normalized negative log-probability tends in probability to by the same law. Thus, outside an event of probability tending to zero, each noise word has probability at most . The decoder's disjoint decision regions contain at most received words in total. Hence
At rates bounded above capacity by a positive amount, choose smaller and obtain success probability tending to zero. This establishes the strong converse as well as the ordinary impossibility of reliable transmission above .
When the output is independent of the input, so success probability for uniform messages is at most and . At or the channel is noiseless or deterministically inverted; all words can be distinguished, so . These endpoints complete the theorem.
At an interior statistical parameter , local asymptotic normality means that there are random vectors and a symmetric nonnegative Fisher information matrix such that, for each fixed ,
A common stronger definition requires this expansion also for . The fixed- version suffices here. A regular identifiable model usually has positive definite Fisher information; nonsingularity is unnecessary for the contiguity conclusion.
Here are sufficient differentiability conditions for a proof by Taylor's theorem. Suppose the local probability density functions have common support, is twice continuously differentiable near , differentiation can pass through the normalization integral twice, the score function has finite second moment, and the local Hessian matrix is bounded in operator norm by an integrable envelope of a function class. These hypotheses imply
The first identity differentiates once; the second uses and differentiates twice. The central limit theorem gives . Taylor's integral remainder gives
The weak law of large numbers and the continuity and integrable-envelope hypotheses make the bracket converge in probability to . Indeed, the expectation of the supremum of the Hessian matrix difference over a shrinking neighborhood tends to zero by dominated convergence, and Markov inequality controls its empirical average. This proves local asymptotic normality and explains the role of both derivatives.
Write for contiguity of probability measures: for every measurable sequence , implies . Mutual contiguity requires this in both directions. A useful form of Le Cam's first lemma is the following: if the Radon-Nikodym derivative of the absolutely continuous part of relative to converges in distribution under to , with almost surely and , then the two sequences are mutually contiguous. This includes the usual case . The mean-one condition ensures uniform integrability of and vanishing mass of any singular part; positivity ensures the reverse implication.
Take and . Their likelihood ratio on the support of satisfies, by local asymptotic normality and the continuous mapping theorem,
This limit is positive and , including . The conditions of Le Cam's first lemma therefore hold, giving mutual contiguity of the product sampling laws. The products, rather than the one-observation laws, are the relevant sequences.
For any , let . Consistency under makes , and contiguity gives . Thus the estimator remains consistent for under each fixed local alternative. Since , it is also consistent for the moving parameter in the sense that in probability under .
Diagonalize the source average , using its positive eigenvalues. For fixed , let project onto product eigenvectors whose eigenvalues obey
The typical subspace theorem states that, for every and all sufficiently large ,
The probability statement is the weak law of large numbers applied to ; the dimension bounds follow by summing the typical eigenvalue bounds. This explains why the quantum typical subspace retains almost all probability using about qubits.
For choose . Measure . On success, encode the projected state isometrically into a space of dimension ; on failure, output a separate fixed flag. Decode the successful sector by the inverse isometry, and map the flag to a fixed state . The compressed dimension is at most , hence fits within rate for all sufficiently large . Both maps are trace-preserving quantum channels, not merely successful postselected operations.
Writing , the composite channel is
For a pure source signal , set . Its squared quantum fidelity after the composite channel is at least . Since the source is memoryless, its average state on uses is . Convexity of the square gives
The Kraus formula for entanglement fidelity gives the same lower bound for , because one Kraus operator is and the other terms are nonnegative. Taking proves reliable compression at every , in both average pure-signal fidelity and the stronger entanglement-fidelity sense. This is typical-subspace compression with a failure flag.
The expected check loss is finite because . It is also Lipschitz in its location argument, with constant at most one. For any fixed , the continuous distribution function makes . The derivative of with respect to , away from that null event, is . Difference quotients are bounded by one, so the dominated convergence theorem gives
The continuous, strictly increasing distribution function has limits zero and one. Its derivative expression changes sign exactly once, from negative to positive, and hence
Equivalently the difference between the expected losses at and is , positive whenever . This proves population quantiles minimize check loss directly.
For the regression argument, define the population risk and its empirical version . Boundedness of and integrability of the error give integrability of and of all these losses. Conditional on , the conditional distribution of the error has unique -quantile zero. Applying the preceding calculation conditionally shows that its expected loss is uniquely minimized when the fitted displacement equals zero. Thus
with strict inequality whenever that displacement is nonzero on an event of positive probability. The stated identifiability assumption therefore makes the unique population minimizer. This is conditional quantile identification.
The Lipschitz property of the check loss gives
Continuity of and its uniform bound, followed by dominated convergence, show that is continuous on .
For the intended estimator constrained to , here is the entire argmin consistency under uniform convergence in probability argument, rather than an invocation of an M-estimator theorem. For a fixed , let . If this set is empty, there is nothing to prove. Otherwise it is compact, and continuity and uniqueness give a strictly positive gap
Let . If minimizes , then
Consequently
The constrained estimator is consistent. Existence of a constrained minimum follows from continuity of the sample criterion and compactness. The argument applies to any measurable choice of minimizer.
There is an actual domain defect in the printed definition: its minimization is over all of , whereas the assumed uniform convergence in probability is only on . That literal unconstrained consistency claim is false. The preceding conclusion needs minimization over , or another assumption that confines the selected minimizers to a set where the convergence and separation arguments apply. No change of question heading is needed to make this qualification explicit.
Here is a counterexample satisfying even identifiability over the whole line. Take a constant covariate, independent standard normal errors, , , , and
This is bounded and continuous, has range , and vanishes only at zero. The conditional error distribution function is continuous and strictly increasing with median zero. The compact-set uniform law of large numbers also holds: the loss is , Lipschitz in , so a finite grid in reduces its uniform difference to finitely many integrable sample averages plus an arbitrarily small grid error. The weak law of large numbers then gives the asserted convergence.
Let be a sample median, and put . Absolute loss over the range is minimized at . Choose the following global empirical minimizer:
Solving the quadratic in shows , so this really minimizes the criterion over the whole line. For odd , symmetry and continuity give . Moreover in probability: for each fixed positive , the proportion of observations below converges to a number greater than one half, and the analogous proportion below converges to a number less than one half. Therefore
along odd . The selected unconstrained estimator is not consistent. This illustrates why a global argmin may escape a compact convergence set.
For a nonnegative random variable with finite expected value, and , Markov's inequality states . Indeed , and taking expected values proves the bound. For a random variable with mean and finite variance , apply Markov's inequality to at threshold . This proves Chebyshev's inequality:
For independent and identically distributed random variables with finite mean and variance , the sample mean has expected value and variance . Thus
This is the weak law: , with the finite-variance hypotheses used in this direct deduction.
The more general weak law of large numbers needs only . To obtain that version, truncate . For fixed the bounded variables obey the result just proved. Their means tend to , while Markov's inequality bounds the probability that the two sample means differ by more than by . First take and then ; the integrable tail vanishes, proving the full integrable i.i.d. version as well.
Finally assume and . For every , implies , so Markov's inequality gives
If , the derivative of the right-hand side is , so its minimum is at . The Cantelli inequality follows:
If , almost surely and the same bound is immediate. The bound is sharp: put mass at and the remaining mass at ; this has exactly the prescribed mean and variance.
Let . Since the alphabet is finite, these independent and identically distributed random variables are finite almost surely, have mean , and have finite variance . Also
The weak law of large numbers says that this average converges in probability to . Thus
One can also state the quantitative Chebyshev inequality bound . If , every word of positive probability is in the typical set. This is the finite-alphabet asymptotic equipartition property.
Use the weak notion of a typical set. For a word write . The definition is
A weakly typical sequence therefore has probability between and . Words containing zero-probability symbols are excluded. These two bounds and the weak law of large numbers provide the three conclusions below.
For fixed , the central limit theorem gives
The weak law of large numbers gives , so Slutsky theorem permits replacing in the standard error by . With , an approximate 95% confidence interval is
The lower endpoint may be truncated at zero because the parameter is nonnegative. This is a large-sample normal approximation for fixed positive ; an all-zero or very sparse sample does not justify the plug-in normal approximation. At the degenerate parameter value zero, every observation is zero almost surely.
The expectation is
For this polynomial to equal for every , comparison of its constant, linear, and quadratic coefficients gives
Thus the unique choice is
For fly , let be half its number of alleles. Then , the are independent and identically distributed,
and . The weak law of large numbers gives in probability. Hence the estimator is unbiased and consistent.
Take and start from the lower endpoint. The stationary distribution of this birth-death chain satisfies detailed balance with
so it is concentrated within of the upper endpoint . Before reaching that region the walk has drift . The weak law of large numbers and exponential concentration therefore imply that its hitting time of is
At time the chain is still macroscopically below the stationary region with probability tending to one, so its total-variation distance tends to one. Under the monotone coupling from part (b), by time the extremal copies have coalesced with probability tending to one, so the distance tends to zero. Therefore the family has
Use base-two logarithms. The weakly typical sequence definition is
Equivalently, . By the weak law of large numbers applied to the independent and identically distributed random variables , the probability of this typical set tends to one.
This captures the usual probability scale of a long sample, but it need not make every symbol frequency representative. For a fair binary source, every word has probability and , so even the all-zero word is weakly typical. The strongly typical sequence definition additionally controls empirical symbol frequencies and excludes this word for small tolerance. Thus weak typicality agrees with the high-probability-set intuition, while allowing individually unrepresentative members.
Memorylessness means that the ensemble's average density operator is . Its spectral decomposition is
The product eigenvalues give
Zero eigenvalues contribute zero to the Von Neumann entropy and are excluded from logarithmic typicality tests.
The quantum typical subspace is the span of eigenvectors whose eigenvalues satisfy
Its orthogonal projection selects precisely the classical typical set for the eigenvalue distribution . The typical-set cardinality bounds and the weak law of large numbers therefore give
for any fixed and all sufficiently large .
Retaining the estimator exactly as printed, define the probability limit
The empirical equations are linear in . Their coefficient matrix converges to
Therefore a sufficient condition, requiring neither parametric assumption, is
with finite moments sufficient for the weak law of large numbers. The empirical determinant then converges to a nonzero number, so the two linear equations have a unique solution with probability tending to one.
Fix and choose
Under , the weak law of large numbers makes the normalized log likelihood ratio converge in probability to , so . On this Neyman-Pearson decision region,
and hence
Letting proves the direct bound.
For any region with , let
The weak law of large numbers gives , so . Therefore
Thus ; let .
Stein's lemma states that for distinct probability mass functions on a finite alphabet, the best exponential decay rate of the Type II error among tests whose Type I error is eventually at most any fixed is
For the direct part, define the information-density typical region
The weak law of large numbers under gives , while
For the converse, let
Again . Any test with satisfies
On , , hence
Thus . Letting proves optimality.
Under , the Hilbert-space central limit theorem gives
where is a centered Gaussian random element with covariance . Distinct leading eigenvalues imply consistency of the empirical eigenvalues and eigenfunctions, up to irrelevant signs. The first standardized functional principal component scores of are independent variables, so Slutsky theorem yields
An asymptotic level- test rejects above the quantile of the chi-squared distribution.
Under a fixed alternative, put . The weak law of large numbers and eigenpair consistency give
Thus the statistic diverges and the test is consistent whenever at least one retained projection is nonzero. A fixed alternative orthogonal to the first eigenfunctions is invisible to this fixed- statistic.
Conditional on the covariates and all responses used to construct , the residual has conditional second moment at most ; conditional independence under the null is what permits this conditioning. Consequently
The Markov inequality proves
Next, the Cauchy-Schwarz inequality gives
The first factor converges to zero in probability. The weak law of large numbers and part a make the second , so the product converges to zero in probability.