Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 51 3 d Solution Created 2026-10-03 Updated 2026-10-14
Use the usual asymptotic convention: the output approaches the desired -copy pure target in trace distance, and any recorded failure probability tends to zero. Define the binary entropyThe entanglement entropies per source and target are and . The asymptotic pure-state entanglement conversion rate isBoth achievability and the upper bound matter here.
For entanglement concentration, expand sources in their correlated computational basis. Every pair of strings of Hamming weight has the same amplitude . Alice measures only this weight, without resolving the individual string. Bob's string has the same weight automatically. Conditional on , the normalized state is maximally entangled on correlated strings. Its outcome probability is , a binomial distribution. By the weak law of large numbers, in probability; Stirling's formula then gives . A uniform Schmidt vector on entries is majorized by a uniform vector on entries padded with zeros. Thus Nielsen's pure-state conversion theorem converts the conditional state into that many Bell pairs exactly. For any fixed , one obtains at least Bell pairs with probability tending to one.
For entanglement dilution, consider the Schmidt strings of targets with probabilities . The quantum typical subspace retains strings satisfyingThe retained probability tends to one by the weak law applied to the independent variables . The number of retained strings is at most , because their probabilities sum to at most one. Normalize the target after truncation to those strings. Its squared overlap with the full target is . A uniform Schmidt vector of dimension , with , is majorized by the truncated target's Schmidt vector padded with zeros: the sum of its largest entries is at least . Hence Bell pairs prepare the truncated target exactly by LOCC. Its trace distance from the true target is . Combining concentration and dilution achieves any rate . Choosing margins tending sufficiently slowly to zero attains the ratio as a limiting rate.
For the converse, average monotonicity of pure-state entanglement entropy follows from Concavity of Von Neumann entropy: a measurement by one party leaves the other party's reduction unchanged on average, so its average conditional entropy cannot increase. Refine local measurement records, including local discarded systems, to obtain pure output branches on the output qubits of each party. Iterating the concavity argument givesLet and let the squared-overlap error of the average output be . Define , the pure-state trace distance. Concavity of the square root gives . Partial trace cannot increase trace distance, so the reduced states are also within . The continuity bound for quantum conditional entropy, with trivial conditioning and local dimension , impliesConsequentlywhich excludes a limiting rate exceeding .
The vanishing-error convention is essential. If exact deterministic conversion were required for every finite block, majorization would also require the largest squared Schmidt coefficient to satisfy , henceThis can be strictly smaller than the entropy ratio: at , the two bounds are approximately and . Thus the boxed rate answers the standard asymptotic task, rather than imposing unmentioned exact zero-error conditions on every finite block.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 51 3 e Solution Created 2026-10-03 Updated 2026-10-14
Applying the optimal single-copy filter independently gives a random number of exact successful targets with binomial distributionThe weak law of large numbers gives in probability. In contrast, collective entanglement concentration and entanglement dilution yield asymptotically targets with vanishing output error. The improvement is strict, not just nonnegative. Differentiating binary entropy givesSince , it follows thatThis is collective advantage over independent two-qubit filtering. Independent filtering discards the entanglement in product-state failure branches; the collective reversible asymptotic procedure avoids that extensive loss. The separately filtered targets are exact conditional on success, whereas the collective statement uses the vanishing-error convention from the previous part. Here the counted outputs are target states ; that is also the notation in the original printed question.
Past exam of the mathematics course of the University of Cambridge 2010 ii Paper 1 12H Solution Created 2026-09-24 Updated 2026-10-14
A binary symmetric channel flips each transmitted bit independently with probability . A length- channel code specifies input words and a decoding rule; its rate is , and its error probability is the probability of a wrongly decoded message. The channel capacity is the supremum of asymptotically achievable rates with vanishing error. For , put , with . The Shannon second coding theorem here statesWe prove achievability and the converse rather than using the formula as a substitute for a coding argument. Output complementation reduces to , so first assume .
Fix . Choose such that and . Independently choose uniformly random input words. Decode a received word to the unique codeword within Hamming distance , declaring error if there is none or more than one. The weak law of large numbers says the empirical fraction of independent Bernoulli- errors tends in probability to , so exceeding this distance has probability tending to zero.
For any independently chosen competing codeword, its probability of lying in this ball is , whereIndeed follows by bounding the probability of exactly successes in a binomial experiment with parameter by one, and increases on . A union bound therefore bounds the ensemble-average decoding error bySome deterministic code is at least as good as this average. Expurgating the half of messages with greatest individual error makes the maximum message error at most twice the original average, and changes the rate by at most . This proves achievability even for maximum-error probability.
For the converse, take uniform messages and any deterministic code/decoder. The independent noise word has probability . Its normalized negative log-probability tends in probability to by the same law. Thus, outside an event of probability tending to zero, each noise word has probability at most . The decoder's disjoint decision regions contain at most received words in total. HenceAt rates bounded above capacity by a positive amount, choose smaller and obtain success probability tending to zero. This establishes the strong converse as well as the ordinary impossibility of reliable transmission above .
When the output is independent of the input, so success probability for uniform messages is at most and . At or the channel is noiseless or deterministically inverted; all words can be distinguished, so . These endpoints complete the theorem.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 39 2 Solution Created 2026-10-03 Updated 2026-10-07
At an interior statistical parameter , local asymptotic normality means that there are random vectors and a symmetric nonnegative Fisher information matrix such that, for each fixed ,A common stronger definition requires this expansion also for . The fixed- version suffices here. A regular identifiable model usually has positive definite Fisher information; nonsingularity is unnecessary for the contiguity conclusion.
Here are sufficient differentiability conditions for a proof by Taylor's theorem. Suppose the local probability density functions have common support, is twice continuously differentiable near , differentiation can pass through the normalization integral twice, the score function has finite second moment, and the local Hessian matrix is bounded in operator norm by an integrable envelope of a function class. These hypotheses implyThe first identity differentiates once; the second uses and differentiates twice. The central limit theorem gives . Taylor's integral remainder givesThe weak law of large numbers and the continuity and integrable-envelope hypotheses make the bracket converge in probability to . Indeed, the expectation of the supremum of the Hessian matrix difference over a shrinking neighborhood tends to zero by dominated convergence, and Markov inequality controls its empirical average. This proves local asymptotic normality and explains the role of both derivatives.
Write for contiguity of probability measures: for every measurable sequence , implies . Mutual contiguity requires this in both directions. A useful form of Le Cam's first lemma is the following: if the Radon-Nikodym derivative of the absolutely continuous part of relative to converges in distribution under to , with almost surely and , then the two sequences are mutually contiguous. This includes the usual case . The mean-one condition ensures uniform integrability of and vanishing mass of any singular part; positivity ensures the reverse implication.
Take and . Their likelihood ratio on the support of satisfies, by local asymptotic normality and the continuous mapping theorem,This limit is positive and , including . The conditions of Le Cam's first lemma therefore hold, giving mutual contiguity of the product sampling laws. The products, rather than the one-observation laws, are the relevant sequences.
For any , let . Consistency under makes , and contiguity gives . Thus the estimator remains consistent for under each fixed local alternative. Since , it is also consistent for the moving parameter in the sense that in probability under .
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 65 4 ii Solution Created 2026-10-03 Updated 2026-10-07
Diagonalize the source average , using its positive eigenvalues. For fixed , let project onto product eigenvectors whose eigenvalues obeyThe typical subspace theorem states that, for every and all sufficiently large ,The probability statement is the weak law of large numbers applied to ; the dimension bounds follow by summing the typical eigenvalue bounds. This explains why the quantum typical subspace retains almost all probability using about qubits.
For choose . Measure . On success, encode the projected state isometrically into a space of dimension ; on failure, output a separate fixed flag. Decode the successful sector by the inverse isometry, and map the flag to a fixed state . The compressed dimension is at most , hence fits within rate for all sufficiently large . Both maps are trace-preserving quantum channels, not merely successful postselected operations.
Writing , the composite channel isFor a pure source signal , set . Its squared quantum fidelity after the composite channel is at least . Since the source is memoryless, its average state on uses is . Convexity of the square givesThe Kraus formula for entanglement fidelity gives the same lower bound for , because one Kraus operator is and the other terms are nonnegative. Taking proves reliable compression at every , in both average pure-signal fidelity and the stronger entanglement-fidelity sense. This is typical-subspace compression with a failure flag.
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 31 1 Solution Created 2026-10-03 Updated 2026-10-07
The expected check loss is finite because . It is also Lipschitz in its location argument, with constant at most one. For any fixed , the continuous distribution function makes . The derivative of with respect to , away from that null event, is . Difference quotients are bounded by one, so the dominated convergence theorem givesThe continuous, strictly increasing distribution function has limits zero and one. Its derivative expression changes sign exactly once, from negative to positive, and henceEquivalently the difference between the expected losses at and is , positive whenever . This proves population quantiles minimize check loss directly.
For the regression argument, define the population risk and its empirical version . Boundedness of and integrability of the error give integrability of and of all these losses. Conditional on , the conditional distribution of the error has unique -quantile zero. Applying the preceding calculation conditionally shows that its expected loss is uniquely minimized when the fitted displacement equals zero. Thuswith strict inequality whenever that displacement is nonzero on an event of positive probability. The stated identifiability assumption therefore makes the unique population minimizer. This is conditional quantile identification.
The Lipschitz property of the check loss givesContinuity of and its uniform bound, followed by dominated convergence, show that is continuous on .
For the intended estimator constrained to , here is the entire argmin consistency under uniform convergence in probability argument, rather than an invocation of an M-estimator theorem. For a fixed , let . If this set is empty, there is nothing to prove. Otherwise it is compact, and continuity and uniqueness give a strictly positive gapLet . If minimizes , thenConsequentlyThe constrained estimator is consistent. Existence of a constrained minimum follows from continuity of the sample criterion and compactness. The argument applies to any measurable choice of minimizer.
There is an actual domain defect in the printed definition: its minimization is over all of , whereas the assumed uniform convergence in probability is only on . That literal unconstrained consistency claim is false. The preceding conclusion needs minimization over , or another assumption that confines the selected minimizers to a set where the convergence and separation arguments apply. No change of question heading is needed to make this qualification explicit.
Here is a counterexample satisfying even identifiability over the whole line. Take a constant covariate, independent standard normal errors, , , , andThis is bounded and continuous, has range , and vanishes only at zero. The conditional error distribution function is continuous and strictly increasing with median zero. The compact-set uniform law of large numbers also holds: the loss is , Lipschitz in , so a finite grid in reduces its uniform difference to finitely many integrable sample averages plus an arbitrarily small grid error. The weak law of large numbers then gives the asserted convergence.
Let be a sample median, and put . Absolute loss over the range is minimized at . Choose the following global empirical minimizer:Solving the quadratic in shows , so this really minimizes the criterion over the whole line. For odd , symmetry and continuity give . Moreover in probability: for each fixed positive , the proportion of observations below converges to a number greater than one half, and the analogous proportion below converges to a number less than one half. Thereforealong odd . The selected unconstrained estimator is not consistent. This illustrates why a global argmin may escape a compact convergence set.
Past exam of the mathematics course of the University of Cambridge 2015 ia Paper 2 11F Solution Created 2026-09-24 Updated 2026-10-06
For a nonnegative random variable with finite expected value, and , Markov's inequality states . Indeed , and taking expected values proves the bound. For a random variable with mean and finite variance , apply Markov's inequality to at threshold . This proves Chebyshev's inequality:For independent and identically distributed random variables with finite mean and variance , the sample mean has expected value and variance . ThusThis is the weak law: , with the finite-variance hypotheses used in this direct deduction.
The more general weak law of large numbers needs only . To obtain that version, truncate . For fixed the bounded variables obey the result just proved. Their means tend to , while Markov's inequality bounds the probability that the two sample means differ by more than by . First take and then ; the integrable tail vanishes, proving the full integrable i.i.d. version as well.
Finally assume and . For every , implies , so Markov's inequality givesIf , the derivative of the right-hand side is , so its minimum is at . The Cantelli inequality follows:If , almost surely and the same bound is immediate. The bound is sharp: put mass at and the remaining mass at ; this has exactly the prescribed mean and variance.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 66 4 ii a Solution Created 2026-10-03 Updated 2026-10-06
Let . Since the alphabet is finite, these independent and identically distributed random variables are finite almost surely, have mean , and have finite variance . AlsoThe weak law of large numbers says that this average converges in probability to . ThusOne can also state the quantitative Chebyshev inequality bound . If , every word of positive probability is in the typical set. This is the finite-alphabet asymptotic equipartition property.
Past exam of the mathematics course of the University of Cambridge 2015 iii Paper 66 4 ii Solution 2026-10-06
Use the weak notion of a typical set. For a word write . The definition isA weakly typical sequence therefore has probability between and . Words containing zero-probability symbols are excluded. These two bounds and the weak law of large numbers provide the three conclusions below.
Past exam of the mathematics course of the University of Cambridge 2016 ib Paper 3 20H b Solution Created 2026-09-24 Updated 2026-10-06
For fixed , the central limit theorem givesThe weak law of large numbers gives , so Slutsky theorem permits replacing in the standard error by . With , an approximate 95% confidence interval isThe lower endpoint may be truncated at zero because the parameter is nonnegative. This is a large-sample normal approximation for fixed positive ; an all-zero or very sparse sample does not justify the plug-in normal approximation. At the degenerate parameter value zero, every observation is zero almost surely.
Past exam of the mathematics course of the University of Cambridge 2018 ii Paper 1 29K b Solution Created 2026-09-24 Updated 2026-10-03
The expectation isFor this polynomial to equal for every , comparison of its constant, linear, and quadratic coefficients givesThus the unique choice is
For fly , let be half its number of alleles. Then , the are independent and identically distributed,and . The weak law of large numbers gives in probability. Hence the estimator is unbiased and consistent.
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 215 2 c Solution 2026-10-03
Take and start from the lower endpoint. The stationary distribution of this birth-death chain satisfies detailed balance withso it is concentrated within of the upper endpoint . Before reaching that region the walk has drift . The weak law of large numbers and exponential concentration therefore imply that its hitting time of isAt time the chain is still macroscopically below the stationary region with probability tending to one, so its total-variation distance tends to one. Under the monotone coupling from part (b), by time the extremal copies have coalesced with probability tending to one, so the distance tends to zero. Therefore the family has
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 323 2 i a Solution Created 2026-10-03 Updated 2026-10-05
Use base-two logarithms. The weakly typical sequence definition isEquivalently, . By the weak law of large numbers applied to the independent and identically distributed random variables , the probability of this typical set tends to one.
This captures the usual probability scale of a long sample, but it need not make every symbol frequency representative. For a fair binary source, every word has probability and , so even the all-zero word is weakly typical. The strongly typical sequence definition additionally controls empirical symbol frequencies and excludes this word for small tolerance. Thus weak typicality agrees with the high-probability-set intuition, while allowing individually unrepresentative members.
Past exam of the mathematics course of the University of Cambridge 2019 iii Paper 323 2 ii a Solution Created 2026-10-03 Updated 2026-10-05
Memorylessness means that the ensemble's average density operator is . Its spectral decomposition isThe product eigenvalues giveZero eigenvalues contribute zero to the Von Neumann entropy and are excluded from logarithmic typicality tests.
The quantum typical subspace is the span of eigenvectors whose eigenvalues satisfyIts orthogonal projection selects precisely the classical typical set for the eigenvalue distribution . The typical-set cardinality bounds and the weak law of large numbers therefore givefor any fixed and all sufficiently large .
Past exam of the mathematics course of the University of Cambridge 2021 iii Paper 221 2 b Solution 2026-09-28
Retaining the estimator exactly as printed, define the probability limitThe empirical equations are linear in . Their coefficient matrix converges toTherefore a sufficient condition, requiring neither parametric assumption, iswith finite moments sufficient for the weak law of large numbers. The empirical determinant then converges to a nonzero number, so the two linear equations have a unique solution with probability tending to one.
Past exam of the mathematics course of the University of Cambridge 2021 iii Paper 224 1 c Solution 2026-09-28
Fix and chooseUnder , the weak law of large numbers makes the normalized log likelihood ratio converge in probability to , so . On this Neyman-Pearson decision region,and henceLetting proves the direct bound.
Past exam of the mathematics course of the University of Cambridge 2021 iii Paper 224 1 d Solution Created 2026-09-28 Updated 2026-10-03
Past exam of the mathematics course of the University of Cambridge 2022 iii Paper 224 1 a Solution Created 2026-09-28 Updated 2026-10-03
Stein's lemma states that for distinct probability mass functions on a finite alphabet, the best exponential decay rate of the Type II error among tests whose Type I error is eventually at most any fixed is
For the direct part, define the information-density typical regionThe weak law of large numbers under gives , while
Past exam of the mathematics course of the University of Cambridge 2022 iii Paper 225 2 a Solution Created 2026-09-28 Updated 2026-10-03
Under , the Hilbert-space central limit theorem giveswhere is a centered Gaussian random element with covariance . Distinct leading eigenvalues imply consistency of the empirical eigenvalues and eigenfunctions, up to irrelevant signs. The first standardized functional principal component scores of are independent variables, so Slutsky theorem yieldsAn asymptotic level- test rejects above the quantile of the chi-squared distribution.
Under a fixed alternative, put . The weak law of large numbers and eigenpair consistency giveThus the statistic diverges and the test is consistent whenever at least one retained projection is nonzero. A fixed alternative orthogonal to the first eigenfunctions is invisible to this fixed- statistic.
Past exam of the mathematics course of the University of Cambridge 2023 iii Paper 205 3 b Solution 2026-09-28
Conditional on the covariates and all responses used to construct , the residual has conditional second moment at most ; conditional independence under the null is what permits this conditioning. ConsequentlyThe Markov inequality proves
Next, the Cauchy-Schwarz inequality givesThe first factor converges to zero in probability. The weak law of large numbers and part a make the second , so the product converges to zero in probability.