Entropy of a classical-quantum state 2026-10-14
The classical-quantum state is block diagonal. If are the eigenvalues of , its eigenvalues are . Inserting these into the definition of Von Neumann entropy gives the displayed sum of classical Shannon entropy and mean conditional quantum entropy. Its quantum mutual information is therefore the Holevo quantity .
Holevo capacity Created 2026-10-05 Updated 2026-10-07
The Holevo capacity of a quantum channel is the maximum one-use output Holevo quantity,It is the unassisted classical communication limit for product state encodings with collective output measurements. Arbitrary entangled inputs require the regularized expression in the Holevo-Schumacher-Westmoreland theorem.
Every entanglement-breaking channel has additive Holevo capacity with every finite-dimensional quantum channel . A measure-and-prepare channel factorization exposes a classical measurement outcome. The quantum mutual information balance identity and data processing for quantum mutual information then bound the joint output Holevo quantity by the sum of the individual capacities, using the conditional input ensemble after a local measurement for the other channel. Independent product ensembles attain the reverse inequality.
Holevo quantity under a quantum channel 2026-10-07
Attach an orthogonal classical label register to an ensemble. Its quantum mutual information with the quantum system equals the ensemble Holevo quantity. A local quantum channel changes the ensemble states but preserves their labels and probabilities. Data processing for quantum mutual information then proves that the output Holevo quantity cannot exceed the input value.
Holevo's theorem 2026-10-14
The classical mutual information obtained by any measurement of a quantum ensemble is at most its Holevo quantity. This follows from the data-processing inequality for quantum relative entropy applied to the measurement channel.
One-shot classical-quantum coding converse Created 2026-10-06 Updated 2026-10-14
For equiprobable quantum code states with average decoding error , data-processing inequality for quantum relative entropy applied to the binary test for quantum decoding success givesfor . Here is binary entropy. The case is trivial. Taking the supremum over allowed input distributions yields a code-size bound in terms of the largest Holevo quantity; at the undivided inequality is vacuous.
Past exam of the mathematics course of the University of Cambridge 2004 iii Paper 32 5 Solution Created 2026-10-03 Updated 2026-10-14
The Schumacher compression theorem concerns a memoryless quantum information source with average density matrix on a finite-dimensional Hilbert space. For uses the average state is . Compression consists of an encoding quantum channel into a space of dimension and a decoding channel back to the original block space, with asymptotic rate qubits per source use. The optimal reliable rate is : every larger rate is achievable, and no smaller rate is reliable. This holds for average pure-source fidelity; the direct construction also preserves a purification reference, and the converse for that stronger entanglement fidelity criterion holds with fidelity tending to zero below the threshold. The encoding and decoding are deterministic channels; no free classical transmission of the source label is allowed.
Diagonalize and omit zero-probability eigenvalues when sampling. Define the quantum typical subspace projector by retaining product eigenvectors withThe sampled random variable has expectation . The weak law of large numbers gives . Every retained eigenvalue is at least , and the total probability is at most one, soThis proves the two typical subspace theorem estimates used in the direct part.
Write . Encode its range isometrically into a compressed space and reserve one orthogonal failure flag. Decode the range back isometrically and the failure flag to a fixed pure state . This typical-subspace compression with a failure flag is a physical channel whose composite action isIndeed its Kraus operators are and , where the form an orthonormal basis of , and their adjoint products sum to . The Kraus formula for entanglement fidelity givesFor any pure-state ensemble of , the average squared quantum fidelity is at least this number: apply convexity of separately to the amplitudes with their source probabilities. Thus average fidelity also tends to one. The compressed dimension is at most , and its rate is at most . Choose for any prescribed . One may also take : the finite spectral information variance and Chebyshev's inequality still give , with rate tending to . A pure source, , can simply be re-prepared exactly without sending any qubits.
For the coherent converse, we prove the finite-dimensional quantum compression converse. If the compressed space has dimension , the state of reference plus compressed system has a pure-state decomposition with Schmidt rank at most . Applying decoder Kraus operators locally cannot increase the Schmidt rank of those vectors, so the final reference–output state has Schmidt number at most . Let purify the source, with squared Schmidt coefficients equal to the decreasing eigenvalues of . For any normalized vector of Schmidt rank at most , its reference support lies in a rank-at-most- projector . HenceThe last bound follows by maximizing subject to and their sum at most . Average over a Schmidt-rank-bounded decomposition of the final state to obtain .
At rate , choose . The total source probability outside the quantum typical subspace tends to zero, while every eigenvalue inside it is at most . Therefore for ,This argument allows arbitrary encoding and decoding channels, not only subspace projection.
For completeness, average pure-source reliability also forces the same rate, even though it is a weaker criterion than entanglement fidelity. Here is a separate converse for that formulation. Let the emitted block pure states be , with probabilities , and let be the decoded states. If their mean squared fidelity tends to one, then their mean trace distance tends to zero, since . This inequality follows by choosing a purification with that overlap and using contraction of trace distance under a partial trace.
We need only an elementary entropy continuity from Jordan decomposition bound, derivable from Question 4. If , write the positive and negative parts of as . The common density matrixand the two mixture bounds giveHere is increasing and concave, . Apply this in block dimension , both to the average states and to individual outputs, using convexity of trace distance and concavity of . Since the original ensemble is pure, its Holevo quantity is . The decoded ensemble hasThe Holevo quantity under a quantum channel cannot increase. To specify the entropy ingredient, Strong subadditivity of Von Neumann entropy states . Attach the classical source label , dilate the decoder isometrically to , and trace out . The displayed inequality says ; the isometry preserves the input mutual information. Since of a labelled ensemble is its Holevo quantity, this proves the needed decoder monotonicity. Before decoding, the system has dimension , so its Holevo quantity is at most . Thus and the rate cannot be below . Both operational fidelity formulations therefore have the claimed noiseless coding threshold.
Past exam of the mathematics course of the University of Cambridge 2006 iii Paper 33 5 b iii Solution Created 2026-10-03 Updated 2026-10-14
Trace out in the final state. With , the remaining state is diagonal in the product classical basis:The Von Neumann entropy of a classical diagonal density operator equals the Shannon entropy of its diagonal probabilities, by its spectrum. Therefore , the mutual information between source symbol and measurement outcome.
For the input, put . The marginal on is , the marginal on has Von Neumann entropy , and the entropy of a classical-quantum state isTo justify the last formula, diagonalize each with eigenvalues . The joint block-diagonal state has eigenvalues ; expanding yields exactly the displayed Von Neumann entropy. Thus , the Holevo quantity of the ensemble. Part (ii) becomes the Holevo boundIt holds for every POVM, and hence also for the accessible information obtained by maximizing the mutual information over all measurements. The only extra Von Neumann entropy identities used were the classical-diagonal and classical–quantum block-spectrum formulas, both justified above; the information inequality itself followed from the requested strong-subadditivity argument.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 34 3 c Solution Created 2026-10-03 Updated 2026-10-14
For the quantum state ensemble with average , the Holevo quantity isThe second equality follows by expanding the trace definition: . All positive-weight states are supported within , so the expression is finite.
For a CPTP map , the output average is , with unchanged probabilities . The data-processing inequality for quantum relative entropy givesThus the Holevo quantity cannot increase under a quantum channel.
The underlying monotonicity can also be seen directly from Strong subadditivity of Von Neumann entropy. Attach the classical label , and realize by a Stinespring representation of a completely positive map with output and discarded environment . The isometry preserves , whose input value is . The difference from the output value iswhich is precisely strong subadditivity. This explains why discarding an environment loses accessible ensemble information.
Here “operation” means the unconditional channel, including the classical outcome when a measurement is retained. Conditioning on a selected outcome can increase the Holevo quantity. For instance, take equally likely vectors , with . Their input Holevo quantity is . The filter succeeds on either state with probability and produces the orthogonal states after normalization. The success-conditioned quantity is . This does not violate the unconditional statement.
Past exam of the mathematics course of the University of Cambridge 2007 iii Paper 34 3 d Solution Created 2026-10-03 Updated 2026-10-14
The Holevo-Schumacher-Westmoreland theorem gives the classical coding formulaIts ensemble-coding statement makes every rate below a one-use output Holevo quantity achievable with product input encodings and collective output decoding. Under this product-input restriction, the capacity isFor any such input ensemble, rates below its output Holevo quantity are achievable with asymptotically vanishing decoding error. Maximization gives the product-state classical capacity. The converse follows from the Holevo bound, entropy bounds on product outputs, and Fano's inequality.
Define the binary entropy . For an input Bloch radius , the output eigenvalues are . Its entropy isOn , is decreasing, so this is minimized by pure inputs . Throughout the completely positive interval , the minimum equals , using symmetry . The average output entropy is at most , because it is a qubit. Hence every ensemble satisfiesTwo equally likely orthogonal pure inputs attain this bound: their average output is , and each individual output has entropy . ThereforeThis gives the Holevo capacity of a qubit depolarizing channel in the noise-weight convention used here.
For completeness, correlated classical code labels do not evade this upper bound. Each product input to uses has product output entropy at least , whereas the average output entropy is at most . Its Holevo quantity is consequently at most . The Holevo bound and Fano's inequality rule out a reliable rate larger than this value. Combined with HSW achievability, this proves the capacity under the stated product-input restriction. It also remains valid in the extended physical parameter range arising from the original assumption.
Past exam of the mathematics course of the University of Cambridge 2008 iii Paper 60 5 Solution Created 2026-10-03 Updated 2026-10-14
The printed normalization has its factors reversed. For the displayed map , the condition says , which is unitality. Trace preservation instead requiresThese are distinct trace-preserving and unital Kraus conditions. To disprove the printed equivalence, take andThey obey , butThus their completely positive map is not trace preserving. They are the adjoints of the operators of an amplitude damping channel. That channel is trace preserving but sends to , so it cannot satisfy the printed normalization in any Kraus representation either. The corrected characterization is proved next.
Work in finite-dimensional input and output Hilbert spaces, with a linear map on operators. Suppose first that and . For every auxiliary dimension and every positive operator on the extended space,Each summand is positive because conjugation preserves positivity. This is exactly the definition of a completely positive map. Cyclicity of the trace givesso the map is also trace preserving.
Conversely, suppose is completely positive and trace preserving, and let be an orthonormal input basis. Use the unnormalized entangled vector , with the reference factor first. Complete positivity makes the corresponding unnormalized Choi matrix positive:Its spectral decomposition can be written , absorbing the nonnegative eigenvalues into the vectors. Define linear operators uniquely byExpanding the outer products and comparing their reference blocks yieldsThe matrix units span all operators, so linearity proves the Kraus representation for every . Finally, trace preservation givesfor all . Taking matrix units as test operators shows that the matrix in parentheses is zero. This proves both directions of the corrected CPT characterization, including the normalization rather than assuming it.
For an input quantum state ensemble , write and . Its output Holevo quantity isThe Holevo capacity is the optimized one-use quantitywhere the supremum ranges over finite input ensembles and is the Von Neumann entropy in bits.
For uses of a memoryless quantum channel, the map is . An -use code consists of a finite message set of size , an encoding state on the inputs for each message, and a decoding POVM on the output space, with and . The encoding states may be entangled across uses. The measurement outcome is the receiver's decoded message, with conditional probabilityFor uniformly distributed messages the average error and rate areA rate is achievable if there is a sequence of such codes with and . The unassisted classical capacity of a quantum channel is the supremum of achievable rates; the sender and receiver do not share prior entanglement.
The operational content of the Holevo-Schumacher-Westmoreland theorem is that is the capacity for product-state input encodings with collective output measurements. Allowing arbitrary entangled block inputs gives the regularized formulaThe limit equals the supremum because superadditivity of Holevo capacity follows by taking product ensembles for two blocks and using additivity of the Von Neumann entropy on product states. The coding theorem makes every rate below the one-block Holevo quantity achievable through many independently encoded blocks, with collective decoding.
The converse can be seen explicitly from the Holevo bound and Fano's inequality. For a uniform transmitted message and decoded message ,The first inequality is obtained by subtracting the Fano bound on from . Dividing by and letting the average error vanish bounds every achievable rate by the regularized expression. The block-coding achievability just described supplies the reverse bound.
Under the assumed additivity of Holevo capacity across tensor powers, for every . ThusThe stated conditional assertion is true: under this additivity assumption, entangled input states cannot increase the asymptotic unassisted classical rate beyond the rate already achievable with product inputs. The decoder may still use collective measurements across channel outputs.
Past exam of the mathematics course of the University of Cambridge 2009 iii Paper 50 3 a Solution Created 2026-10-03 Updated 2026-10-14
Write . The Holevo quantity iswhere is Von Neumann entropy, with a consistent logarithm base. Attach an orthogonal classical label register to form the classical-quantum stateThe entropy of an orthogonal quantum mixture givesHere is the Shannon entropy of the classical label. Hence , where denotes quantum mutual information.
Let be the proposed quantum channel. Using its Kraus representation, define an linear isometry , since . This is a Stinespring representation. Apply it to , obtaining a state ; tracing out applies to every ensemble member. An linear isometry preserves nonzero eigenvalues and therefore Von Neumann entropy, soTheir difference isThe Strong subadditivity of Von Neumann entropy states that this expression is nonnegative for every tripartite state. ConsequentlyThus the Holevo quantity under a quantum channel decreases because discarding the dilation environment cannot improve correlations with the classical label. The probabilities remain unchanged throughout.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 48 3 b Solution Created 2026-10-03 Updated 2026-10-14
Write a qubit density operator as , with Bloch vector . The depolarizing channel sends to . Its output eigenvalues are , so its Von Neumann entropy is minimized at . DefineThe minimum output entropy is , since binary entropy is symmetric under . The usual probabilistic-mixture convention has . The argument also holds throughout the physical qubit CPTP range , where this still lies in .
To handle multiple channel uses, let a classical message select a product input with probability . Memorylessness gives product outputs . Additivity of Von Neumann entropy on tensor products gives . The average output acts on qubits, so . Thus the Holevo quantity obeys the product-input block bound for a qubit depolarizing channelThe Holevo bound says the classical mutual information obtained by any measurement, including a joint measurement on all outputs, is at most .
For a reliable code with equiprobable messages and decoding error , Fano's inequality gives . Consequently . Letting the error tend to zero proves .
The bound is tight: equal use of and computational-basis output measurements produce a binary symmetric channel with crossover probability . Ordinary classical coding achieves bits per use.
Past exam of the mathematics course of the University of Cambridge 2010 iii Paper 48 4 b Solution Created 2026-10-03 Updated 2026-10-14
For an ensemble , write its channel-output Holevo quantity asTake ensembles and independently, giving the product ensemble . Its average output factors:The Von Neumann entropy of a tensor product is the sum of its entropies. Applying this both to the average and to every labelled output givesChoose each ensemble within of its supremum. The supremum for the joint channel includes this product ensemble, so its value is at least . Let . The superadditivity of Holevo capacity follows:This argument does not restrict the joint supremum to product ensembles and does not require the individual suprema to be attained.
Past exam of the mathematics course of the University of Cambridge 2012 iii Paper 65 4 i Solution 2026-10-07
For a finite-dimensional memoryless quantum channel , the Holevo-Schumacher-Westmoreland theorem identifies its product-state classical capacity with the optimized output Holevo quantity:With product codewords and a collective measurement on the outputs, every rate below this value is achievable with vanishing error; no larger rate can be reliable under that product-input restriction. For a fixed classical-quantum output alphabet the corresponding optimized entropy difference gives its classical coding capacity. If entangled inputs across channel uses are also allowed, the general unassisted capacity is the regularized value . The requested calculation below concerns the single-use optimized product-input expression, so no unproved additivity assumption is needed.
Past exam of the mathematics course of the University of Cambridge 2016 iii Paper 323 1 ii Solution Created 2026-10-03 Updated 2026-10-06
Write and for the classical quantum registers and . By the quantum mutual information formula , expanding the right-hand side of the quantum mutual information balance identity givesAll Von Neumann entropies here are evaluated in .
We use three facts: quantum mutual information is nonnegative by nonnegativity of quantum relative entropy; a local quantum channel cannot increase it by data processing for quantum mutual information; and the quantum mutual information of a classical-quantum state is its ensemble's Holevo quantity. Write for the Holevo capacity, the supremum of the output Holevo quantity over finite input ensembles.
The marginal is an output ensemble for , with inputs . Consequently . Also is obtained from by a quantum channel on which retains and prepares from . HenceTo bound the latter even for entangled states , exhibit the conditional input ensemble after a local measurement. Setwhen ; zero-weight outcomes can be omitted. The numerator is a positive operator, its trace is , and the sum to one. ThusThis is a classical-quantum state with an output ensemble for , so . Combining these bounds with yieldsThe last step takes the supremum over all input ensembles on . The left-hand channel direction is , as established in part (i); the printed in the last inequality is a typographical reversal. Independent product ensembles also give the reverse inequality, so this proves Holevo-capacity additivity for entanglement-breaking channels.