Ternary symmetric channel capacity Created 2026-09-24 Updated 2026-09-24
Binary symmetric channel capacity Created 2026-09-24 Updated 2026-10-14
A binary symmetric channel independently flips each transmitted bit with crossover probability . Its channel capacity isin bits per use, where is binary entropy and the endpoint convention is . Knowing the input leaves just the uncertainty of the flip, so for every input probability distribution. Since the output is a bit, , and thus . A fair input produces a fair output and reaches the bound. This is the two-symbol case of weakly symmetric channel capacity; Eytan Modiano, MIT 16.36, Channel Capacity and Coding, slides 4–5 gives this calculation.
For crossover probabilities , the resulting channel capacities are approximately , , and bits per use. At , the communication channel is noiseless; at , the output is independent of the input and the capacity is zero. At , every bit is inverted, a known reversible rule, and capacity is one again. More generally , because inverting every received bit exchanges the two crossover probabilities. The existing mutual information figure shows this full symmetric curve.
An uncoded transmission illustrates why the raw bit-error probability is not itself channel capacity. At , transmitting 100 uncoded bits succeeds on all of them with probability . The probability of at least one error is therefore approximately . A suitable block code changes which received words count as recoverable evidence of a message; simply repeating uncoded transmission at rate one does not obtain the reliability promised at rates below .
Krein-Šmulian theorem Created 2026-09-24 Updated 2026-10-14
The other standard formulation says that a convex subset of a Banach-space dual is weak-star closed if its intersection with every norm-closed ball is weak-star closed.
Weakly sequentially compact set Created 2026-09-24 Updated 2026-10-05
Szlenk derivation Created 2026-09-24 Updated 2026-10-14
Weak-star metrizability of the dual ball Created 2026-09-24 Updated 2026-09-29
If is separable, the weak-star topology on is metrizable. For a dense sequence in , a compatible metric is obtained by summing bounded multiples of .
Galerkin method Created 2026-09-24 Updated 2026-09-24
The Galerkin method seeks an approximate solution in a finite-dimensional subspace and requires the equation's residual to be orthogonal to that subspace. Uniform energy estimates and compactness can then produce a weak solution as the subspaces become dense.
Weak formulation Created 2026-09-24 Updated 2026-10-14
A weak formulation multiplies a differential equation by a test function, integrates, and uses integration by parts to move derivatives away from the unknown function. Natural boundary conditions appear in the resulting boundary terms.
Compact massive-Laplacian resolvent Created 2026-09-24 Updated 2026-09-24
The solution operator is compact on every bounded open set because it maps boundedly into and the Rellich-Kondrashov compactness theorem for H01 embeds that space compactly into .
Norm-closed convex set is weakly closed Created 2026-09-24 Updated 2026-10-14
A norm-closed convex subset of a Banach space contains every weak limit of its sequences. Apply Mazur lemma to obtain norm-convergent convex combinations that remain in the set.
Weakly null orthonormal sequence Created 2026-09-24 Updated 2026-09-24
Every orthonormal sequence in a Hilbert space converges weakly to zero, by Bessel inequality, but no subsequence converges strongly because distinct terms remain distance apart.
Radon-Riesz theorem Created 2026-09-24 Updated 2026-10-05
Weak lower semicontinuity of the Hilbert norm Created 2026-09-24 Updated 2026-09-24
If in a Hilbert space, thenFor , take the inner product with and apply Cauchy-Schwarz before passing to the lower limit.
Weak subsequence of a bounded Hilbert-space sequence Created 2026-09-24 Updated 2026-09-24
Every bounded sequence in a separable Hilbert space has a weakly convergent subsequence. Successive subsequences make each basis coordinate converge, and a diagonal subsequence converges in every coordinate; the coordinate criterion for weak convergence in a separable Hilbert space finishes the proof.
Coordinate criterion for weak convergence in a separable Hilbert space Created 2026-09-24 Updated 2026-10-03
Hamiltonian ray-tracing equations Created 2026-09-24 Updated 2026-10-03
Linearly damped string Created 2026-09-24 Updated 2026-10-07
Two-sided Gaussian p-value Created 2026-09-24 Updated 2026-09-24
Wald and likelihood-ratio asymptotic equivalence Created 2026-09-24 Updated 2026-09-24
In a regular scalar model under the null, Taylor expansion about the MLE givesA uniform law of large numbers for the observed information makes
and the Fisher information used in the Wald statistic converge to the same positive limit. Their ratio therefore converges in probability to one.
and the Fisher information used in the Wald statistic converge to the same positive limit. Their ratio therefore converges in probability to one.
Multivariate Wald statistic Created 2026-09-24 Updated 2026-10-06
There are unlisted articles, also show them or only show them.