Barcode collision 2026-10-20
Independent cells receive the same apparent label. If barcode probabilities are , two independent founders match with probability , rather than necessarily the inverse of the nominal library size.
Bayesian model evidence Created 2026-09-24 Updated 2026-10-18
The Bayesian model evidence is the prior predictive distribution evaluated at the data . For a statistical model with a normalized prior density , its marginal likelihood isThis is an expected value of the likelihood function under the prior distribution; for discrete statistical parameters, replace the integral by a sum. For continuous observations, is a probability density function value with respect to a specified data reference measure, rather than a probability of one exact observation. Comparisons must use the same data and reference measure. The same normalizes the within-model Bayesian posterior and supplies the between-model comparison in a Bayes factor.[ref]
Bayes Factors by Robert E. Kass and Adrian E. Raftery. Kass and Raftery, Bayes Factors (1995), section 3.1, p. 776, equations (1)–(2): integrating over parameter priors
A normalized prior distribution makes the Bayesian model evidence an average, so it cannot exceed the largest likelihood function value on its support. A broad prior distribution can assign little mass to values that predict the data well, even when one value gives an excellent fit. The worked uniform-alternative binomial Bayes factor below makes the difference between averaging and maximum likelihood estimation explicit.
Bayesian statistics Created 2026-09-24 Updated 2026-10-14
Bayesian statistics expresses uncertainty about an unknown statistical parameter through a probability distribution, then uses Bayes' theorem to update it after observing data. The prior distribution describes uncertainty before the current observations; the likelihood function describes how the statistical model generates those observations at each parameter value; the posterior distribution describes uncertainty conditional on the observations and that model. A physical parameter can have one fixed value while its value remains uncertain to us. Assigning it a probability distribution represents that uncertainty under the chosen model, rather than requiring the physical parameter to change randomly between measurements.
For example, suppose ten Bernoulli trials are independent conditional on an unknown heads probability , with a beta distribution prior . Eight heads and two tails give the posterior distribution by Beta-binomial conjugacy. Its posterior mean is , between the prior mean and observed binomial proportion . The Bayesian posterior below computes the whole update, and the credible interval below summarizes its remaining uncertainty. The conjugate update is explained in MIT 18.05, Reading 15: beta and normal conjugate priors.
The useful feature is that one posterior distribution supports several questions: a posterior mean estimates a value, a credible interval reports a range, and a posterior predictive distribution predicts a future observation while averaging over parameter uncertainty. With conditionally independent new data, today's posterior distribution can become tomorrow's prior distribution. These conclusions remain conditional on the statistical model and prior distribution; a precise update does not establish that either assumption fits the experiment.
A historical starting point is Thomas Bayes's essay in the 1763 volume of the Royal Society's Philosophical Transactions, communicated after his death by Richard Price. Its opening problem asks for uncertainty about an unknown event probability given observed successes and failures: the same direction of reasoning illustrated by the coin example. See Bayes and Price, An Essay towards solving a Problem in the Doctrine of Chances, opening letter and problem.
Bayes' theorem Created 2026-09-24 Updated 2026-10-14
For a finite measurable partition with positive probabilities, and an event of positive probability,Its beauty is that a model predicting observations from a hidden state can also describe uncertainty about the state after an observation. Each numerator is a joint probability; the denominator, supplied by the law of total probability, makes the answers sum to one. This is a direct consequence of conditional probability, rather than an extra axiom.
Select the coin from law of total probability once, then toss that same coin repeatedly, with conditionally independent tosses given its identity. Let denote the -head coin, initially of prior probability . After one head , its posterior probability isThe likelihood of a head is larger under , but remains less likely than the other coin because its prior probability was smaller. A large likelihood for an observation does not itself imply a large posterior probability for the hypothesis.
After an ordered sequence containing heads and tails, its likelihood ratio between the two coins is . Bayes' theorem therefore gives posterior oddsEach head multiplies the odds by and each tail by . Three heads give posterior probability , still below one half; four give , above one half. The finite-model update and the distinction between prior probability, likelihood and posterior probability are set out in MIT 18.05, Reading 11: Bayesian Updating with Discrete Priors.
Updating uncertainty about one selected coin after repeated observations
. Details. The hidden selection also creates dependence. Each toss has marginal head probability , but two heads have joint probability , greater than . Their indicator covariance is . Seeing a head makes the head-favoring coin more likely, so it also raises the chance of a future head. This is covariance induced by a shared latent variable, despite conditional independence of the tosses given the coin.
Historically, Thomas Bayes's essay on an unknown success probability appeared in 1763 after his death, communicated by Richard Price. Its opening problem asks how observed successes and failures constrain that unknown probability; Price's introductory letter explains the connection to reasoning from experience. That is a more substantial inference problem than simply rearranging today's elementary identity. [ref]
https://www.gtfp.cs.rhul.ac.uk/pulskamp/Bayes/bayesessay-rjp.pdf. Bayes, An Essay towards solving a Problem in the Doctrine of Chances, 1763; original text transcribed, introductory letter and statement of the problem
Bell correlations versus a classical mixture 2026-10-14
Give Alice the first qubit and Bob the second . Compare the Bell state with a preparation that tosses a fair classical bit and gives both parties its value. Their density operators, written in the computational basis ordered , areThey have identical diagonal quantum state populations. The off-diagonal entries of the Bell state retain quantum coherence between and ; the classical mixture has none in this basis.
If both parties perform a Pauli measurement of , the Born rule gives and for both preparations. Perfect agreement here therefore cannot establish entanglement: an ordinary shared random bit already explains it.
Now both measure , whose normalized eigenstates are and . Changing basis givesThe Bell state again has matching outcomes, each with probability . For either product state or , each of the four outcome pairs has probability , so their classical mixture does too. Equivalently, the Pauli correlator is one for the Bell state and zero for this mixture, while is one for both.
Joint measurement probabilities distinguish a Bell state from a classical mixture while every local outcome remains uniformly random
. Details. Taking a partial trace gives for both preparations. Thus every measurement confined to Alice's system has the same statistics in the two cases, and so does every measurement confined to Bob's. They reveal the difference by comparing records through classical communication. Conditional on Alice's result, Bob can predict a matching result for the Bell state; without that result, his outcomes remain evenly split. An uncommunicated local quantum channel, including a measurement with its outcome discarded, leaves his reduced density matrix unchanged. This is quantum no-signalling, even when conditional states change. [ref]
https://jhwatrous.github.io/TQI.2.pdf. Watrous, Basic notions of quantum information, sections 2.1.3 and 2.2.1, on reductions and channels
The Von Neumann entropy makes the joint-versus-local distinction numerical. With base-two logarithms, the Bell state has eigenvalues , giving , whereas the mixture has , giving . Both have . Their quantum mutual information is consequently two and one bits, respectively. The value two is not two readable classical bits in either local qubit: the matching records have ordinary mutual information one bit in both cases. Random records can come from a globally pure state. [ref]
https://jhwatrous.github.io/TQI.5.pdf. Watrous, Quantum entropy and source coding, on Von Neumann entropy and quantum mutual information
These two matching-axis measurements distinguish the specified preparations; they alone are not a test of a Bell inequality. A local hidden-variable theory could assign shared random answers separately to these two axes. Bell theorem concerns incompatible correlations across a suitable larger collection of measurement settings. Bell's 1964 paper established the obstruction for local hidden-variable descriptions of the predicted correlations. [ref]
https://journals.aps.org/ppf/pdf/10.1103/PhysicsPhysiqueFizika.1.195. Bell, On the Einstein Podolsky Rosen paradox, 1964
Bell test Created 2026-10-18 Updated 2026-10-20
A Bell test compares experimental probabilities or expectation values with a Bell inequality. In a two-setting photon polarization test, each station chooses a polarizer orientation and records an outcome. A coincidence circuit identifies candidate pairs using an agreed timing rule. The choice of which trials enter the statistic is part of the experiment: correlations calculated only from detected pairs can differ from correlations of all emitted pairs. The Polarization CHSH count model separates ideal expectation values from this experimental selection problem.
Two-setting polarization measurements and coincidence readout
. Conceptual apparatus for the ideal two-output model. The displayed angles belong to the worked CHSH example; they are not a reconstruction of a historical apparatus. Each station chooses one basis, then records either output. The coincidence record also needs a rule for missed detections. Details. Benford law Created 2026-10-05 Updated 2026-10-14
For a positive random variable , let be its first nonzero base-ten digit. The Benford law is the discrete probability distribution with probability mass functionHere need not be an integer: , and all have . Multiplication by an integer power of ten changes the decimal point's position and leaves the first nonzero digit unchanged. Zero has no first nonzero digit, so exclude it. For negative inputs one may explicitly use their absolute values, still excluding zero; that convention must be stated rather than applying a logarithm to a negative number.
The Benford law favors small digits: , whereas . Thus the model assigns about to digit one and to digit nine. The masses are positive and their normalization is a finite telescoping series:
Why can digit one be so common? In a decimal significand interval , the digit-one region occupies a larger fraction of the logarithmic scale than the digit-nine region . The precise assumption is that the fractional part of the base-ten logarithm is distributed uniformly on ; Benford law from logarithmic uniformity turns those unequal interval lengths into probabilities. This makes a surprising digit pattern into a simple geometry of multiplicative size. The logarithmic explanation is also presented in Peter Sheridan Dodds, Benford's Law, essential story.
The Benford law is useful as a proposed model for leading digits when the mechanism supports logarithmic uniformity or an appropriate limiting argument, such as Benford frequencies for powers of an integer. Merely spanning many powers of ten does not establish that assumption. A discrepancy from the Benford law can prompt investigation of the model and data collection; by itself it does not establish fraud, and agreement does not establish authenticity.
Simon Newcomb's 1881 paper, Note on the Frequency of Use of the Different Digits in Natural Numbers, appeared in the American Journal of Mathematics 4, pp. 39–40. Its opening connects unequal leading-digit frequencies with the faster wear of early pages in logarithm tables. The publication metadata and original opening excerpt are available in Newcomb (1881), original publication record and [ref]
https://www.benfordonline.net/fullreference/414. Newcomb (1881), reproduced opening excerpt
. Frank Benford's The Law of Anomalous Numbers, Proceedings of the American Philosophical Society 78 (1938), pp. 551–572, likewise discusses worn logarithm tables on p. 551 and tabulates observations on p. 553. See Benford (1938), transcription of the original paper with page numbers and publication metadata. These observations motivated study of the digit pattern; they do not make the Benford law universal. Benford law from logarithmic uniformity Created 2026-10-07 Updated 2026-10-14
For a positive random variable , write its base-ten logarithm as an integer part plus a fractional part:The floor function handles values below one as well: for , and the decimal significand is . Since , the first nonzero decimal digit is . The monotonicity of the logarithm gives the exact event equivalenceIf has the uniform distribution on , the probability of this interval is its length. Consequently , proving the Benford law. This argument assumes uniformity of the fractional part of the logarithm, rather than uniformity of itself. See the logarithmic-coordinate explanation in Peter Sheridan Dodds, Benford's Law, essential story.
Leading-digit intervals have unequal lengths in the fractional logarithm and equal lengths in the original number
. Details. An exact constructed example is the log-uniform distribution on , with probability density function there and zero elsewhere. Its total mass is . The change of variables formula with gives for . Equivalently, integrating directly givesFor example, the probability of first digit four is . By contrast, an ordinary uniform distribution for on has probability density function there, so for every digit. This is a concrete counterexample to any claim that the Benford law holds for every positive random variable.
More generally, a log-uniform distribution on with has uniform on . If its logarithmic span is a positive integer, reduction to the fractional part wraps an interval of length around the unit interval exactly times, making uniform even when is not a power of ten. Arbitrary partial-decade truncations generally do not have this property: for a log-uniform distribution on , the first digit is always one.
Under the uniform fractional-logarithm assumption, multiplication by any constant replaces by . This is a rotation modulo one, which preserves the uniform distribution and therefore preserves the Benford law; see scale invariance of decimal significands. For the constructed example, multiplying by gives a log-uniform distribution on with the same digit probabilities. The claim concerns the decimal significand law: there is no proper probability density function proportional to over all of , since its integral diverges. The existing scale-invariant prior describes that unnormalizable measure, while a finite log-uniform distribution is normalizable.
Bernoulli process 2026-10-14
A Bernoulli process is a sequence of independent and identically distributed random variables with a Bernoulli distribution: and . It models repeated Bernoulli trials with a fixed success probability and no dependence between trials. The count has a binomial distribution, expected value , and variance ; the first success time has a geometric distribution on . The observations and the accumulated count are different stochastic processes: the observations are independent, while consecutive counts share all earlier observations. [ref]
Let be fixed and known, and let be independent and identically distributed Bernoulli random variables with common success probability . Their joint probability mass function, on the binary sample space , isThere are arrangements with successes, so has the binomial distribution. For and , its exact conditional full-data probability mass function isThis conditional distribution is uniform over arrangements, with no dependence on : the sum is a sufficient statistic. [ref]
Sufficiency (Stat 210a, Fall 2025) by Will Fithian. Sufficiency, Will Fithian, “Independent Bernoulli sequence”: conditional pmf
Four Bernoulli observations grouped by their sufficient sum
. All sixteen binary sequences are grouped by . Within each group the conditional distribution is uniform; changing changes the group's total probability, not the conditional weights within it. Details.For , the group sizes are and the within-group conditional probabilities are respectively . For example, leaves exactly , each with conditional probability . At , each such sequence has unconditional probability and the group has probability . At , these values are and ; at they return to and . The conditional weights stay in all three cases.
At the boundary , only has positive probability; at , only does. Dividing by on the other groups would divide by zero. Nevertheless, the same uniform-on-arrangements Markov kernel is a valid common version for the entire family : it gives the correct point mass on the one observed group at each boundary and assigns permissible versions on its unobserved groups. Define the joint probability mass function there by the original product of the one-trial Bernoulli probability mass functions, or use the limiting convention in the compact formula.
The sample mean is an unbiased estimator of and retains the sufficient statistic because is known. By contrast, is also an unbiased estimator of but, for , is not sufficient: the conditional success probability of the independent given is still . Thus unbiasedness does not imply sufficiency.
Sufficiency also does not imply completeness of a statistic. For , the full-data sufficient statistic admits the nonzero function with expectation zero for every . Nor does minimality imply completeness of a statistic: for and the restricted statistical model , is a minimal sufficient statistic since the likelihood ratio distinguishes its three values. Yet has expectation at both parameter values and is never zero. Changing the parameter family can change completeness of a statistic even while preserving sufficiency.
Bernoulli string 2026-10-20
A Bernoulli string is a finite sequence of independent binary digits, each taking value one with a specified probability. Unless stated otherwise, all positions use the same probability.
Bernoulli typical-set example 2026-10-14
Take an IID random variable source of bits with . Its binary entropy isA word of length containing ones has probability . Its information content per symbol isThus weakly typical sequences for this biased source have near . With tolerance bits per symbol, the exact condition isFor , this includes exactly . There are words with each count: a type class with that many possible orderings. Summing the counts and their probability masses givesThese are fewer than one percent of the possible words, yet they carry nearly 64 percent of the probability. The most likely individual word is all zeros, with probability ; it is outside this typical set. No contradiction is involved: the type classes near ten ones each contain many more individual words.
The most likely individual word differs from the counts carrying most probability
. The left plot gives the information content of one word with each number of ones. The right includes the binomial coefficient counting every such word, giving the exact binomial distribution of the count. Both use , ; the green band marks the typical set with tolerance bits per symbol. Details. Bernstein polynomial Created 2026-09-24 Updated 2026-10-14
For a function and an integer , its Bernstein polynomial isThe Bernstein basis supplies nonnegative weights whose sum is one. Equivalently, the weights are the probabilities of a binomial distribution, and the result is an expected value. At a given , this averages the sampled values with weights concentrated near .[ref]
The Weierstrass approximation theorem (Georgia Tech handout). The Weierstrass approximation theorem, Lemmas 0.1–0.2 and Theorem 0.3, printed pp. 1–2: weights, binomial moments and polynomial construction
The endpoints are exact: and . Interior sampled points need not be interpolated. For example, binomial distribution moments give and . Thus every affine function is reproduced exactly, whereas is generally changed. Bernstein polynomial degree preservation is a statement about degree of a polynomial, not equality of the entire polynomial.
For a continuous , the uniform continuity of and the variance explain uniform convergence. Split the expected value of the error into , where uniform continuity makes the change small, and its complement, whose probability is at most by Chebyshev's inequality. The bounded function bounds the remaining error. This proves convergence without assuming differentiability.
For , the tensor-product Bernstein polynomial is the expected value of for independent random variables . The same uniform continuity and coordinatewise variance estimates give uniform convergence for each fixed finite .
Berry phase Created 2026-09-28 Updated 2026-10-13
A Berry phase is the geometric phase acquired when a nondegenerate energy eigenstate follows a closed cycle of parameters of a Hamiltonian operator in the ideal limit of the adiabatic theorem. The energy eigenstate must stay separated from other energy eigenstates by a nonzero spectral gap, and the parameters must change sufficiently slowly. Returning the Hamiltonian operator to its starting value returns the state to the same ray, but its quantum phase can remember the journey. The total quantum phase contains both the dynamical phase and the Berry phase.
The beauty of the Berry phase is that, within the adiabatic theorem's limit, it depends on the oriented path of the parameters rather than how long the journey takes. For a spin one-half qubit, the Berry phase of a Bloch-sphere latitude turns that memory into half a solid angle. Berry-phase interference with a reference path converts this geometry into a detection probability.
Michael Berry's 1984 paper formulated the geometric phase for cycles governed by the adiabatic theorem and derived the solid angle result for spin. Its bibliographic details are Proceedings of the Royal Society of London A, volume 392, pages 45–57, DOI 10.1098/rspa.1984.0023. [ref]
https://michaelberryphysics.wordpress.com/publications/. Berry's authored publication list, entry 120: Quantal phase factors accompanying adiabatic changes (1984)
; [ref]https://stuff.mit.edu/afs/athena/course/8/8.06/spring06/handouts/Berry_1984.pdf. Berry's original paper, available through MIT
. The wider concept of geometric phase does not require every cycle to obey the adiabatic theorem: Aharonov and Anandan formulated a geometric phase for general cyclic quantum evolution in 1987. [ref]https://doi.org/10.1103/PhysRevLett.58.1593. Aharonov and Anandan, Phase change during a cyclic quantum evolution, Physical Review Letters 58, 1593–1596 (1987)
.An isolated qubit that acquires only a global phase has unchanged measurement probabilities. To reveal the Berry phase, use two coherent paths of a Mach-Zehnder interferometer, represented by a path qubit. In one arm the internal spin one-half qubit follows the loop; in the reference arm it stays in its starting energy eigenstate. Assume equal arm amplitudes, identical final internal states, cancelled relative dynamical phases, and calibrated fixed apparatus phases. In the model above, hold the reference Hamiltonian operator at its initial value for the same duration. Both arms then have energy eigenvalue and acquire the same dynamical phase , so their relative dynamical phase vanishes in the ideal limit of the adiabatic theorem.
The joint quantum state before recombination then factors asThe Berry phase is now a relative quantum phase between the two paths. The calibrated plus output projects onto . The Born rule givesFor the Berry phase of a Bloch-sphere latitude, the plus-port probabilities at are respectively . This ideal Mach-Zehnder interferometer measurement cannot distinguish from or by itself; scanning a known reference phase can resolve the sign. An uncancelled relative dynamical phase would shift the fringe as well.
Bessel second-moment identity 2026-10-20
For real , the probabilities over integer angular-momentum modes satisfy . Differentiate the unit-modulus function and use Parseval to obtain the identity; its zero first moment follows from the symmetry of opposite orders.
Beta distribution Created 2026-09-24 Updated 2026-10-20
The beta distribution is an absolutely continuous probability distribution for a random variable between zero and one. It can describe uncertainty about a probability, such as an unknown coin's chance of heads. For any real , its probability density function isand zero outside . The normalizer is the Euler beta function, related to the gamma function by the beta-gamma identity:Thus the probability density function integrates to one. [ref].
The endpoint behavior explains why the restrictions are exactly : near zero the probability density function behaves like a constant times , and near one like a constant times . These improper integrals converge for positive parameters, even when the probability density function diverges at zero for or at one for . There is no probability mass at either endpoint: . A probability density function's height is not a probability; an interval's probability is the area under it.
Some useful examples of the beta distribution are:
- is the uniform distribution on , with probability density function .
- has probability density function : values near one half are favored, and it is a symmetric probability distribution about one half.
- has probability density function . Its mean is and its variance is ; most of its area lies toward the lower end.
- is the arcsine distribution, with probability density function . It favors values near both endpoints despite having mean ; its variance is .
The arcsine distribution curve is plotted only for ; its finite plotted ends do not represent finite endpoint values of the probability density function. Using the inverse sine, the shaded central interval has exact probability , calculated analytically rather than by treating the cropped curve as normalized.
To separate location from spread, write and . The mean and variance of the beta distribution areThe mean specifies the balance between the parameters; their sum controls concentration about that mean. Multiplying both parameters by the same positive number preserves the mean and changes the variance. Larger puts more area near and makes the probability density function taller there; the total area stays one. Small allows much greater spread, sometimes favoring the endpoints rather than the mean itself.
For example, keeping mean and taking gives the beta distributions , , and . Their variances are , , and , respectively. Parameters need not be integers.
The formulas follow from two short moment calculations. Multiplying the probability density function by or increases the first parameter of the Euler beta function:Apply the Gamma function recurrence to the beta-gamma identity, then subtract from to obtain the variance.
The beta distribution is especially convenient as a prior distribution for the unknown success probability of Bernoulli trials. The Beta-binomial conjugacy says that successes and failures update a prior distribution to a posterior distribution . For example, suppose a coin has prior distribution and we observe eight heads and two tails. Its posterior distribution is then , with posterior mean . [ref]
https://ocw.mit.edu/courses/18-05-introduction-to-probability-and-statistics-spring-2022/mit18_05_s22_class15-prep.pdf. MIT 18.05, Reading 15: beta priors and conjugate updating
. Beta-geometric conjugacy 2026-10-20
For independent geometric random variables with success probability , observing terminal events and preceding failed Bernoulli trials gives likelihood function proportional to . Multiplication by a beta distribution prior gives the posterior distribution . With complete waiting times , take and .
A waiting time that is right-censored after failed trials contributes : increase by without increasing . This requires the censoring mechanism to be ignorable, as with an externally fixed observation horizon. Counting a censored waiting time as an observed event changes the likelihood function and biases the update.
Bhattacharyya coefficient 2026-10-14
For probability distributions on the same finite alphabet, the Bhattacharyya coefficient measures their square-root overlap:The vectors and have unit Euclidean norm, so the Cauchy-Schwarz inequality gives . Equality holds exactly when the distributions agree; holds exactly when they assign positive probability to disjoint outcomes. For and , . This overlap is not the probability that two independent draws agree, which here is .
The fidelity of commuting mixed states reduces to this coefficient. More generally, the measurement characterization of quantum fidelity minimizes it over outcome distributions of a common measurement in quantum mechanics, connecting classical overlap to the unsquared quantum fidelity.
Biased random walk Created 2026-09-24 Updated 2026-10-14
A biased random walk on the integer line takes unit steps right and left with unequal probabilities and , using independent and identically distributed random variables as increments. For , the expected value is : positive for and negative for . Changing to reverses the preferred direction. The exact endpoint probability mass function is given under simple random walk on the integer line.
For example, with each step has expected value and variance . After steps,The displacement of the expected value from zero is about standard deviations, yet individual sample paths still move left as well as right, as the figure under simple random walk illustrates. Bias lets this elementary stochastic process model an average directional tendency while retaining fluctuations. Boundary and return questions have their own treatments under gambler's ruin and the specialized children below.









