Offspring distribution of a branching process Created 2026-10-07 Updated 2026-10-20
The offspring probability distribution of a Galton-Watson process is the law of one individual's number of children: for , with and . Its probability generating function and, when finite, its expected value are
Use when evaluating the probability generating function at zero: and .
For and , , , and the offspring variance is : and . The generation probability mass functions pictured under Galton-Watson process come from repeatedly composing this probability generating function. They describe the whole generation, whereas describes one individual's reproduction. [ref]
The whole offspring distribution matters for extinction. Another law, and , has the same offspring mean but branching extinction probability , since has roots of a polynomial and . Consequently the two laws have the same expected generation size in a Galton-Watson process at each generation but different survival chances. A binomial branching process and a Poisson branching process likewise specify different offspring distributions; a common mean does not make their probability generating functions identical.
Ontological model of a quantum system Created 2026-10-06 Updated 2026-10-14
An ontological model associates each quantum state preparation with a probability distribution over underlying physical states . A measurement in quantum mechanics's response probabilities depend on its specification and , sum to one, and reproduce the Born rule when averaged over the preparation distribution. The model need not assign deterministic outcomes. Overlap or disjointness of preparation measures defines the psi-epistemic model versus psi-ontic model distinction.
For a strictly positive probability distribution on source symbols, with , every optimal binary prefix code has common length if and only if for every three distinct symbols. It suffices to compare the sum of the two smallest probabilities with the largest.
An optimal binary prefix tree has no node with only one child, because removing that detour would strictly shorten positive-probability words. It therefore satisfies equality in the Kraft inequality. If it is not a fixed-length tree, it has a deepest sibling pair at depth and a short leaf at depth . Exchanging that pair with the short leaf changes the expected codeword length by . Strict positivity of every pair sum over a third probability makes this change negative, contradicting optimality.
Conversely, if , begin with the complete depth- tree, place at sibling leaves, replace their parent by , and replace the previous leaf by children . The new expected length is and its lengths are unequal. If the optimum is below , every optimal tree is nonuniform; if it is , this modified tree is a nonuniform optimum. Thus equality in the probability condition already defeats the assertion that every optimum has fixed length.
Optimal prefix code Created 2026-09-24 Updated 2026-10-14
An optimal prefix code minimizes expected codeword length for a fixed source probability distribution. Here the source alphabet is finite, has symbols, and has for every symbol; each source symbol receives one codeword over the binary output alphabet . Its code tree puts the symbols at leaves. Reading the edges along the graph path from the root of a tree to a leaf produces its codeword, so the leaf depth in a code tree is exactly its codeword length. Thus
For unnormalized positive weights, minimize instead; the corresponding expected codeword length is . This connects the abstract optimization to storage or transmission: counts the bits charged when symbol occurs. Huffman coding attains this minimum; the Huffman sibling property and Huffman sibling contraction explain why. [ref]
For , a balanced code tree charges every symbol two bits, giving . The codeword lengths charge the most frequent symbol only one bit, giving . The choice concerns weighted cost, not just the greatest codeword length: increasing that maximum from two to three can improve the average.
The search over prefix codes looks infinite, but positivity reduces it to finitely many full binary trees with leaves. A vertex with one child can be suppressed to improve cost, and a full binary tree with leaves has internal vertices. There are consequently finitely many such shapes and symbol assignments, so the minimum exists. For four leaves, the only possible sorted codeword lengths in a full binary tree are and . Probability monotonicity of optimal prefix-code lengths assigns larger probabilities to shallower leaves, giving respective minimum costs and in this example. This is an independent small-instance check of the Huffman code.
These hypotheses matter. With zero weights, suppressing a subtree carrying only zero weight need not strictly improve cost, so an optimal prefix code need not have a full binary tree. A one-symbol source raises the convention of whether an empty codeword is allowed. Both cases are outside the original statement here. Encoding groups of symbols changes the source alphabet and the optimization problem; the minimum here concerns one source symbol per codeword.
Order statistic Created 2026-09-24 Updated 2026-10-14
An order statistic is a value selected by its position in a sorted statistical sample. For real observations , write
The th order statistic is the th smallest value, counting repeated values separately. The parentheses distinguish sorted position from the original observation label: and need not be equal. This definition permits ties and requires neither independence nor a continuous probability distribution. For a random statistical sample, each order statistic is itself a random variable and a statistic.
For example, the five fixed observations
sort to
Their original indices in sorted order are , so . Their ranks of observations, listed in original observation order, are . Here is the minimum, is the sample maximum, and is the sample median. These are deliberately chosen observations, rather than simulated draws.
Figure 1.
Five observations: original indices, sorted positions, and the third order statistic
. Details.
Order statistics put extremes and typical values in one language: the first and last locate the minimum and sample maximum, while intermediate positions give sample quantiles and the sample median. Under the existing generalized-inverse convention, the sample quantile at level is . For the five observations, the sample quantiles at are . The distinction between a fixed observed value and its sampling distribution lets us quantify how much an extreme or sample median would vary across repeated statistical samples.
The useful counting identity is
For independent and identically distributed random variables with a continuous cumulative distribution function , the count on the right has binomial distribution with parameters , giving
This cumulative distribution function is a binomial distribution tail: a question about sorting becomes a question about counting successes in Bernoulli trials. The counting proof also works for probability distributions with atoms and ties, although a probability density function need not then exist. For a uniform order statistic, on , which makes the formula particularly explicit.
Ordinary kriging Created 2026-10-05 Updated 2026-10-18
Ordinary kriging assumes for an unknown constant . A predictor has zero bias for every precisely when , where is the all-ones vector. Ordinary kriging minimizes the error variance subject to this constraint, giving the best linear unbiased predictor. Its explicit system is
The sign of the last term follows from the displayed convention . To derive the system, differentiate . To prove the minimum, let solve it and let be another feasible choice. Then , so
A positive-definite matrix makes equality possible only for . This argument uses second moments, not a normal distribution assumption. Ordinary kriging is the special case of universal kriging with and .
For an original one-dimensional teaching example, observe at , and predict at . Choose unit marginal variance, exact observations without measurement noise, an unknown constant mean, and the exponential covariance function
The exponential covariance function corresponds to a stationary Ornstein-Uhlenbeck process, so it gives a valid covariance model. Its semivariogram is . The resulting matrix and vector are
Solving the displayed system gives
These values can be checked directly: the weights sum to one and . Substitution into gives . Nearest-neighbor interpolation must choose between the two equally close samples at one and three, returning either three or two; their error variances under this model are both . Thus the benefit is quantified under the chosen model, without knowing the unobserved target value.
Figure 1.
Ordinary kriging combines three samples and reports uncertainty under a fixed exponential covariance model
. Details.
The upper panel applies the same ordinary kriging calculation at each target location. The lower panel shows the square root of its error variance, in the units of the observations. It is zero at the exact observation locations and rises between and beyond them. No confidence interval is inferred from a variance alone; a probability distribution assumption is needed to attach a coverage level.
The weights are not required to be positive. Keep the same observations and target, but replace the covariogram by the smoother Gaussian kernel . Then
The negative coefficient compensates for dependence between samples; the constraint eliminating bias still holds. Kriging is not generally a convex combination, and its prediction need not stay between the observed values. A smaller model-based error variance does not establish that one covariance function is better supported by these three observations.
Figure 2.
Changing the covariance model changes the ordinary kriging weights and can make a weight negative
. Details.
Set and draw independently of future Brownian increments. The Ornstein-Uhlenbeck process is then a strictly stationary process, with
Every time has the same normal distribution, and the covariance function depends only on the time lag. For a Gaussian process these properties also make all its finite-dimensional distributions invariant under a common time shift. The stationary distribution balances the continual random forcing against the contracting drift.[ref]
With a fixed , the covariance function instead is
In particular, it is zero when , since the initial value has no uncertainty. The second term records the fixed start; it is the general scaling of the zero-start Ornstein-Uhlenbeck covariance. The pure exponential covariance function displayed above assumes stationary initialization. For a fixed start, that function emerges as the late-time limit at fixed lag, while the one-time probability distributions approach by convergence in distribution.
For the stipulated , , , stationary initialization has variance one from the outset. Its autocorrelation is , so the correlation time is one: a lag of one reduces the autocorrelation to . Its raw second moment includes the squared expected value; it must not be confused with the covariance.
Figure 1.
Simulated stationary Ornstein-Uhlenbeck samples and analytic covariance compared with a fixed start
. Details.
The upper panel shows three simulated sequences with independent stationary initial values and exact transitions at spacing . Joining their points only guides the eye; it does not simulate a continuous sample path between those points. The lower panel shows analytic covariance functions: the stationary curve and, for comparison, for fixed initialization at two different ages . These are simulated samples and model curves, not measured trajectories or empirical covariance estimates.
Ornstein-Uhlenbeck transition distribution Created 2026-10-14 Updated 2026-10-20
For a fixed initial value , the Ornstein-Uhlenbeck process has the normal distribution
The two parameters of are the expected value and variance, not the standard deviation. At the variance is zero and the value is fixed. More generally, its transition kernel over any interval of length has conditional expected value and conditional variance when the current value is . The coefficients depend on elapsed time; the initial probability distribution determines whether the resulting stochastic process is stationary.[ref]
In the stipulated example , , , , the expected value at time two is and the variance is . The initial distance from two has fallen by a factor , but the standard deviation has grown to about . Approaching the reference level in expected value is compatible with growing uncertainty from a perfectly known initial value.
Figure 1.
Ornstein-Uhlenbeck transition densities, mean relaxation and variance growth from a fixed initial value
. Details.
The solid probability density functions use times , and ; the dashed curve is the limiting normal distribution with expected value two and variance one. The curves are exact model predictions. There is no ordinary density for the fixed value at time zero.
A short derivation uses the integrating factor . The Itô product rule gives , hence
The stochastic integral has zero expected value. The Itô isometry gives its variance as . Its deterministic integrand makes it a Gaussian random variable, yielding the displayed normal distribution. Shifting the integration interval gives the same transition kernel from any later time.
Parameter space 2026-10-31
The parameter space of a statistical model is the set of allowed statistical parameter values indexing its probability distributions. For an exponential distribution parametrized by its mean, ; for a Bernoulli distribution, . Intersecting a confidence interval with the known parameter space cannot remove the true statistical parameter and therefore preserves its coverage probability.
Pareto distribution Created 2026-10-07 Updated 2026-10-18
The Pareto distribution describes a positive random variable whose tail probability falls as a power law. In the shape–minimum convention used here, has shape parameter and minimum , with probability support . Its probability density function is
The minimum has the same units as ; the shape parameter is dimensionless. At fixed , changing gives a scale family, since . This convention is also used in uniform-Pareto conjugacy.[ref]
The survival function and cumulative distribution function are
For , solving gives the quantile function
Its right-hand limit at is ; it tends to infinity as .[ref] There is no probability mass at : changing a probability density function's value at that single point changes no probabilities.
Choose and as an original theoretical example. Then , , the median is , and the 0.99 quantile is . These chosen values and all figures below describe mathematical probability distributions, not actual wealth observations.
Figure 1.
Pareto survival curves: smaller alpha gives a slower power-law tail
. Details.
On this log-log plot, write to obtain . The slope is , whereas the probability density function has power exponent . Multiplying a threshold by ten divides its tail probability by . A larger therefore concentrates the Pareto distribution nearer ; a smaller makes extreme values more plausible. This exact scaling is useful when modelling large positive losses or sizes over several orders of magnitude.
The Pareto distribution is a heavy-tailed distribution: for every , the exponential moment diverges because eventually grows without bound. In contrast, the Laplace distribution has exponentially decreasing tails and some finite positive exponential moments. The Student's t-distribution also has power tails, but on both sides of the real line, with a smooth central region rather than a positive minimum.
Pareto moment threshold 2026-10-18
A Pareto distribution is a proper probability distribution for every , even when its mean is infinite. To see both facts, integrate the probability density function against . For real ,
The improper integral converges exactly when . At it diverges logarithmically; above that it diverges as a positive power of the upper endpoint. Setting gives one, proving normalization regardless of whether higher moments exist.
Taking and using when both terms are finite gives
For , the nonnegative random variable has expected value ; a centered variance about a finite mean is unavailable. For , the mean is finite and the variance is infinite.[ref] A finite total probability and a finite expected value answer different questions.
At the chosen minimum , gives , and variance , but an infinite third moment. At , the mean is 30 and the variance is infinite; at , even the mean is infinite, while the median remains the finite number . At the boundary , the earlier example has mean 20 but infinite variance. A finite sample contains finite values almost surely; that fact cannot establish that the underlying mean or variance is finite.
For a nonnegative random variable with finite positive mean, the share of its total amount carried by the largest fraction of outcomes can be defined by dividing their contribution to the expected value by the whole expected value. For a Pareto distribution, let and choose , so that . If , direct integration gives
This is a share of amount, distinct from the fraction of outcomes. It depends on , but not on the unit of measurement .[ref]
For the chosen , the top 20% starts at and carries of the amount. To make the top 20% carry exactly 80%, solve
The resulting Pareto distribution has a finite mean and infinite variance. The 80/20 rule selects one shape parameter; it is not a universal law, or even a property of every Pareto distribution. For , the population-share definition above is unavailable because its denominator is infinite; substituting such an into the finite-mean formula is invalid.
Figure 1.
Changing Pareto alpha changes quantiles, moment existence and the top 20 percent share
. Details.
The left panel compares three quantiles in units of the minimum. The right panel shows only where the mean is finite, and marks the chosen 80/20 value. The thresholds and separate the moment regimes; they do not separate valid and invalid probability distributions.
A straight-looking empirical log-log plot does not by itself establish a Pareto distribution or a reliable tail exponent; estimating an exponent and assessing goodness of fit are separate tasks.[ref] If a Pareto distribution is used only above a fitted lower threshold, describes that conditional tail population, not automatically the whole population. A genuine finite upper cutoff gives a truncated distribution with finite nonnegative moments; its survival function, quantiles and top shares must be recalculated. Truncation is a modelling change, distinct from merely observing a finite sample. None of the chosen numbers here estimates an actual wealth distribution.
The parity construction of pairwise independent bits turns two independent fair bits into three pairwise independent random variables. With , , and , their allowed triples are , each of probability . Every coordinate has the Bernoulli distribution with parameter . Every pair has the same joint probability mass function:
All twelve pair cells equal the product of the corresponding probabilities in their marginal distributions. This establishes pairwise independent random variables, a requirement involving every pair of value-events, rather than merely one chosen event per coordinate. For general real-valued random variables , the requirement is
for every pair of Borel sets . For these binary random variables, checking all four cells of each pair suffices: any value-event is a union of the checked cells. In fact, for binary random variables, independence of their one-value events also gives the other cells by taking complements. Siegrist gives the all-set definition and its connection to indicator random variables in Random Services: independence of random variables.
The full joint probability mass function tells a different story:
The integer parity of is always even. Any two bits determine the third: , , and . Each coordinate is independent of either other coordinate individually, but is dependent on the pair together. For example, the conditional probabilities satisfy and . See also pairwise independence does not imply joint independence for the general distinction.
The constraint changes the sum's probability distribution without changing its expected value or variance. Let . Only gives ; each other allowed triple gives . Direct calculation gives
The same variance follows from the variance of a sum: each Bernoulli distribution has variance , and pairwise independent random variables have zero cross covariances. Linearity of expectation gives the expected value even without independence.
For comparison, the sum of three mutually independent fair bits has the binomial distribution :
Both sums have identical expected values and variances, but never takes the values one or three. Even their third moments differ: , whereas . Pairwise independence preserves these first two sum summaries while allowing a different joint probability distribution and a different sum law. The calculation is an exact finite example.
Figure 1.
Pairwise independence preserves the mean and variance but changes the sum distribution
. The parity construction of pairwise independent bits gives sum probabilities ; three mutually independent fair bits give the binomial distribution probabilities . Both expected values are and both variances are . Details.
For three bits, the Boolean function outputs one when is odd, where denotes exclusive or. Unlike the three-bit majority decision tree, an exact decision tree computing parity must inspect all three bits on every input. If any coordinate is unread, two completions differing only at that coordinate follow the same observed graph path but have opposite parity. A single leaf cannot correctly label both.
The same argument works for bits: parity needs all queries on every input, whatever their order. Thus its decision-tree depth is , its expected query cost is for every input probability distribution, and each coordinate revealment is one. The algorithm remains required to be correct on the whole Boolean cube, even if the chosen probability distribution assigns some inputs zero probability; a promise restricting permitted inputs would be a different computational problem.
Use the ordered basis and , with
A pure quantum superposition has on the Bloch sphere. In contrast, a mixed state has , inside the sphere for . At equal populations its vector is zero. Equal populations alone therefore do not distinguish a coherent superposition from a mixture; their off-diagonal density matrix elements differ.
Choose the drive phase so the rotating-frame Hamiltonian is , where as specified. The Rabi vector is the angular-velocity vector
Here is the on-resonance population oscillation angular frequency, not the unhalved coefficient of a cosine coupling. From , rotation about at gives
For , the rotation axis is nearly transverse, the trajectory nearly a great circle, and transfer is almost complete. For , the axis bisects and , the orbit lies in , and never exceeds . Each member remains a pure state in this coherent evolution.
Figure 1.
Pure and mixed Bloch vectors, resonant and detuned trajectories, and their population oscillations
. Details.
For the Ramsey free interval, let atom have detuning . Instantaneous ideal pulses give the Ramsey ensemble coherence factor . Averaging the free-evolution vector obtained in step (ii) gives
Different atoms fan out around the equator, shortening the ensemble Bloch vector even though every individual's vector remains unit length. A broad smooth detuning distribution usually makes the average spiral towards the centre and damps the Ramsey fringes towards . The dephasing time is of order . inhomogeneous ensemble dephasing is not necessarily irreversible decoherence of individual atoms; an appropriate spin echo can rephase static frequency offsets.
The given spread does not specify a probability distribution or whether it denotes an RMS width. An exact envelope is therefore not determined. The figure illustrates, rather than infers, a Gaussian distribution with RMS , for which . A uniform distribution would instead give a sinc envelope and side lobes. Both have the same qualitative initial loss of contrast on the quoted inverse-spread scale.
Figure 2.
An ideal Ramsey path and an explicitly illustrative Gaussian ensemble-dephasing envelope
. Details.
In the rubidium-87 ground-state hyperfine structure, and , so . Taking gives
The zero-field splitting is . Ignoring the small nuclear magnetic term, the weak-field Landé g-factors are and . The diagram labels all three and five substates, with linear shifts .
The pair and is connected by a magnetic dipole transition with , , driven with its oscillating magnetic component along the quantization axis. Both first-order shifts vanish, giving the rubidium-87 clock transition first-order insensitivity near zero field. Its insensitivity does not imply absence of quadratic shifts.
For these two levels the Breit-Rabi formula gives the quadratic Zeeman shift of a clock transition:
where the last expression neglects the nuclear term and sets . Hence
This uses and the supplied . With physical moments defined by , the differential magnetic moment is . If effective magnetic moment denotes the positive energy slope instead, that slope difference is positive. The magnitude and physical frequency sensitivity are the same. Retaining the full atomic factors gives the familiar quadratic clock-frequency coefficient about ; the simplified supplied parameters give about .[ref]
Figure 3.
Weak-field rubidium-87 hyperfine manifolds and the quadratic clock-transition shift
. Details.
Use a far-detuned optical dipole trap, such as a red-detuned focused-beam trap, to confine both clock states. Their first-order magnetic moments vanish; their residual quadratic magnetic slopes are opposite, so a simple static magnetic-field minimum does not confine both in the same way. An optical potential acts through the electronic polarizability and can trap both ground hyperfine states. It is not perfectly state independent: differential AC Stark shifts, intensity noise and residual magnetic gradients still need control during Ramsey evolution.
The entropy chain rule gives
Conditional entropy is nonnegative, so . For finite entropies, if , equality holds exactly when , meaning is a function of almost surely. If , interchange the variables. When their entropies are equal, equality requires both functional relations. Zero conditional entropy has this characterization because each conditional probability distribution must be a point mass.
For a finite probability distribution,
with . If the positive support has size , apply the given strict Jensen inequality to the random variable :
Equality requires and constant almost surely, so all probabilities are . Conversely the uniform distribution attains this bound. Thus , with exactly that equality case.
Put and let be the largest length. Expanding sums over all strings of source symbols, where is the total code length. By unique decodability, the concatenations of length in this sum are all distinct, so there are at most of them. Since ,
Taking th roots and sending to infinity proves the Kraft–McMillan inequality
Now is a probability distribution. With base-two logarithms, Gibbs inequality gives
Terms with contribute zero. Therefore
The normalization by is important: the raw numbers need not sum to one.
Every positive atom has probability at most , so . Averaging yields
For , the supplied inequality gives . Rearranging proves
The two regimes combine into the entropy lower bound from the largest atom, valid for every finite probability distribution.