Let the survival time have an exponential distribution with rate per year. Its hazard function is per year, its cumulative hazard is for in years, and its survival function is . For a subject still event-free after five years, the conditional probability of an occurrence within the next two years is
The original population's probability of an occurrence between those same endpoints is instead . Dividing by recovers the conditional answer. The memoryless property makes the two-year conditional answer independent of the preceding five years.
For just year, the exact conditional event probability is , close to the instantaneous approximation . For two years that approximation gives , whereas the exact answer is about . At the single exact time five, the event probability is zero. These are three different quantities: an instantaneous hazard function with inverse-time units, a short-interval approximation, and an exact finite-interval probability.
A simple locally finite point measure on with void probability on finite unions of bounded intervals is a Poisson random measure with Lebesgue measure intensity. Void-event intersections factor, hence the occupation indicators on disjoint cells are independent. The dyadic occupancy approximation of a simple point measure is binomial with rare-event probability and converges to a Poisson count of mean the interval length. Independence survives joint convergence for disjoint intervals. Extension of the mean measure and the Laplace functional of a Poisson random measure to Borel functions identifies all Borel counts, not just intervals.
If bounded intervals have void probabilities for Lebesgue measure , a fixed deterministic point has zero chance of being an atom. Surround it by intervals of lengths tending to zero and use . This holds for each fixed endpoint, not simultaneously for all real points of a nonempty point process.
If a normalized wavefunction has exterior tails outside , integration over both tails gives the title probability. For an even cosine interior , the remaining normalization contribution is . Tail amplitudes defined at the edge rather than at the origin absorb the factor , so their probability formula looks different despite describing the same state.
Extinction probability of a branching process Created 2026-10-07 Updated 2026-10-14
For a Galton-Watson process with one ancestor, the branching extinction probability is the probability that some generation is empty:
The equality uses the absorbing state at zero. The complementary branching survival probability is the probability that every generation is nonempty. The Galton-Watson extinction fixed point computes from the offspring distribution.
For , , one ancestor has . Starting instead from ancestors with independent descendant families gives
All families must die out. With three ancestors, eventual extinction has probability and survival has probability ; by generation two, extinction has probability . Extra ancestors change the extinction probability without changing the offspring distribution. [ref]
For finite offspring mean , the extinction classification is:
  • If , extinction has probability . For example , gives and ; its only fixed point in is .
  • If and , extinction also has probability . For example gives and , despite expected generation size in a Galton-Watson process remaining one.
  • If , extinction has probability . The value can be zero: if , every individual has at least one child, so an initially nonempty family never becomes empty. In particular gives and .
The critical exception is : every individual has exactly one child, , and forever from one ancestor. Thus but ; a blanket claim that every critical Galton-Watson process becomes extinct would be false. These cases concern the Galton-Watson process with its common offspring distribution and independence assumptions. [ref]
This probability answers whether any lineage persists, which the offspring mean alone cannot quantify in the supercritical case. A branching process conditioned on extinction uses the same fixed point to reweight reproduction and describe families known eventually to die out.
For the ferromagnetic binary Ising model, all-zero boundary measures increase and all-one boundary measures decrease as boxes exhaust the lattice, in stochastic domination. The nearest-neighbor spatial conditional probability distribution reduces each domain comparison to a mixture of boundary conditions for the smaller box. Probabilities that a specified finite set is all one consequently converge; inclusion-exclusion gives convergence of every finite Ising spin pattern. Their consistent limits define the two extreme infinite-volume measures. Existence does not assert that the two limits coincide.
A failure-probability budget assigns nonnegative numbers to a finite or countable family of failure events in a common probability space, with verified bounds . The union bound guarantees that the probability of any failure is at most . By De Morgan's laws and the complement rule of probability, the probability that every requirement succeeds obeys
Thus guarantees simultaneous success with probability at least , even when all failure events depend on the same observations. The numbers are upper allowances; adding them is not a calculation of the exact failure probability.
For three requirements, give each a failure-probability budget . The total budget is , so simultaneous success has probability at least . On a sample space of twenty equally likely outcomes, let , , and . These disjoint events attain the budget and the success bound. If instead all three failure events equal , their individual probabilities are unchanged, but exact failure has probability and simultaneous success has probability . This second model shows how overlap can leave the guarantee conservative.
Figure 1.
A shared failure-probability budget covers both separate failures and one common failure
. The two panels each have twenty equally likely numbered outcomes. The blue, orange, and purple marks identify membership in , , and , respectively. Their individual probabilities are in both panels. The union has three outcomes on the left and one on the right, while the union bound is in both. The event of simultaneous success is the complement of an event of any failure and contains seventeen or nineteen outcomes. These are illustrative probability models, not measured failure rates. Details.
For requirements, an equal allocation is convenient; unequal allocations also work when some requirements are harder to satisfy. For infinitely many requirements indexed by , the allocation uses total budget by the geometric series. A fixed positive allowance for every requirement instead gives an infinite sum and no positive simultaneous-success guarantee from the union bound. The individual probability bounds must cover all the failure events being combined: omitting possible failure modes leaves the resulting guarantee about the listed requirements only. The same addition of error allowances underlies the Bonferroni correction in simultaneous hypothesis tests.
Fano's inequality Created 2026-09-29 Updated 2026-10-14
Fano's inequality turns remaining uncertainty into a constraint on decision errors. If an observation leaves many plausible answers, a decoder cannot usually recover the answer reliably. Its elegant idea is to separate two uncertainties: whether the guess was wrong, and which alternative was correct when it was wrong.
Let be discrete random variables, with taking values in a finite alphabet of cardinality . Choose any deterministic decoder whose output lies in , and define its average error probability . With base-two logarithms, Fano's inequality states
Here is conditional entropy and is binary entropy, with at the endpoints. Both sides are measured in bits; using natural logarithms throughout gives the same inequality in nats. No uniform source, independence of , or optimality of the decoder is assumed. Requiring its output to belong to the same alphabet is what leaves at most alternatives after an error.[ref]
For an exact toy example, give the discrete uniform distribution on . A channel reports with probability and reports each of the other three symbols with probability , where . Use the decoder . The output is uniform, and the conditional probabilities after any report are
Thus and direct calculation of the conditional entropy gives
This is equality in Fano's inequality for every . At , each report leaves probabilities , up to their order, and bits. The two contributions are bits for the error flag and bits for identifying the correct alternative after an error. These are theoretical probabilities, not measured data.
Figure 1.
A symmetric four-symbol toy channel makes every step of Fano's bound an equality
. Details.
The identity decoder in this example minimizes error only for : its guessed symbol has the largest posterior probability exactly when . At , are independent random variables and all four guesses tie. For , guessing any one of the three other symbols has error probability . Equality in Fano's inequality therefore does not certify an optimal decoder.
For usefulness, combine with to obtain the simpler consequence
For a uniform , , so this becomes . This connects mutual information to unavoidable decision error in channel coding or classification in statistical learning; it can rule out reliable recovery regardless of the chosen decoder.[ref]
The sharper right-hand side increases from zero to on , then decreases: in the interior, . When interpreting the inequality by inverting a curve, use its increasing branch to obtain a lower error threshold. A decoder that chooses a largest posterior probability, as in maximum a posteriori decoding, always has , since the largest of conditional probabilities is at least . Arbitrary decoders can have larger error. In particular, low conditional entropy does not force every decoder to work well: with a fair binary and , the rule has even though . Fano's inequality supplies a constraint, not an exact error prediction for each rule.
Fano's inequality via an error indicator Created 2026-10-06 Updated 2026-10-14
Under the hypotheses of Fano's inequality, let , , and let be the indicator random variable of an error. Its probability of being one is . The in the displayed bound denotes binary entropy in bits. Since is a deterministic function of , . Applying the chain rule for conditional entropy in both orders gives the exact decomposition
The first term is bounded by , because conditioning reduces entropy. For the second term, fix a report : if , then is known; if , then lies among at most other symbols. Maximum entropy on a finite alphabet bounds the latter uncertainty by . Averaging over the reports and the error flag gives
This proves Fano's inequality. Events of zero probability contribute zero to this average, so the proof also covers without assigning a conditional distribution to an impossible event.[ref]
Figure 1.
The four-symbol entropy budget peaks at chance-level error and separates the error flag from the three alternatives
. Details.
The decomposition also explains equality. The first bound is exact when the indicator random variable and are independent random variables: knowing the report does not change the error probability. The second is exact when, for every report with positive error probability, the wrong-symbol conditional distribution is uniform on all alternatives. Both conditions hold in the four-symbol toy channel of Fano's inequality. At , the second condition is vacuous; at , the flag is constant but three alternatives remain, giving . For , there is just one alternative after an error, so the second term vanishes: all remaining uncertainty is whether the single alternative must replace the guess.
Fermi's golden rule Created 2026-10-18 Updated 2026-10-20
For a weak time-independent perturbation switched on at zero time, first-order time-dependent perturbation theory gives a transition probability
The frequency kernel has area and width of order . Against a smoothly varying continuum of final states, it approaches , giving the rate . Using gives the energy form above. One integrates the Dirac delta function against the appropriate density of states; it is not an ordinary finite number for one isolated resonant level.
The time must be long enough to resolve the smooth continuum and short enough that the total transition probability remains small. For continuum variation scale and total rate , the usual window is . A discrete finite spectrum also limits this approximation through its recurrences.
When two density operators are commuting elements, choose a common orthonormal eigenbasis and write , . Their quantum fidelity becomes the classical overlap of the two probability distributions, while their trace distance becomes total variation distance:
This follows by computing the positive square root of an operator entry by entry in the common eigenbasis. For the qubit mixed states and ,
The two contributions to quantum fidelity are about and . In contrast, the chance that two independent computational basis measurements, one on each preparation, print the same label is . That particular event has a specified probability; neither nor is that probability.
Figure 1.
Commuting mixed-state probabilities, square-root overlap contributions to unsquared fidelity F, squared fidelity Fsq, and trace distance D
. Details.
Here trace distance means an equal-prior quantum state discrimination success of by the Holevo–Helstrom theorem. Measuring in the common computational basis and guessing on outcome zero and on outcome one achieves . Also : the pure-state trace distance and fidelity identity is an equality for pure states, rather than a formula for arbitrary mixed states.
A percolation measure has the finite-energy property if, conditional on all exterior states, every prescribed state of any finite collection of sites or edges has positive probability almost surely. This permits finite local modifications within events of positive probability. It is a hypothesis on the measure and does not follow merely from invariance under graph symmetries.
For the uniform-arrival residual mass martingale with total weight , the first crossing of level one happens continuously: its only jumps are downward, and an arrival almost surely misses the finitely many deterministic possible crossing times. Stop at that crossing or at . The stopped values lie between zero and one, and their limit as is the crossing indicator. Optional stopping and dominated convergence identify its probability as . At the strict boundary inequality already fails at time zero.
For a simple symmetric random walk starting at zero, let be its first hitting time of . The infinite mean first passage of a simple symmetric random walk shows that almost surely but . Since , assuming a finite expected value for would let Wald's equation assert , a contradiction. The formal expression is not an allowed use of the theorem.[ref]
Compare . From every surviving position in , three consecutive positive increments force absorption within three steps. Each fresh block has probability of this event, so and . This establishes finiteness before invoking the theorem. If is the average remaining time from position , the law of total expectation gives
so . Symmetry gives equal exit probabilities at and , and , as Wald's equation predicts. This is a small gambler's ruin problem with two absorbing barriers.
Figure 1.
Almost sure stopping can have either a finite or an infinite mean
. Original exact simple symmetric random walk calculation from zero. The left compares survival probabilities for first hitting and first hitting either or ; the right sums these tails to obtain capped average waiting times . These are calculated laws, not simulated measurements. Details.
Even for , each bounded stopping time satisfies . The stopped process tends to almost surely, but its expected value does not tend to . Rare long negative excursions retain the balancing contribution. The existing stopped-walk martingale with almost sure but not L1 convergence explains the related failure of uniform integrability; almost sure convergence alone does not permit exchanging a limit and an expected value.
For , every prescribed state pattern on a finite edge set has positive conditional probability given all exterior states: independence makes it for prescribed open and prescribed closed edges. Thus a positive-probability exterior event remains possible after any finite local surgery. This is the finite-energy property of Bernoulli percolation, and applies equally to dual bond percolation.
For individuals in monogamous families of exactly two offspring, let be mean pairwise kinship coefficient, mean inbreeding and mean kinship of mates. A random distinct offspring pair are siblings with probability . Accounting separately for within-family and cross-family pairs gives the displayed recurrence, while . Random mating makes . Sibling avoidance changes the mating-pair mean; it does not create unrelated founders or stop eventual drift to ancestral identity in a closed finite population.
On the full Cartesian product with its product sigma-algebra, take the coordinate random variables . A product-measurable set is a tail event if and only if membership is unchanged whenever two sequences differ in finitely many coordinates. The measurability condition is essential: invariance alone is not a license to assign a probability to an arbitrary subset.
For the forward implication, fix . An event in cannot distinguish points with the same remaining coordinates. Since a tail event belongs to this sigma-algebra for every , every finite change preserves membership.
For the converse, freeze the first coordinates to zero. The insertion map
is a measurable function for the product sigma-algebras. Thus is a measurable set. Invariance gives , where the coordinate projection discards the first entries. Hence for every . The same argument works on . On a general probability space, coordinates need not admit arbitrary replacements, so the defining intersection of sigma-algebras remains the reliable formulation.
Keep the first pulse's oscillation phase zero and give the second phase in the Driven two-level Rabi model. Its upper off-diagonal Hamiltonian operator entry is . Multiplying the two pulse unitary operators and the free-flight unitary operator gives
The Born rule gives the displayed phase-dependent form using the of the Ramsey fringe envelope. Thus reproduces the existing expression, while turns a resonant transfer maximum into zero transfer. A single pulse's population is insensitive to its drive phase; the second coherent interaction makes their difference observable. An uncontrolled, uniformly random instead averages this probability to , leaving the broad pulse response but removing the dark-flight fringes.
Finite pulses also contribute to the near-resonant frequency slope. For , differentiating at gives . Consequently the phase near resonance is
At the exact resonant slope is . For the plotted parameters ; the near-resonant estimate explains why the exact finite-pulse width below differs from . The slope is exact at resonance under these assumptions, while this width estimate uses the local phase expansion. A velocity distribution requires averaging the full response, not substituting one effective flight time.
Here is an original reproducible finite set with 40 points and 512 coordinates. Let be the first four vectors of the standard basis of . With point indices , generate
The four groups have different centers, and the standard normal random variables perturb all 512 coordinates. Generate the coordinates in row order using NumPy's PCG64 pseudorandom number generator with seed 20261013. Then keep this finite set fixed. A second PCG64 stream with seed 424242 generates a matrix of independent random variables with the standard normal distribution; divide it by to obtain the Gaussian Johnson–Lindenstrauss transform.
For all 780 unordered pairs, compute the distance ratio . In this draw, its minimum is approximately and its maximum , giving a maximum relative error in Euclidean distance of about . The squared-distance ratios instead range from approximately to : their maximum relative error is about . Thus this particular draw fails a 20% distance tolerance. The Johnson–Lindenstrauss lemma does not assert that every draw into 32 dimensions must succeed.
Figure 1.
All 780 pairwise Euclidean distances for one Gaussian map from 512 to 32 dimensions
. Details.
The two bands of original Euclidean distances distinguish pairs within a group from pairs between groups. Their spread after the linear map shows why checking an average distance is insufficient: the Johnson–Lindenstrauss lemma controls every pair. The dashed 20% distance band is an illustrative tolerance, not a confidence interval or a squared-distance band. The affine hull of 40 points has dimension at most 39; 512 is the ambient coordinate count, and no full-dimensionality assumption is required. For this draw the bi-Lipschitz distortion is approximately .
Now keep the same points and draw 48 fresh Gaussian Johnson–Lindenstrauss transforms for each target dimension . NumPy's SeedSequence(314159).spawn(240) supplies distinct PCG64 streams, ordered first by target dimension, then by draw. Each stream generates a new random matrix, normalized by ; no map is a row prefix of another map. Each plotted value is
Figure 2.
Maximum relative distance error over independently drawn Gaussian maps at five target dimensions
. Details.
The observed median maximum relative errors in Euclidean distance are approximately , , , , and , respectively. All pairs fall inside the 20% distance tolerance in , , , , and of the 48 draws, respectively. These are computations on one synthetic finite set, rather than optimal dimension bounds or measured physical data. The displayed quantiles describe the sampled maps; they do not certify a success probability for other sets. Even at 128 dimensions, 13 of the sampled maps fail this tolerance.
The practical benefit is that each point acquires fewer coordinates while its pairwise Euclidean distances can remain useful. The choice of target dimension balances compression, accuracy, and failure probability. For example, a conservative sufficient squared-distance tolerance with and gives by the explicit bound above. Here that exceeds the ambient dimension, so the identity map is better for a certified guarantee. The much smaller dimensions in the plots illustrate observed behavior without claiming that this sufficient bound is sharp.
Consider a finite-duration Markov process with discrete, time-even states coupled to one thermal reservoir at positive temperature . Let include the initial probability of the sample trajectory . Define by reversing the control protocol and initializing it with the actual forward final probability distribution . Write for the same states visited in reverse time order. Require normalized path laws with matching probability support: a path has positive forward weight exactly when its reverse has positive reverse weight. This excludes irreversible forbidden transitions and missing initial states.
Under local detailed balance, with positive heat delivered to the thermal reservoir, the full path-weight logarithm is
The endpoint term is the change in stochastic system entropy; the conditional path ratio alone accounts for the thermal reservoir. Here is the Boltzmann constant. Both terms matter even for a short observation. [ref]
Define the conjugate reverse functional by , so . Summing the path identity over paths with a given value gives the exact finite fluctuation theorem
for nonzero denominator, using probability masses or corresponding probability density functions. This is defined by the paired laws: it need not be the total entropy production obtained by independently restarting the thermodynamic construction for the reverse experiment. A generic driven experiment therefore does not imply .