Translate the inequality inside the cumulative distribution function:Differentiating with the chain rule gives the probability density functionalmost everywhere. Translation shifts the probability distribution without changing its shape or its total probability.
For any real , put . Since is integer-valued,Continuity of the cumulative distribution function of therefore givesThe strict inequality matters before using the absence of point masses. The resulting probability distribution is discrete, with probability mass functionThus has no ordinary probability density function with respect to length on the real line. Its cumulative distribution function is a step function; its derivative is zero almost everywhere and does not recover its probabilities. The floor function has converted a density into masses on the integers.
Conditioning on has positive probability exactly when for an integer . This is the same event as . The addition of independent Poisson random variables gives a Poisson distribution with parameter for the sum. Therefore, for ,Thus . The case is a constant zero random variable. For even, nonpositive, or noninteger , the conditioning event has zero probability, so an event-conditional probability distribution is not specified by the quotient formula. This is a two-component case of Poisson-multinomial conditioning.
Using the rate parameter convention for the exponential distribution, independence gives the joint probability density functionFor , the survival probability of the minimum isThus has exponential distribution with rate , andValues of a probability density function at the single endpoint do not affect the probability distribution.
Normalization of the probability density function requires . Hence . It is positive for the given , and the density is nonnegative, so this does define a probability distribution. It is a Pareto distribution with scale and shape .
Percolation theory Created 2026-09-24 Updated 2026-10-14
Percolation theory asks how many local connections must be available before a large connected structure appears. Start with a graph, randomly retain some edges or vertices, and study the resulting percolation clusters. In independent bond percolation, every edge is open with probability , independently of the others. In independent site percolation, the random decisions concern vertices instead. A percolation cluster is a connected component of a graph formed by the available connections; an open path joins two vertices exactly when they belong to the same percolation cluster.
The attraction is that a local rule can produce a global change. One open edge says little about travel across a large graph. Many alternative graph paths can nevertheless make distant connections likely. The model separates the geometry of possible connections from the probability distribution of which connections are usable. This was the central perspective of Broadbent and Hammersley's 1957 paper, which discussed porous solids and disease transmission as interpretations of the same mathematical structure: [ref]
https://courses.physics.ucsd.edu/2019/Spring/physics235/Broadbent_Hammersley.pdf. Percolation processes I: Crystals and mazes, introduction
. Independent bond percolation supplies a simplified model of those systems; the physical interpretation still requires justification of its independence assumptions.For a completely calculable example, consider the four edges around a square and ask whether opposite corners and are connected. There are two graph paths, each using two edges. Each open path has probability . Their events are independent events because the paths share no edges, even though they share endpoints. The inclusion-exclusion principle therefore givesAt , the connection probability is , larger than the for either chosen graph path. Counting all sixteen equally likely edge configurations gives the same answer: two configurations with exactly two open edges, four with three, and one with four connect to . Connectivity benefits from alternative routes; adding their probabilities without subtracting their overlap would count the all-open configuration twice.
Two alternative paths increase the probability of connecting opposite corners
. Details. This finite calculation is already useful for studying redundant connections. The deeper question is what happens as the graph becomes arbitrarily large: does connectivity remain confined to finite percolation clusters, or can an infinite percolation cluster appear? The percolation probability and percolation critical probability make that question precise. A finite picture can illustrate the geometry, but cannot establish the existence of an infinite percolation cluster.
Perfect secrecy Created 2026-09-24 Updated 2026-09-29
An encryption scheme has perfect secrecy when the ciphertext and plaintext are independent random variables, so observing the ciphertext does not change the plaintext's probability distribution.
Photon statistics 2026-10-18
Photon statistics is the probability distribution of the number operator in specified field modes, or the distribution of registered counts in a specified gate. Those distributions agree only for an appropriate ideal measurement. Mode selection, losses, and detector dead time matter. For a one-mode density matrix, andThese two sums already distinguish preparations with the same expected value.
Poisson-Dirichlet distribution 2026-10-14
Poisson process Created 2026-09-24 Updated 2026-10-14
A Homogeneous Poisson process models arrivals at a constant rate . Its counting process counts arrivals in , with . Its paths are right-continuous nondecreasing functions, take nonnegative integer values, and have unit jumps almost surely. The defining Poisson distribution of each increment isIt has stationary increments: the probability distribution above depends on the duration , not the starting time . It also has independent increments: counts in any finite collection of disjoint time intervals are independent random variables. Together these conditions specify the joint count laws, not merely the Poisson distribution at a single time.[ref]
Poisson Processes (Chapter 2). pp. 78-79: counting-process definition and its equivalence to exponential interarrival times
The rate has units of arrivals per unit time; is dimensionless. The Poisson distribution givesFor a toy rate per minute and a duration of minutes, the expected value and variance of the count are both . The probability of no arrival is , and the probability of exactly three is . In two consecutive one-minute intervals, the probability of exactly two arrivals in the first and exactly one in the second is , using independent increments. These are exact model calculations with rounded decimals, not measured frequencies.
Synthetic arrival times and their right-continuous counting path, compared with the exact mean at two arrivals per minute
. Details. The diagram's nine hand-chosen arrivals illustrate a path; the line is an expected value, not a prescribed trajectory. Constant rate does not imply evenly spaced arrivals. Poisson interarrival times connect the count description to waiting, while Poisson thinning explains how independently routing arrivals produces separate streams. This makes the Poisson process useful as a simple arrival model for a queue, provided constant rate and independent increments are plausible. For a deterministic changing rate, use an Inhomogeneous Poisson process; bunching or history-dependent arrivals need additional assumptions. Conditional on , the arrival times are the order statistics of independent uniform distributions on , as developed in Poisson process conditional arrival times.
Polymerization 2026-10-13
Polymerization converts a monomer, or a mixture of monomers, into a polymer: repeated chemical reactions establish a connected molecular chain or network. The central question is how connections form, not merely whether a material becomes solid. Joining small molecules can produce a thread that can be handled, while the individual molecules remain invisible. See IUPAC, Basic Definitions of Terms Relating to Polymers, definition 2.2.
From two liquid layers to a Nylon 6,10 thread: monomers, a constitutional repeating unit, and statistical segments
. Original schematic of the authored UCSB polymerization demonstration described below. Chemical formulas identify the actual reactants and interior repeat; colored blocks identify their contributions. The lower coarse-graining sketch deliberately groups three repeats per model segment. Shapes, sizes, and that grouping are illustrative, not measured molecular geometry or a fitted Kuhn length. Details.In step-growth polymerization, complementary reactive groups on monomers and on shorter or longer chains can react with one another. A two-unit chain can join a three-unit chain to make a five-unit chain; growth does not require a specially active end to add only free monomers. An example is the Nylon 6,10 reaction of with : each amine end can form an amide connection with an acid-chloride end, with formal elimination of . Both reactants have two suitable ends, allowing repeated joining. See Paula Hammond, MIT 10.569 lecture 2: step-growth joining and Hammond, lecture 5, p. 4: acid chloride–amine reaction.
In chain-growth polymerization, a monomer reacts with an active site on a growing chain, and the growth step regenerates an active site. Schematically, , where counts incorporated monomeric units and the star denotes reactivity rather than a particular electric charge. Ethene forming polyethylene is an example: the double chemical bond is converted into single chemical bonds as the carbon backbone grows. Initiation creates the active chains; subsequent reactions can deactivate them or transfer reactivity to another molecule. See IUPAC: chain polymerization and John McMurry, Organic Chemistry, 31.1: chain growth. Whether growth is stepwise or carried by an active site is a different question from whether small byproducts are released: chain-growth polymerization can also release them.
A motivating experiment: drawing nylon from a liquid interface. Feldwinn's UCSB demonstration places of an aqueous chemical solution of hexamethylenediamine, , in a beaker, then gently adds of sebacoyl chloride, , in an organic solvent. The procedure specifies hexane; other parts of that handout list cyclohexane. The layers remain separate. The instructor catches material at their interface with tweezers and winds it slowly onto a glass rod; the handout reports continued spooling of Nylon 6,10. It specifies freshly prepared acid-chloride chemical solution and washing the thread before touching it. These are observations and conditions of a supervised laboratory demonstration, not measurements of chain lengths. See Feldwinn, UCSB Demonstration Library, Demo 044, pp. 1–3.
The mechanistic interpretation is that the monomers encounter one another near the interface, where amide connections produce the film; withdrawing it exposes a region where more material can form. An authored research demonstration independently reports a rapidly formed interfacial film collapsing into a thread on withdrawal, using cyclohexane and an aqueous chemical solution containing potassium hydroxide. See Polymer Day: Outreach Experiments for High School Students, Journal of Chemical Education (2017), nylon demonstration. This is the striking observation: a thread much longer than the beaker can emerge because material is continually supplied to the formation region, rather than because a pre-existing thread was hidden in the liquid.
Useful proposed controls, not results reported in those demonstrations, omit one monomer at a time while retaining the same solvents, liquid amounts, and pulling procedure. The prediction is loss of a renewable drawable Nylon 6,10 film; merely finding cloudiness would not establish polymerization, since other chemical reactions, including acid-chloride hydrolysis, can occur. See McMurry, 21.4: competing acid-chloride hydrolysis. Stopping and restarting withdrawal would probe renewal at the interface. Even successful drawing does not measure the degree of polymerization, establish a chain-length probability distribution, or prove the entire growth mechanism. Chemical identification and a molecular-size measurement would be needed for those stronger conclusions. These controls and limits are inferences from the setup, not invented experimental data.
Why almost complete reaction matters in step growth. For ideal linear step-growth polymerization, assume exactly two reactive groups per starting molecule, equal numbers of complementary groups, only joining of different chains, no rings, no branching, and no loss of chain material. Let count starting monomer molecules, including both reactant species, and let be the fraction of either type of reactive group consumed. There are initially groups of each type, so connections reduce the number of chain-bearing molecules to ; the count excludes small byproducts but includes unreacted monomers. The number-average degree of polymerization, measured in monomeric units, is thereforeThus , , and give , , and . Losing the last fraction of unreacted groups matters enormously. See Hammond, lecture 3: balanced step-growth conversion. This counts residues of both feed species; a Nylon 6,10 interior constitutional repeating unit contains two such monomeric units.
For an feed with initial reactive-group counts, put and now let denote the fraction of the limiting groups consumed. Under the same linear, no-ring assumptions, and , givingFor , even complete consumption of gives . Stoichiometry controls chain length as well as yield. See Hammond, lecture 2, pp. 2–3: stoichiometric imbalance. The liquid-interface demonstration is not a homogeneous, balanced reactor, so its thread length cannot be inserted into this formula as a molecular chain length.
Two ideal degree of polymerization counts: late growth in step-growth polymerization and fixed-chain growth in ideal living polymerization
. Toy analytic curves, not measured data. Left: , with the limiting-group conversion and the initial reactive-group ratio. Right: , with the fraction of feed monomer molecules incorporated and their initial number per initiated chain. The two horizontal axes count different entities; the right plot represents a special ideal model, not all chain-growth polymerization. Details.A contrasting chain count. In ideal living polymerization, assume no chain termination or irreversible chain transfer, all chains initiated before the counted growth, one chain per effective initiator, a fixed chain count , and every consumed monomer molecule incorporated into those chains. If is the initial number of feed monomer molecules and their incorporated fraction, conservation gives in monomeric units, excluding initiator fragments. For , incorporating half the feed gives . If initiation consumes one monomer molecule per chain, the fixed-chain interval starts at , rather than . See Hammond, lecture 21, p. 1: ideal living-chain count. The mean does not imply identical chain lengths. Living polymerization does not require reversible loss of monomers; the defining absence of chain termination and irreversible chain transfer is explained in Devon Shipp, IUPAC Polymer Education workshop, Radical Polymerizations II, slide 50. Ordinary chain-growth polymerization with new chains, termination, or transfer need not follow the straight line.
The useful connection is between local chemistry and a macroscopic material: selecting reactive ends and their proportions controls connectivity, while the resulting polymer's conformation is a separate problem described by models such as the freely jointed chain or Gaussian chain. Formation of chemical bonds, the count of monomeric units, and the count of statistical segments must be kept distinct.
Population mean 2026-10-25
The expected value of a numerical characteristic under the target population's probability distribution, when it exists. A sample mean estimates this fixed statistical parameter from observed data; it is not itself the population value.
Population risk Created 2026-09-29 Updated 2026-10-14
The population risk of a prediction rule is its expected loss on a fresh observation from the target probability distribution.
Split the units into visible units , whose patterns occur in the training data, and hidden units . Let be the empirical probability distribution and maximize the average log-likelihood , where . The positive phase clamps to data and averages over ; the negative phase releases all units and averages over . The displayed difference uses these two expectations. When both units are visible, the positive pair product is supplied directly by the data.
For a proof, write . Differentiating each finite sum gives, respectively, and . Since , subtraction proves the rule. Similarly . A small positive step along these gradients increases log-likelihood. The negative term suppresses associations overproduced by the model; strengthening observed pairs alone misses this correction. The identity requires equilibrium expectations; estimates from insufficiently mixed sampling can give a biased update.
Potential theory Created 2026-10-06 Updated 2026-10-13
Potential theory studies harmonic functions, subharmonic functions, and the Laplace operator, including harmonic measure, regular boundary points, and the Dirichlet problem. The Brownian representation of the Dirichlet problem connects these analytic objects with exit probability distributions.
Probabilistic number theory 2026-10-06
Probabilistic number theory studies arithmetic functions and integer sets through probability distributions, concentration, and limit theorems.
Probabilistic programming Created 2026-10-24 Updated 2026-10-31
Probabilistic programming expresses a probability model as an executable program with random choices and observations. Executing the generative part induces a probability distribution; observations then restrict or weight executions, and inference computes the resulting conditional distribution. Program syntax and inference algorithm are separate choices: the same model can be evaluated by rejection sampling, importance sampling or Markov chain Monte Carlo.
Probabilistic use of Hölder's inequality 2026-10-18
On a probability space, the same inequality readsIf the displayed moments are finite, the product is an integrable random variable. The random variables can be dependent: the estimate controls their possible overlap without assuming a factorization of the expected value. This is useful when a calculation needs the product to be integrable but the joint probability distribution is complicated.
Probability distribution Created 2026-09-24 Updated 2026-10-18
A probability distribution describes how the values of a random variable are allocated among possible outcomes. More precisely, the law of a random variable assigns each measurable set the probabilityIt is a probability measure on the values of . The underlying experiment can be more elaborate than the output: different experiments may produce the same probability distribution. The law of a random variable retains the probabilities needed to answer questions about that output. [ref]
https://ocw.mit.edu/courses/6-436j-fundamentals-of-probability-fall-2018/9797310bed4c7f5b5d40d007783eec8d_MIT6_436JF18_lec04.pdf. MIT Fundamentals of Probability, Lecture 4: random variables and their laws
.For a finite example, let take values with probability mass function , , . Its probabilities sum to one. The event has probability , whereas has probability : including one endpoint matters when it carries positive probability.
For a contrasting random variable , choose the probability density function on , and zero elsewhere. It integrates to one. Now , while every single outcome has probability zero. The probability density function can have height : probabilities come from integrals over outcome ranges.
The cumulative distribution function answers all threshold questions for a real random variable, regardless of whether there are jumps or a probability density function. A quantile function reverses the direction of the question: given a cumulative probability level, find a threshold. This connects descriptive summaries to inverse transform sampling, which constructs a chosen probability distribution from a uniform distribution.
Probability generating function Created 2026-09-24 Updated 2026-10-18
For a nonnegative integer-valued random variable , write . Its probability generating function packages the entire probability mass function into one power series:This domain is guaranteed, even for complex , because . At the constant monomial is one, including when : the convention here gives . Also . The power series may converge beyond this domain, but that needs an additional argument. Encoding a probability distribution this way turns convolution of independent random variables into multiplication.[ref]
Random: Probability, Mathematical Statistics, Stochastic Processes by Kyle Siegrist. Expected Value, §6 Generating Functions, Basic Theory, The Probability Generating Function: definition, absolute convergence, inversion, and the independent-sum identity




