Reject the empty string, because the given formula would divide by zero and no normalized probability distribution exists on its empty observed support. Remove repeated characters from The probability mass function is an empirical probability distribution:Every character occurrence contributes exactly once to the total count, so the probabilities sum to one. Absent characters have count zero. For
getDom, but include all their occurrences when computing probability.class DistFromString(s: String) extends FiniteDist[Char] {
require(s.nonEmpty)
private val chars = s.toList
private val dom = chars.distinct
def getDom: List[Char] = dom
def getProb(x: Char): Double =
chars.count(c => c == x).toDouble / chars.length.toDouble
}"Scala", the support is List('S','c','a','l'), with probabilities respectively. Here Char means the language's UTF-16 code unit, matching the supplied interface rather than assuming one Unicode code point per element.The are independent Bernoulli random variables with success parameter . Their sum has the binomial distribution , whose probability mass function isChoose the successful events in ways; independence gives the same product probability for each choice. At or , interpret the formula by its degenerate distribution or by continuity.
Summing the probability mass function of the binomial distribution up to the largest permitted integer givesThe floor is implicit in the original integer-indexed sum.
For a nonnegative integer-valued random variable , its probability generating function isAt , use so . The series also converges absolutely for complex ; for near zero, its coefficients recover the probability mass function.
The exponential series gives . Thus the normalization constant for the Poisson distribution isEvery value is nonnegative, and their sum is . Hence this is a valid probability mass function.
For any real , put . Since is integer-valued,Continuity of the cumulative distribution function of therefore givesThe strict inequality matters before using the absence of point masses. The resulting probability distribution is discrete, with probability mass functionThus has no ordinary probability density function with respect to length on the real line. Its cumulative distribution function is a step function; its derivative is zero almost everywhere and does not recover its probabilities. The floor function has converted a density into masses on the integers.
Since , its finite expected value satisfies . Every is nonnegative andThus these values are a probability mass function. They define the size-biased distribution of : larger values receive proportionally more weight.
Subtract the first three values of the probability mass function of the Poisson distribution from one:
For a Poisson distribution with parameter , the probability mass function isand is zero at all other values. Its normalization follows from the exponential series .
By the preceding convolution, has a Poisson distribution with parameter . Directly from its probability mass function, shifting the index in the absolutely convergent sums gives and . Since , . This is also the identity .
This is the ordinary factorial of , rather than a falling-factorial moment. Substituting the probability mass function of the Poisson distribution gives the nonnegative seriesThe geometric series converges exactly when . Therefore for . For , its terms fail to tend to zero and the expectation is infinite. This is the factorial of a Poisson random variable.
In the uniform balls-in-bins allocation, each ball enters box 1 independently with probability . Thus has the binomial distribution , with probability mass functionand zero outside that range.
For each integer , the events , indexed by the integers , are disjoint and their union is . Therefore countable additivity gives the marginal probability mass functionThe nonnegative terms make this sum well-defined, even when the support is infinite.
Poisson binomial distribution 2026-10-14
The sum of independent Bernoulli random variables with possibly unequal success probabilities has a Poisson binomial distribution. Its probability generating function is : expand the product to read off the probability mass function. Linearity of expectation and additivity of variance for independent random variables give and . Equal recover the binomial distribution.
For three trials with success probabilities , expanding gives masses at . Their expected value is and variance is . Replacing all three success probabilities by their average preserves the expected value but gives binomial distribution variance , so it does not preserve the law.
Poisson distribution Created 2026-09-24 Updated 2026-10-14
For , a Poisson random variable has probability mass functionThe exponential function series verifies normalization. At , define with certainty. The equality of mean and variance is a distinguishing model property, though it does not by itself characterize the law.
When counting events in a homogeneous Poisson process, distinguish its rate from the distribution parameter: an interval of duration has . A rate measured per minute times a duration measured in minutes gives a dimensionless expected count. This process assumes independent increments, a constant rate, and a negligible chance of multiple events relative to interval length in a sufficiently short interval. A rate alone does not establish a Poisson distribution. See Bertsekas and Tsitsiklis, chapter 6 summary, pages 46-47.
For a constructed arrival model with events per minute over minutes, . The mean and variance are both three, andThe probability of at least one event is . These results describe the specified process, not every arrival mechanism with the same average rate.
The Poisson limit theorem, often called the law of rare events, connects this law to the binomial distribution. Keep fixed and let for integers . For each fixed nonnegative integer and sufficiently large ,There are more opportunities, each less likely to succeed, while the mean stays and the variance approaches . For , the probability of three successes is at , at , and at , approaching the Poisson distribution value .
The panels show the same count scale and the same Poisson distribution reference. At , is not especially small and the difference is visible. No universal trial-count cutoff guarantees an adequate approximation for every event.
The independence assumption matters even when every success is rare. For , if all indicator random variables equal one shared Bernoulli random variable of parameter , their sum is zero with probability and with probability . Its mean is three, yet its zero-count probability tends to one, not . Some dependent counts still admit approximation through the Stein-Chen method, but this requires additional control of dependence.
For historical orientation, the BnF records Poisson's original probability treatise, Recherches sur la probabilité des jugements, as published in Paris in 1837. This bibliographic fact alone does not establish when the modern distribution terminology arose. See BnF record of Poisson's 1837 treatise.
Poisson thinning Created 2026-09-24 Updated 2026-10-14
Poisson thinning splits a Poisson process by independently marking each arrival as retained or rejected. Let the original Homogeneous Poisson process have rate , and let be a deterministic measurable function of time. Attach independent uniform distributions on , independent of the entire original Poisson process. At arrival time , retain the arrival if . Given all arrival times, these decisions are independent and have the specified retention probabilities. Define the two counting processes using an indicator function:The Poisson thinning theorem gives independent retained and rejected Inhomogeneous Poisson processes. Their rates are and , respectively, in the sense of the intensity function of a point process. In particular, for ,The independence is of the two whole processes: every finite collection of retained counts is independent of every finite collection of rejected counts. It is not merely zero covariance for one interval. For constant , the streams are Homogeneous Poisson processes of rates and ; the endpoints include the identically zero stream.[ref]
Lectures on the Poisson Process by Günter Last and others. Definition 5.7, Proposition 5.5, Theorem 5.8 and Corollary 5.9, printed pp. 42-44: location-dependent independent marking, intensities, and independence of the split processes
For an exact toy calculation, take per minute and retain with on and on . In the first two minutes, the retained and rejected expected values are and . In the next two minutes they are and . Over all four minutes, are independent Poisson distributions with mean each, and their sum has mean . ThusThese probabilities and expected values describe the model, not empirical measurements. In the diagram, the original nine synthetic arrivals split into five retained and four rejected arrivals; those realized counts need not equal their expected values.
Independent marks split a synthetic Poisson arrival path, with exact expected counts for two time-dependent retention probabilities
. Details. The mechanism explains why mutually exclusive labels can yield independent counts: randomness of the original total offsets the dependence from allocating a fixed total. For constant and an interval with original mean , the conditional retained count has a binomial distribution given . The joint probability generating function isThis factorization proves the two independent Poisson distributions; disjoint original intervals give independent pairs. For varying , the Independent marking theorem for Poisson point processes gives the same conclusion with the two integrated intensities. The joint red and green Poisson count formula gives the corresponding direct calculation with probability mass functions.
Independence here is unconditional. After conditioning on , the identity gives covariance for constant . Thus the retained and rejected counts are dependent for and , even though their unconditional covariance is zero. Poisson thinning can model independent routing of arrivals, or independent detection of arrivals with a known efficiency schedule; using only a retention fraction without checking the marking mechanism can give a wrong count law.
Power-law distribution 2026-10-14
A power-law distribution uses a power law for a probability mass function or a probability density on a specified range. For a continuous model with on and zero below it, the total integral is finite exactly when . Normalization then requires , giving a Pareto distribution with shape parameter . Discrete models instead normalize a sum. The support and normalizing coefficient are part of the model, and a power law for its tail probability uses a different exponent from its probability density.
Prior probability Created 2026-09-24 Updated 2026-10-14
Prior probability describes uncertainty before the current observations are incorporated. For a statistical parameter , a prior distribution assigns probabilities to its possible ranges, conditional on background information and a statistical model. A continuous prior density specifies these probabilities through integration:Here the probability density function is relative to Lebesgue measure ; a discrete prior distribution instead uses a probability mass function and sums. Density at one point is not the probability of that point. A nonnegative kernel with infinite total mass is an improper prior, whose use requires a separate check of posterior propriety.
For the coin model in Bayesian statistics, the beta distribution has prior density on . Its mean is and its variance is . It favors moderate heads probabilities without ruling out values near zero or one. For example,The prior curve in Bayesian posterior makes this preference visible; moment matching for a beta prior explains how to choose a beta distribution from a desired mean and variance.
A prior distribution lets earlier evidence or elicited knowledge contribute to statistical inference when the current sample size is limited. It also exposes assumptions that can be checked by prior elicitation and a prior predictive check. Before the same eight heads and two tails, a uniform prior would give posterior mean , compared with under : the observations do not uniquely determine a Bayesian posterior. Even a uniform prior makes a choice of parameter coordinates; its child article explains why changing coordinates can destroy uniformity.
Probability distribution Created 2026-09-24 Updated 2026-10-18
A probability distribution describes how the values of a random variable are allocated among possible outcomes. More precisely, the law of a random variable assigns each measurable set the probabilityIt is a probability measure on the values of . The underlying experiment can be more elaborate than the output: different experiments may produce the same probability distribution. The law of a random variable retains the probabilities needed to answer questions about that output. [ref]
https://ocw.mit.edu/courses/6-436j-fundamentals-of-probability-fall-2018/9797310bed4c7f5b5d40d007783eec8d_MIT6_436JF18_lec04.pdf. MIT Fundamentals of Probability, Lecture 4: random variables and their laws
.For a finite example, let take values with probability mass function , , . Its probabilities sum to one. The event has probability , whereas has probability : including one endpoint matters when it carries positive probability.
For a contrasting random variable , choose the probability density function on , and zero elsewhere. It integrates to one. Now , while every single outcome has probability zero. The probability density function can have height : probabilities come from integrals over outcome ranges.
The cumulative distribution function answers all threshold questions for a real random variable, regardless of whether there are jumps or a probability density function. A quantile function reverses the direction of the question: given a cumulative probability level, find a threshold. This connects descriptive summaries to inverse transform sampling, which constructs a chosen probability distribution from a uniform distribution.
Probability generating function Created 2026-09-24 Updated 2026-10-18
For a nonnegative integer-valued random variable , write . Its probability generating function packages the entire probability mass function into one power series:This domain is guaranteed, even for complex , because . At the constant monomial is one, including when : the convention here gives . Also . The power series may converge beyond this domain, but that needs an additional argument. Encoding a probability distribution this way turns convolution of independent random variables into multiplication.[ref]
Random: Probability, Mathematical Statistics, Stochastic Processes by Kyle Siegrist. Expected Value, §6 Generating Functions, Basic Theory, The Probability Generating Function: definition, absolute convergence, inversion, and the independent-sum identity


