The binomial distribution counts successes in a fixed number of independent Bernoulli trials with common success probability . Equivalently,Here is a nonnegative integer and . The binomial coefficient counts placements of the successes; each particular arrangement has probability . The binomial theorem makes the masses sum to . At all mass is at zero, and at all mass is at ; these endpoint laws can be read directly without interpreting .
The linearity of expectation and addition of variances for independent random variables giveThe fixed trial count, common success probability, and joint independence are substantive model assumptions. Sampling uniformly without replacement from a finite population instead leads to a hypergeometric distribution. Independent trials with different success probabilities generally give a Poisson binomial distribution. Common marginal success probabilities alone are insufficient: if all ten indicators equal the same Bernoulli random variable with , their sum is zero with probability or ten with probability . Its mean is still three, but its variance is . The standard construction is given in Penn State STAT 504, binomial distribution.
For an exact constructed example, let each of ten independent trials choose uniformly from ten labelled tokens, with replacement, and mark three tokens as successes. Then and . Exactly three successes have probabilityThe mean is , the variance is , and the standard deviation is . Zero successes have probability , so at least one success has probability . A single count calculation replaces enumeration of all equally likely token sequences.
Each bar's height is one probability mass. Three is the most likely count, but its mass is only about : a most likely outcome need not occur most of the time.
For a binomial distribution with parameters and , the binomial theorem gives the displayed moment-generating function, finite for every real . Products of these moment-generating functions show that the sum of independent binomial random variables with the same success probability again has a binomial distribution, with trial counts added.
If independent trials give a specified digit with probability , its observed fraction is with binomial count . Since and , the mean squared discrepancy is the displayed inverse-sample-size law. Dividing by converts it to a relative squared discrepancy without changing the log-log slope. Nested prefixes are correlated; a single deterministic expansion's plotted discrepancies do not prove that its digits are independent or normally distributed in the number-theoretic sense.
For independent random variables with the same binomial distribution , partition the tie event into the mutually exclusive events . Independence makes each probability the square of its binomial probability, proving the formula. At , Vandermonde's identity gives . Symmetry under exchange of the two variables then gives .
The binomial distribution with parameters and assigns the displayed probability to successes, for integers . Each specified sequence of independent trials has probability , and the binomial coefficient counts the sequences with exactly successes. Outside this range the probability is zero.
Let and be independent random variables with binomial distributions and . Conditional on having positive probability, the possible values of satisfy . Their probabilities arewhere the denominator sums over that feasible integer range. The formula follows by multiplying independent binomial probabilities and dividing by the probability of the disjoint union of all feasible count pairs.
For , common factors cancel and the weights are proportional to , where . If , this reduces to the hypergeometric distribution, with probabilities . At parameter endpoints, use the original probability weights and check that the conditioning event has positive probability before dividing.
For with , the sample binomial proportion is . Its expectation is p and its variance is . The central limit theorem gives a normal approximation when both expected outcome counts are sufficiently large. These moments determine a standard error and model-based control limits.
With groups of trials and common marginal failure probability , each count has expectation , so the displayed estimate is unbiased without assuming independence within groups. Independent individual trials give variance . If only groups are independent, estimate the variance instead by , retaining within-group dependence. Equal marginal probabilities alone do not justify a binomial confidence interval.
If and is observed, the maximum-likelihood estimate of is zero. A one-sided upper confidence bound solves , so . For large , , giving approximately at 95% confidence. This describes uncertainty after no observed events, rather than proving that the underlying probability is zero. It assumes independent observations with a common event probability; clustered data require a different uncertainty calculation.
The zero-truncated binomial distribution has probabilities for . Its natural parameter is and its cumulant is . Mean and variance are and , where . The conditional normalizer depends on , so its likelihood is not proportional to the untruncated likelihood even after a positive observation. At and , its likelihood supremum is at rather than at .
For , expand the fourth power of the sum of centered independent Bernoulli variables. Terms with an index occurring once vanish; single-index fourth moments contribute and paired second moments contribute . Their sum is the displayed formula. Scaling by yields a uniform fourth moment for .
For independent Bernoulli observations with success probability , the sample proportion is the success count divided by the sample size. It is an unbiased estimator with variance . It supplies the arm-specific risks in a risk ratio and the mean difference in a two-proportion comparison.
For two independent samples of Bernoulli random variables, the difference of their sample proportions estimates the difference of population probabilities. Since the samples are independent,Substitution of the sample proportions gives a standard error for a large-sample Wald confidence interval. This interval is a descriptive comparison of the specified groups; a causal effect needs further assumptions. Sparse counts and probabilities near zero or one can make the normal approximation poor. Testing equality can instead use a null-pooled estimate of the common probability for the test's standard error.
If successes occur in independent Bernoulli trials, the binomial likelihood for the success probability is proportional to .
Articles by others on the same topic
The Binomial distribution is a discrete probability distribution that models the number of successes in a fixed number of independent Bernoulli trials (experiments with two possible outcomes, often termed "success" and "failure"). This type of distribution is particularly useful in situations where you want to determine the likelihood of a certain number of successes within a series of trials.
