Multinomial distribution Created 2026-09-24 Updated 2026-10-14
A multinomial distribution describes category counts from independent trials, each choosing exactly one of categories with the same probabilities . Require to be an integer, , and . If counts the trials in category , then and
The are integers, and the mass is zero for other count patterns. A category with has count zero almost surely, with in this formula. For a specified ordered trial sequence, independence gives the product of numbers ; the multinomial coefficient counts the different sequences with that same count pattern.
For four trials with category probabilities , the count pattern can occur in orders, each of probability . Thus its total probability is . This is a constructed independent-trial example, distinct from drawing four objects without replacement from a ten-object population of composition , where the multivariate hypergeometric distribution gives .
Figure 1.
Three category counts from four independent trials: every point fixes the third count through the total
. Details.
The diagram shows all fifteen possible count patterns. Coordinates determine ; the triangle is a constraint on integer counts, not a continuous probability density. The mode is , where the probability mass function is largest, but the expected values are not a possible count pattern.
Each single count has a binomial distribution, because recording category versus all other categories reduces every trial to a Bernoulli trial. Consequently,
These statements about the joint count model are summarized in Aditya Guntuboyina's lecture notes.[ref]
Independent trials do not make the resulting counts independent random variables. Within one trial the indicator random variables for two distinct categories cannot both equal one, so their product is zero and their covariance is . Summing over independent trials gives . In the four-trial example, the variances are and the pairwise covariances are . Knowing that all four trials were in the first category fixes the other two counts at zero.
The attraction is that one formula describes any fixed-total list of category counts while preserving the constraint that they add up to . It underlies multinomial likelihood calculations and uniform balls-in-bins allocation. The multinomial aggregation rule lets us merge categories without leaving this family of probability distributions. Allowing independent category counts with an unfixed total instead leads to a different model, related through Poisson-multinomial conditioning.
For an aggregate claims model, let denote one claim size, with expected value and variance . The total is zero when the claim count is zero. Given , independence gives
The law of total expectation and law of total variance, together with for a Poisson distribution, imply
The raw second moment appears because the random count itself contributes to the variance.
Conditional on , the moment-generating function of the sum is . Averaging with the Poisson distribution therefore gives the compound Poisson distribution transform
This is valid wherever is finite. Finite first and second moments alone do not ensure positive exponential moments; for positive claims the corresponding Laplace transform always exists.
For the independent portfolios put and . Their Poisson distribution counts add to a Poisson distribution with parameter . By Poisson-multinomial conditioning, conditional on the total count the first risk count has a binomial distribution with parameters , and the second is the remaining count. Thus one can generate the same total loss by drawing independent risk labels with these weights, then drawing each claim from its label's law. The merged severity has mixture distribution
It follows that has a compound Poisson distribution with count parameter and this severity law. This is the fixed-year version of Poisson superposition of insurance portfolios. Its expected value and variance are
Alternatively, multiplying the two independent aggregate Laplace transforms yields wherever finite, confirming the same compound Poisson distribution.
For the retained compound Poisson aggregate under per-claim reinsurance, replace each claim by its retained payment . Assume the retention is measurable, with as usual. The count parameter remains , and the severity law is the pushforward measure of the mixture severity under . Thus the retained compound Poisson aggregate has a compound Poisson distribution with that transformed severity and
Its moment-generating function is on its finite domain. For a general retention , zero retained payments can occur and are allowed as compound-Poisson marks; they may equivalently be removed by Poisson thinning. The two specified contracts retain strictly positive payments for strictly positive claims.
Write and . Under the model in part (a),
and is independent of the price category . The Poisson-multinomial conditioning identity gives
More explicitly, the likelihood function for row factors as
The first factor is the likelihood of the row total and the second is the conditional multinomial likelihood. The free price effect makes the first factor maximal at , while maximizing the remaining factors gives
Consequently both fits have the same maximum-likelihood fitted value
Here every row total is , the column totals are , and , so every fitted row is
This factorization is the Poisson trick.
Let
and condition on . The corresponding model for each treatment group is
For fit1, the additive Poisson means imply
so the outcome probabilities are common to all three treatments. For fit2,
so each treatment may have its own outcome probabilities.
The Poisson trick is Poisson-multinomial conditioning: independent Poisson cell counts, conditional on their total, are multinomial with probabilities proportional to their means. With free treatment main effects, profiling the Poisson likelihood over the group totals gives the multinomial likelihood up to a parameter-independent factor. The Poisson regressions therefore fit these multinomial models and give the same likelihood-ratio comparisons for the outcome parameters.
Conditioning on has positive probability exactly when for an integer . This is the same event as . The addition of independent Poisson random variables gives a Poisson distribution with parameter for the sum. Therefore, for ,
Thus . The case is a constant zero random variable. For even, nonpositive, or noninteger , the conditioning event has zero probability, so an event-conditional probability distribution is not specified by the quotient formula. This is a two-component case of Poisson-multinomial conditioning.