Multinomial distribution Created 2026-09-24 Updated 2026-10-14
A multinomial distribution describes category counts from independent trials, each choosing exactly one of categories with the same probabilities . Require to be an integer, , and . If counts the trials in category , then andThe are integers, and the mass is zero for other count patterns. A category with has count zero almost surely, with in this formula. For a specified ordered trial sequence, independence gives the product of numbers ; the multinomial coefficient counts the different sequences with that same count pattern.
For four trials with category probabilities , the count pattern can occur in orders, each of probability . Thus its total probability is . This is a constructed independent-trial example, distinct from drawing four objects without replacement from a ten-object population of composition , where the multivariate hypergeometric distribution gives .
Three category counts from four independent trials: every point fixes the third count through the total
. Details. The diagram shows all fifteen possible count patterns. Coordinates determine ; the triangle is a constraint on integer counts, not a continuous probability density. The mode is , where the probability mass function is largest, but the expected values are not a possible count pattern.
Each single count has a binomial distribution, because recording category versus all other categories reduces every trial to a Bernoulli trial. Consequently,These statements about the joint count model are summarized in Aditya Guntuboyina's lecture notes.[ref]
https://stat238.berkeley.edu/spring-2026/lecturetwelve238spring2026/. Guntuboyina, Berkeley STAT 238, lecture 12: multinomial distribution
Independent trials do not make the resulting counts independent random variables. Within one trial the indicator random variables for two distinct categories cannot both equal one, so their product is zero and their covariance is . Summing over independent trials gives . In the four-trial example, the variances are and the pairwise covariances are . Knowing that all four trials were in the first category fixes the other two counts at zero.
The attraction is that one formula describes any fixed-total list of category counts while preserving the constraint that they add up to . It underlies multinomial likelihood calculations and uniform balls-in-bins allocation. The multinomial aggregation rule lets us merge categories without leaving this family of probability distributions. Allowing independent category counts with an unfixed total instead leads to a different model, related through Poisson-multinomial conditioning.
Past exam of the mathematics course of the University of Cambridge 2013 iii Paper 28 2 Solution 2026-10-07
For an aggregate claims model, let denote one claim size, with expected value and variance . The total is zero when the claim count is zero. Given , independence givesThe law of total expectation and law of total variance, together with for a Poisson distribution, implyThe raw second moment appears because the random count itself contributes to the variance.
Conditional on , the moment-generating function of the sum is . Averaging with the Poisson distribution therefore gives the compound Poisson distribution transformThis is valid wherever is finite. Finite first and second moments alone do not ensure positive exponential moments; for positive claims the corresponding Laplace transform always exists.
For the independent portfolios put and . Their Poisson distribution counts add to a Poisson distribution with parameter . By Poisson-multinomial conditioning, conditional on the total count the first risk count has a binomial distribution with parameters , and the second is the remaining count. Thus one can generate the same total loss by drawing independent risk labels with these weights, then drawing each claim from its label's law. The merged severity has mixture distributionIt follows that has a compound Poisson distribution with count parameter and this severity law. This is the fixed-year version of Poisson superposition of insurance portfolios. Its expected value and variance areAlternatively, multiplying the two independent aggregate Laplace transforms yields wherever finite, confirming the same compound Poisson distribution.
For the retained compound Poisson aggregate under per-claim reinsurance, replace each claim by its retained payment . Assume the retention is measurable, with as usual. The count parameter remains , and the severity law is the pushforward measure of the mixture severity under . Thus the retained compound Poisson aggregate has a compound Poisson distribution with that transformed severity andIts moment-generating function is on its finite domain. For a general retention , zero retained payments can occur and are allowed as compound-Poisson marks; they may equivalently be removed by Poisson thinning. The two specified contracts retain strictly positive payments for strictly positive claims.
Past exam of the mathematics course of the University of Cambridge 2019 ii Paper 1 13J b Solution Created 2026-09-24 Updated 2026-09-29
Write and . Under the model in part (a),and is independent of the price category . The Poisson-multinomial conditioning identity givesMore explicitly, the likelihood function for row factors asThe first factor is the likelihood of the row total and the second is the conditional multinomial likelihood. The free price effect makes the first factor maximal at , while maximizing the remaining factors givesConsequently both fits have the same maximum-likelihood fitted valueHere every row total is , the column totals are , and , so every fitted row isThis factorization is the Poisson trick.
Past exam of the mathematics course of the University of Cambridge 2021 ii Paper 1 13J a ii Solution Created 2026-09-24 Updated 2026-09-25
Letand condition on . The corresponding model for each treatment group isFor
fit1, the additive Poisson means implyso the outcome probabilities are common to all three treatments. For fit2,so each treatment may have its own outcome probabilities.The Poisson trick is Poisson-multinomial conditioning: independent Poisson cell counts, conditional on their total, are multinomial with probabilities proportional to their means. With free treatment main effects, profiling the Poisson likelihood over the group totals gives the multinomial likelihood up to a parameter-independent factor. The Poisson regressions therefore fit these multinomial models and give the same likelihood-ratio comparisons for the outcome parameters.
Conditioning on has positive probability exactly when for an integer . This is the same event as . The addition of independent Poisson random variables gives a Poisson distribution with parameter for the sum. Therefore, for ,Thus . The case is a constant zero random variable. For even, nonpositive, or noninteger , the conditioning event has zero probability, so an event-conditional probability distribution is not specified by the quotient formula. This is a two-component case of Poisson-multinomial conditioning.
