Write and . Conditional independence of the next count given allows us to average its Poisson distribution over the posterior distribution:This Poisson-gamma mixture is the posterior predictive distribution. In the stated negative binomial distribution convention its parameters areIts expected value equals the posterior mean of , while its variance includes both conditional Poisson variation and uncertainty in .
Put . By the law of total probability,For , termwise differentiation of the geometric series, valid inside its radius of convergence, givesTaking therefore yieldsSince , this is the zero-based geometric distribution with parameterThis illustrates Bernoulli thinning of a geometric count. Here , as .
For the reverse conditional distribution, Bayes' theorem gives, for ,ThusFor the conditional probability is zero. The conditional distribution of is the failure-count form of a negative binomial distribution, with successes and success parameter : the geometric-binomial posterior is shifted negative binomial.
Let be the time of the second occurrence of , whether or not it is adjacent to the first. On every digit sequence, completion of a consecutive pair requires at least two occurrences of , so .
The waiting time for the first has mean . Once that digit has appeared, the fresh independent digits give another waiting time with the same mean for the next . Thus , the mean of the corresponding negative binomial distribution. Monotonicity of expectation now proves , without computing the waiting time for the consecutive pair itself. The argument remains valid even before establishing that has finite mean, since these waiting times are nonnegative.
Poisson-gamma conjugacy Created 2026-09-24 Updated 2026-10-25
For conditionally independent Poisson observations of mean and a gamma distribution prior of shape and rate , the likelihood function contributes . Multiplying by the prior density gives a posterior distribution with shape and rate . The single-observation update is shape and rate .
The posterior mean is the convex combinationThus the prior mean and the sample maximum-likelihood estimate bracket it. Integrating the next conditional Poisson distribution against this posterior distribution gives the Poisson-gamma mixture, a negative binomial distribution; its spread includes uncertainty in as well as the conditional count variation.
Poisson-gamma mixture 2026-09-24
If and has a gamma distribution, then has a negative binomial distribution. For gamma shape and scale ,
Poisson mixture Created 2026-10-05 Updated 2026-10-07
A model with for a nonnegative random intensity. Conditional expectation and total variance give and , explaining overdispersion. A Poisson-gamma mixture gives the negative binomial distribution.
Posterior coin count after exactly one head Created 2026-10-07 Updated 2026-10-18
Let have the positive-integer geometric distribution with success parameter , and conditionally toss independent coins with head probability . Exactly one head has conditional probability . Combining this with the prior by Bayes' theorem gives the displayed posterior with ; its normalization uses . For , the posterior is . It is also a shifted negative binomial distribution, with equal in law to the number of failures before two successes of probability .