For independent one-stop negative multinomial distribution observations, the natural estimates are and . Their sum is with strictly concave , so Jensen's inequality makes its expectation strictly below . Conditional category proportions split this bias between both estimates. With zero observed counts of a category, that estimate lies at zero; in a parameter space requiring strict positivity the likelihood supremum is not attained.
Write . Differentiating the probability generating function at gives
Expanding its denominator as a geometric series and then applying the binomial theorem gives
Coefficient identification proves , a one-stop negative multinomial distribution.
For an independent identically distributed sample let and . Ignoring parameter-independent factors, the log-likelihood is . When both sums are positive, its stationary equations are and . Together with , these give
The Hessian is , negative definite in this case, so the stationary point is the unique global maximum.
There is an important boundary qualification: if , the derivative with respect to is , so the likelihood increases as decreases to zero. The displayed formula then gives a boundary estimator, not an attained MLE in the stated open parameter space . The analogous issue holds for . The formulas are MLEs on the extension allowing zero category probabilities, and interior MLEs when both counts are positive.
For bias, put and . Then and with . Its second derivative is , and is nondegenerate. Strict Jensen's inequality gives
In fact both estimates are downward biased. Conditional on , the first count is binomial with success probability ; hence conditional on , is also binomial with that probability. Therefore
This proves the finite-sample bias in a negative multinomial probability estimator, using the boundary-extended formulas whenever necessary.
Finally, the strong law of large numbers applies because the nonnegative variables have finite means: almost surely and . Continuity of the estimator function then gives
and similarly for . Thus the estimates are strongly consistent despite finite-sample bias. Almost surely both sample sums eventually become positive, so the open-parameter MLE issue affects finite samples rather than this asymptotic conclusion.