For fixed known , take the natural parameter of an exponential family
The negative binomial distribution has log-likelihood
Thus this is a negative binomial exponential family, with dispersion parameter in the convention of part (a). The carrier contains the Gamma function and depends on the fixed size , which need not be an integer. Differentiating the cumulant function of an exponential family gives
Therefore
The size controls overdispersion relative to a Poisson distribution; it is different from the unit dispersion parameter used by this fixed-size generalized linear model. Another common convention applies to the scaled response : then and . Keeping track of the response scale prevents confusing these two representations. At the law is concentrated at zero and is obtained as a boundary limit, rather than by a finite natural parameter of an exponential family.
This is not a valid ordinary R glm family specification. A multinomial distribution is natural for the three damage counts conditional on the row total, but base R's generalized linear model interface does not supply a family named multinomial. Furthermore, the written response is one cell count, not a three-category response or grouped multinomial vector. A properly specified multinomial logistic regression could model category probabilities by group, but it is not the model fit by this command. The independent-count log-linear model in part (a), conditional on the margins, is the appropriate supplied alternative.
This does not model the full three-category response. A binomial distribution has two outcome classes, whereas the observed damage factor has three. In base R, a factor response to a binomial generalized linear model is coded as first level versus all other levels; this would silently collapse the categories. It would also treat the nine table rows as nine individual observations, ignoring the frequencies. A deliberate binary analysis would require specifying the collapse and retaining the counts, but cannot recover the full damage distribution.
Fit a Poisson regression to artificial responses with means
With the logarithmic link, this is the generalized linear model
where is a known offset. Its log likelihood, apart from constants, is
The difference
does not depend on . The Poisson surrogate therefore has exactly the same maximum-likelihood estimate of . This is the Poisson surrogate for an uncensored proportional-hazards likelihood.
For independent observations from an exponential dispersion family with common known dispersion parameter , the generalized linear model log-likelihood is
where and the link function satisfies .
A suitable generalized linear model is a Gamma regression with logarithmic link:
with
The gamma distribution is appropriate for a positive, continuous, right-skewed payment, and its variance function allows the conditional variance to grow like the square of the conditional mean instead of assuming constant variance. The logarithmic link function also guarantees positive fitted means and represents covariate effects multiplicatively, which accords with the Box–Cox transformation evidence for a logarithmic scale.
At a current value , put
and define the working response
Then the displayed formulas in the question can be written compactly as
and
Indeed, the th component of the latter is
which is precisely the stated score.
Substitution into the Fisher-scoring update gives
By part (b), this is the weighted least squares fit of the working response on . Both and are recomputed from the current fitted means after every update. Fisher scoring for a generalized linear model is therefore the iteratively reweighted least squares algorithm.
A generalized linear model assumes independent responses from one exponential dispersion family,
where , , and a link function relates the mean to the linear predictor by . It follows from normalization of the density after shifting the natural parameter that
Independence therefore gives the joint moment-generating function
whenever every shifted natural parameter lies in its natural-parameter domain.
A generalized linear model assumes that the independent responses have distributions in an exponential family, with means , and that
The invertible function is the link function; it connects the mean to the linear predictor.
For binomial regression, write independently, so . The logistic regression link is
while probit regression uses
where is the standard-normal distribution function. The logit is the canonical link function for the binomial family.
The ordinary least squares equations for model 2 are
For the Gamma generalized linear model, and , so its score equation under the logarithmic link is
When is close to ,
by the first-order Taylor expansion of the exponential function. The Gamma score equations then become the model-2 normal equations, so their coefficient estimates are close.
A generalized linear model has three components:
For independent uncensored event times with and baseline cumulative hazard , maximizing the survival log likelihood over is equivalent to fitting a Poisson regression with unit responses and means
Thus a log-link generalized linear model with response , linear predictor , and offset gives the same estimate of .