A Poisson distribution has probability mass , where . It is an exponential family with , mean and variance . The responses are independent, their linear predictors are , and the log link relates these predictors to their means. These are precisely the components of a generalized linear model; the log link is its canonical link function and the dispersion is one.
The log-likelihood and score function are
Thus a finite maximum-likelihood estimator satisfies
The Hessian is ; with a full-rank design matrix it is negative definite at finite parameter values, so a finite solution is the unique maximum. A finite maximum need not exist for every possible response/design combination; the displayed equations describe it when it does exist. If the first component of every is one, the first score equation gives .
The saturated model fits each mean as , with the limiting mean zero allowed for a zero count. Subtracting the fitted log-likelihood from the saturated log-likelihood gives the Poisson deviance
where . With an intercept, the sum of the second terms is zero, but retaining them is necessary without that score equation.
Take low pH as a reference level. For group , the model with interaction has
where is biomass. The additive model sets every to zero. The interaction model estimates six parameters and the additive model four. In the additive model the log-mean curves are parallel straight lines, while the mean curves are positive exponentials with fixed ratios . In the interaction model the log-mean slopes differ, and the mean ratio is . The following sketches illustrate common versus factor-specific slopes in Poisson regression; their coefficients are illustrative, not estimates from the data.
Figure 1.
Illustrative Poisson mean curves with common and pH-specific biomass slopes
. Details.
The additive model is nested in the interaction model with two restrictions. The likelihood-ratio test therefore uses
whose p-value is . There is strong evidence that the biomass slope on the log-mean scale depends on pH. The interaction-model residual deviance is close to its residual degrees of freedom, giving no obvious indication of overdispersion from this comparison alone. The supplied deviances contain no slope estimates: they do not establish which pH group has more species, whether each slope is positive or negative, or whether any actual curves cross. Those conclusions require the fitted coefficients and their uncertainty.