Past exam of the mathematics course of the University of Cambridge 2007 ii Paper 4 13I Solution Created 2026-09-24 Updated 2026-10-14
Use the exponential dispersion family convention . For the Gamma distribution, takeSubstitution reproduces the gamma density exactly. Differentiating its normalization with respect to yields and : the first identity follows from zero mean score, and differentiation again gives the variance. ThereforeThe canonical link function is . Some conventions reverse the sign and call the reciprocal link; this only reverses the regression coefficients. We retain the genuine natural parameter .
In the Gamma regression with canonical link, and . Differentiating the independent-observation log-likelihood givesHere , so the negative Hessian equals this information matrix. Fisher scoring or Newton iteration iswith the means and information recalculated at each iteration; damping can preserve and increase the likelihood. Full column rank makes the information positive definite for positive means.
The saturated model has mean . Subtracting fitted from saturated log-likelihood yields the unscaled devianceTwice the actual log-likelihood ratio is . In particular, the printed parenthetical is incorrect for this nonidentity link: estimates , and .