Past exam of the mathematics course of the University of Cambridge 2009 ii Paper 1 5I Solution Created 2026-09-24 Updated 2026-10-14
The logit link gives . Independence in the Bernoulli logistic-regression model therefore gives the log-likelihoodDifferentiate using :The maximum-likelihood estimator, if finite, solves the single score equation . If at least one is nonzero, the log likelihood is strictly concave at finite , so any root is the unique maximizer.
Use Newton method, equivalently one-parameter iteratively reweighted fitting:A damped step or a bracketed score solver is useful if a full step overshoots. The finite maximum-likelihood estimate in a one-parameter logistic model requires the score limit at minus infinity to be positive and its limit at plus infinity to be negative. Perfect sign separation of the observations can instead send the estimate to an infinite coefficient; if every , the coefficient is unidentifiable. These possibilities should be checked before claiming convergence to a finite estimate.