Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2007/ii/paper-2/5i/solution

The independent Laplace distribution responses have log likelihood
For every fixed positive , maximizing this expression means minimizing the sum of absolute residuals. Thus is a least absolute deviations estimate, not a least-squares estimate. Such a minimizer exists: minimize the distance in the finite-dimensional closed column space of the design matrix. It need not be unique if the data or design allow multiple minimizers.
Write . For , differentiating the profiled log likelihood gives . Its unique maximum is
If the fitted residual sum is zero, the likelihood instead increases without bound as : there is no joint maximum with the stated positive scale parameter. The displayed estimate then denotes the boundary limit, not an admissible positive-scale MLE.
An ordinary exponential dispersion family has log density , so changing the mean changes the log density by an affine function of . For two distinct Laplace locations , their log-density difference is , with different slopes on the intervals separated by the two locations. It is not affine in . Equivalently the kink at moves with the parameter. The Laplace location family is not an ordinary exponential dispersion family.

New to topics? Read the docs here!