Solution

ID: past-exam-of-the-mathematics-course-of-the-university-of-cambridge/2008/iii/paper-47/6/b/ii/solution

Within the merged third observed cell, the probability of belonging to the original fourth cell is
The allocation therefore has the conditional binomial distribution
Its conditional expectation and the filled-in missing counts are
with and .
Taking the conditional expectation of the complete log-likelihood gives the EM for merged multinomial cells E-step:
This is the parameter-dependent part of . More precisely, , where the constant is independent of the candidate , interpreting factorials of noninteger filled counts through the gamma function. The expected log-factorials are not generally the log-factorials of expected counts, so literal equality including the normalization would be false. Equality up to this constant is exactly what the M-step needs. Filling in conditional means works here because the candidate-parameter terms are linear in the missing counts; it is not a universal rule for the expectation-maximization algorithm.

New to topics? Read the docs here!