First distinguish a complete-data calculation, conditional on the missing counts, from optimization of the observed-data likelihood. Introduce death counts , survivor counts , observed recapture counts and unobserved-alive counts . Terms involving these probabilities in the complete-data log likelihood areThe survival score is and the detection score is . Their derivatives are nonpositive, and strictly negative whenever their respective total counts are positive. The interior roots, with boundary interpretations if a success or failure count vanishes, are thereforeSubstituting the survivor and unobserved-alive totals givesThese are the requested complete-data maximizing ratios. Here denotes the terminal missing count discussed in part (b); pre-release cells and nonexistent release cohorts contribute zero. If a denominator is zero, the likelihood is constant in that parameter rather than defining a estimate. Also does not occur in this likelihood and has no identified maximum. With unobserved , these ratios alone do not yet supply an observed-data estimate; the EM algorithm below supplies the missing-count expectations.
The consistent missing-data interpretation is that each never-recaptured individual either dies in an interval or survives unobserved through the final occasion. Define the known never-recaptured total and its allocation byThe terminal cell is the source's separately named . The printed identity equating that cell to the total observed recaptures is inconsistent with the supplied multinomial law. In particular, with no observed recaptures its printed value would be zero even though the terminal-cell probability is positive at interior parameters. The displayed accounting identity repairs that notation and makes all sums through well-defined.
For an individual released at , define the unnormalized probabilitiesThe empty product is one. Each intermediate factor means surviving an interval and avoiding its subsequent detection; the death weight additionally includes failure to survive interval . Let . This is the probability of never being recaptured. It is the source's normalizing constant , renamed to avoid confusion with the detection-success counts above. Conditional on no recapture, division by gives precisely the supplied multinomial distribution cell probabilities.
Initialize an interior parameter vector . At iteration , the E step of missing-count EM for capture-recapture computes, for every cohort and missing cell,If , set every missing count to zero without dividing, even if . If and , that parameter vector gives zero probability to the observations and cannot be used in the E step. These expected counts sum to , preserving each cohort's observed accounting. The E step is conditional expectation, not replacement by the modal missing counts or a single random imputation.
The expected complete-data log likelihood is linear in the missing counts, apart from count-only terms irrelevant to the new parameter values. In the M step substitute these expectations into the success/failure ratios from part (a):andIf an exposure denominator vanishes, retain any admissible value of the unidentifiable parameter. Repeat until the observed likelihood and parameter updates stabilize. The conditional normalizers in the E step are evaluated at the old parameters; maximizing a newly normalized conditional missing-data distribution instead of the expected complete-data log likelihood would be the wrong M step.
One can monitor the observed likelihood directly. The probability of a first recapture at isand successive death, detection and continuation alternatives partition the possibilities, giving . Thus, up to count-only factors,The usual conditional Jensen argument for the EM algorithm makes this likelihood nondecreasing at each exact M step. It does not guarantee a unique global maximum. In this observation scheme the final survival and detection probabilities enter through the product only, so these two probabilities cannot generally be estimated separately without a further constraint. The algorithm remains valid, but may converge to different points on the same likelihood ridge.
With complete counts fixed, the likelihood factor for is . As a function of , normalize it to the density of a beta distribution with parameters . Normalization does not change its maximizing argument. The standard beta-mode formula, when both counts are positive, givesThis uses the standard distribution result without differentiating the likelihood, and introducing the normalized beta kernel does not require adopting a Bayesian prior. If only is zero the maximum is at zero; if only is zero it is at one; if both vanish every probability maximizes the constant factor. For the EM M step the same beta-mode argument applies to the expected, possibly noninteger counts, since positive real beta parameters are allowed.
Articles by others on the same topic
There are currently no matching articles.