Maximize over the permitted statistical parameters, with the E-step conditional distribution held fixed.[ref]
Maximum Likelihood from Incomplete Data via the EM Algorithm by Arthur Pentland Dempster and others. Section 2, printed p. 6: general maximization step
A finite mixture model hasFor normal distributions with known common variance and fixed positive mixture weights, only the means are fitted. Dropping terms independent of these candidate means givesThe derivative in is , and its second derivative is . Thus a positive weighted count gives a unique maximizing weighted mean. This is a maximization of the surrogate ; the observed-data log-likelihood need not be concave. Recompute the mixture responsibilities after updating the means. The broader EM for Gaussian mixtures with a common variance also estimates mixture weights and the shared variance. New to topics? Read the docs here!