EM maximization step

ID: em-maximization-step

Maximize over the permitted statistical parameters, with the E-step conditional distribution held fixed.[ref] A finite mixture model has
For normal distributions with known common variance and fixed positive mixture weights, only the means are fitted. Dropping terms independent of these candidate means gives
The derivative in is , and its second derivative is . Thus a positive weighted count gives a unique maximizing weighted mean. This is a maximization of the surrogate ; the observed-data log-likelihood need not be concave. Recompute the mixture responsibilities after updating the means. The broader EM for Gaussian mixtures with a common variance also estimates mixture weights and the shared variance.

New to topics? Read the docs here!