Second moment of a mixture likelihood ratio
ID: second-moment-of-a-mixture-likelihood-ratio
If and the nonnegative mixture weights sum to one, the likelihood ratio of the mixture model is . Expanding proves the displayed chi-squared divergence identity. For independent random variables sampled from a fixed component, one-observation cross moments multiply across observations. The component is drawn once for the whole sample; redrawing it per observation gives a different mixture model.
New to topics? Read the docs here!