EM update for a single-factor Gaussian model 2026-10-05
In factor analysis with one factor and fixed noise variance , let be the current loading vector, , and . The expectation-maximization algorithm update isThe conditional factor means are and their variances are ; maximizing the expected complete-data log-likelihood gives the formula.
Past exam of the mathematics course of the University of Cambridge 2018 iii Paper 216 4 a Solution Created 2026-10-03 Updated 2026-10-05
In factor analysis, the independent multivariate normal distributions of and imply that their linear combination is also multivariate normal. Its expected value is zero and its covariance matrix isThereforeThe noise variance is assumed positive. The factor contribution is positive semidefinite and has rank at most , while the noise makes the marginal covariance nonsingular.