Factor analysis writes an observation as , where the low-dimensional latent variable describes shared variation. In the isotropic Gaussian model and independently, the observation has covariance .
A model combining a linear observation equation with Gaussian process priors over latent trajectories, allowing shared neural activity and temporal smoothness to be estimated together. Observation-noise assumptions and temporal kernels are substantive choices. The original 2009 demonstration used macaque motor recordings, not episodic-memory recordings.[ref]
Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity by Byron M. Yu and others. 2009, model formulation and motor-cortex demonstration
A latent variable introduced to represent covariance related to a measurement method. Its separation from trait factors depends on indicators and identifying restrictions; labeling a factor as methodological does not establish that interpretation by itself.
A factor analysis evaluating prespecified loading patterns and other measurement restrictions. Testing a model in new data is stronger evidence than selecting it and evaluating its apparent fit using the same data. Model fit alone does not establish construct validity.
Factor analysis used to investigate shared dimensions without fixing the complete loading pattern in advance. Factor count, estimator and factor rotation require justification. A resulting structure is a proposal for further study, not independent confirmation of itself.
An approach to selecting factor or component count by comparing observed eigenvalues with reference values obtained from uncorrelated random data of matching dimensions. The reference must match the intended extraction and correlation approach. John L. Horn proposed a random-variable procedure to assess sampling contributions to the roots.[ref] Use it with substantive interpretation and model assessment rather than as a universal guarantee of a correct factor count.
A common-factor extraction method based on iteratively estimating shared variance and the associated factor loadings. It differs from principal component analysis, whose components summarize total observed variation.
A latent factor is an unobserved coordinate introduced to explain shared variation among measurements. In an orthogonal factor model, latent factors have variance one and are mutually uncorrelated, with coefficients specified by the factor loadings. They differ from a regression factor, which is a categorical predictor. A fitted covariance alone generally leaves the latent factor orientation undetermined; factor rotation gives equivalent representations.
The latent factor vector has mean zero and covariance , the specific errors have mean zero and diagonal covariance , and the two are uncorrelated. Thus the off-diagonal covariance is explained by shared factors. Normality additionally gives a likelihood model, but the covariance identity needs only these second-moment assumptions. Positive diagonal entries of describe variation not explained by the factors. Unlike principal component analysis, the model separates shared and specific variation rather than only maximizing total projected variance.
An orthogonal rotation of factors leaves unchanged and hence preserves the model covariance. It proves rotational nonidentifiability of the unrestrained factor loadings. Choose an orientation for interpretability, for example varimax rotation, or impose identifying restrictions in a confirmatory model. An oblique transformation permits correlated factors: if becomes , their covariance becomes , preserving the same shared covariance.
A representation of a factor solution allowing correlated latent factors. If and is invertible, replacing by and by preserves the shared covariance when the factor covariance matrix changes accordingly. Report factor correlations as well as loadings.
An orthogonal factor rotation maximizing, over factor axes, the variance across variables of their squared loadings. It seeks an interpretable pattern with some large and many small loadings on each factor without changing the covariance fit.
The communality is the variance of the shared-factor contribution to variable . In an orthogonal factor model, , where is its specific variance. For standardized variables, . It measures variance shared through the modeled factors, not variance in a chosen principal component.
A factor loading is the coefficient of latent factor in observed variable . In the orthogonal factor model, . If has variance one, this is also its correlation with the variance-one factor. Its sign and size depend on the factor-coordinate convention; factor rotation preserves the implied covariance while changing individual loadings.
In factor analysis with one factor and fixed noise variance , let be the current loading vector, , and . The expectation-maximization algorithm update isThe conditional factor means are and their variances are ; maximizing the expected complete-data log-likelihood gives the formula.
Articles by others on the same topic
Factor analysis is a statistical method used to identify underlying relationships between variables in a dataset. Its primary goal is to reduce the dimensionality of the data while retaining as much variance as possible. Essentially, factor analysis helps to uncover latent (hidden) factors that can explain the observed correlations among variables. ### Key Components of Factor Analysis: 1. **Variables**: The original observable variables in the dataset (e.g., survey responses, test scores).