Classical multidimensional scaling
ID: classical-multidimensional-scaling
For a symmetric zero-diagonal dissimilarity matrix , square each entry to obtain and put . Take the eigenvectors of corresponding to its largest positive eigenvalues. Multiplying them by square roots of these eigenvalues gives coordinates. If contains Euclidean distances, is a centered Gram matrix, so retaining all positive eigenvalues reconstructs those distances exactly. Retaining fewer approximates the Gram matrix, not generally the sum of squared errors in raw distances. Negative eigenvalues signal failure of an exact Euclidean representation. Coordinates are unchanged in meaning by orthogonal transformations.
New to topics? Read the docs here!