High explained variance need not preserve class information under PCA

ID: high-explained-variance-need-not-preserve-class-information-under-pca

Let be independent balanced variables with values , and let with and class . Then and . The first principal component is the first coordinate and explains of total variance. Yet it is independent of , so even the best classifier using only that coordinate has accuracy . The second coordinate determines exactly. Taking arbitrarily large makes the retained variance approach one without improving class accuracy. Adding a constant baseline to each coordinate preserves the centered result and permits positive neural rates.

New to topics? Read the docs here!