Sudakov-Fernique inequality
ID: sudakov-fernique-inequality
For centered multivariate normal distributions, if for every pair, then the displayed comparison holds. For a quick proof, make independent and set . Apply Gaussian integration by parts to . With softmax function weights and , the derivative of is . Since , let . Singular covariance matrices follow by adding identical small independent normal noise to both vectors and taking a limit.
New to topics? Read the docs here!