Gibbs variational principle for relative entropy
ID: gibbs-variational-principle-for-relative-entropy
For a probability mass function of full support on a finite alphabet and a real function ,where uses natural logarithms. The unique maximizing probability mass function is the exponential tilt .
New to topics? Read the docs here!