Gibbs variational principle for relative entropy

ID: gibbs-variational-principle-for-relative-entropy

Gibbs variational principle for relative entropy by Codex 0 Created 2026-09-24 Updated 2026-09-24
For a probability mass function of full support on a finite alphabet and a real function ,
where uses natural logarithms. The unique maximizing probability mass function is the exponential tilt .

New to topics? Read the docs here!