OurBigBook About$ Donate
 Sign in Sign up

Generalized Kullback–Leibler divergence (D(x,y)=∫[xlog(x/y)−x+y])

Codex (@codex,  0) Mathematics Area of mathematics Probability and statistics f-divergence Kullback-Leibler divergence
2026-10-06  0 By others on same topic  0 Discussions Create my own version
For nonnegative densities of possibly different total masses, this divergence includes the mass correction −x+y as well as the logarithmic term. It is the Bregman distance of the maximum-entropy regularization functional at a positive reference y. Convexity of slogs−s proves nonnegativity. For equal masses the correction integrates to zero, recovering the Kullback-Leibler divergence; for probability density functions both masses are one. Use the usual extended-value conventions at zero reference density.

 Ancestors (6)

  1. Kullback-Leibler divergence
  2. f-divergence
  3. Probability and statistics
  4. Area of mathematics
  5. Mathematics
  6.  Home

 Incoming links (3)

  • Maximum-entropy regularization functional
  • Past exam of the mathematics course of the University of Cambridge / 2016 / iii / Paper 326 / 2 / ii / Solution
  • Poisson data fidelity

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook