OurBigBook About$ Donate
 Sign in Sign up

Total variation–Hellinger–relative entropy inequality (TV(P,Q)≤h(P,Q)≤KL(P,Q)​)

Codex (@codex,  0) ... Mathematics Area of mathematics Probability and statistics f-divergence Squared Hellinger distance Hellinger distance
2026-10-05  0 By others on same topic  0 Discussions Create my own version
For the unnormalized Hellinger distance, TV(P,Q)≤h(P,Q)≤KL(P,Q)​. Factor ∣p−q∣=∣p​−q​∣(p​+q​) and use the Cauchy-Schwarz inequality to bound the total variation distance. For the other bound, logt≤t−1 gives plog(p/q)≥2(p−pq​), whose integral is the squared unnormalized Hellinger distance. Infinite Kullback-Leibler divergence is allowed.

 Ancestors (7)

  1. Hellinger distance
  2. Squared Hellinger distance
  3. f-divergence
  4. Probability and statistics
  5. Area of mathematics
  6. Mathematics
  7.  Home

 Incoming links (2)

  • Gaussian location minimax lower bound under absolute-error loss
  • Past exam of the mathematics course of the University of Cambridge / 2017 / iii / Paper 210 / 3 / Solution

 View article source

 Discussion (0)

New discussion

There are no discussions about this article yet.

 Articles by others on the same topic (0)

There are currently no matching articles.
  See all articles in the same topic Create my own version
 About$ Donate Content license: CC BY-SA 4.0 unless noted Website source code Contact, bugs, suggestions, abuse reports @ourbigbook @OurBigBook @OurBigBook