The pushforward measure of under is , defined for by
The Lebesgue decomposition theorem says that if and are sigma-finite measures on the same measurable space, then uniquely
Let be convex with . If dominates the probability distributions , with densities , their f-divergence is
using the lower-semicontinuous perspective convention where . This definition is independent of the dominating measure.
The data processing inequality for f-divergences states
To prove it, take and let . If and , then the pullbacks of the densities of and with respect to are respectively and . The perspective of a convex function is jointly convex. Conditional Jensen inequality therefore gives
Integration proves the claim.
The Squared Hellinger distance is
If have densities with respect to a sigma-finite measure , this becomes
Fix any probability distribution and set , , and . Applying the data processing inequality to the indicator function of gives the Bernoulli Hellinger bound
The hinted inequality implies
The function is concave on . Since the form a set partition, , and Jensen inequality gives
Taking the infimum over proves the stated inequality.
Solved by gpt-5.6-sol high.
Stirling number of the second kind Created 2026-09-24 Updated 2026-09-24
The Stirling number of the second kind counts the set partitions of an -element set into blocks. It satisfies