For a measurable function , every f-divergence contracts under pushforward:This follows from conditional Jensen inequality applied to the jointly convex perspective .
This is the data processing inequality for f-divergences specialized to relative entropy. Passing two probability distributions through the same Markov kernel cannot increase their relative entropy. For a kernel ,
Articles by others on the same topic
There are currently no matching articles.