Chain rule for relative entropy
ID: chain-rule-for-relative-entropy
For probability distributions and on a product space, the Kullback-Leibler divergence decomposes into the divergence of a marginal and the expected divergence of the corresponding conditional distributions. Iteration gives
New to topics? Read the docs here!