Yes. Write and . The bounds from b and d are respectively
The Strong form of Han's entropy inequality, obtained by repeated entropy submodularity, states
After replacing entropies by divergences from the product reference, whose cross-entropy terms cancel, this is exactly . Equality holds for product and when ; dependence can make the new bound strictly smaller.

Articles by others on the same topic (0)

There are currently no matching articles.