Yes. Write and . The bounds from b and d are respectivelyThe Strong form of Han's entropy inequality, obtained by repeated entropy submodularity, statesAfter replacing entropies by divergences from the product reference, whose cross-entropy terms cancel, this is exactly . Equality holds for product and when ; dependence can make the new bound strictly smaller.
Articles by others on the same topic
There are currently no matching articles.