Bernoulli relative entropy lower bound

ID: bernoulli-relative-entropy-lower-bound

For , the second derivative with respect to is . Its value and first derivative at vanish, so . Boundary values follow by continuity or the infinite-divergence convention. Together with the binary partition bound for relative entropy, this gives Pinsker's inequality with the natural-logarithm constant.

New to topics? Read the docs here!