Bernoulli relative entropy lower bound
ID: bernoulli-relative-entropy-lower-bound
For , the second derivative with respect to is . Its value and first derivative at vanish, so . Boundary values follow by continuity or the infinite-divergence convention. Together with the binary partition bound for relative entropy, this gives Pinsker's inequality with the natural-logarithm constant.
New to topics? Read the docs here!