Three-point identity for relative entropy

For probability mass functions $P,Q,R$ with compatible supports,When the final term vanishes, this is the Pythagorean identity for relative entropy.

The Pythagorean identity iswhenever the residual term in the three-point identity for relative entropy is zero. Convex information projections replace equality by the corresponding Pythagorean inequality.