The canonical gradient is the influence-function representer in the statistical tangent space . It equals the orthogonal projection onto of any representer. Every other representer differs from it by an element of , so the Pythagorean theorem in an inner-product space gives it minimum variance. For in an unrestricted density model with bounded , it is .
New to topics? Read the docs here!