Metric squared-loss two-point bound

ID: metric-squared-loss-two-point-bound

For any estimator in a metric parameter space, by the triangle inequality. Average the two risk functions and replace their probability density functions by their minimum. This proves . The overlap equals one minus total variation distance. The same proof applies to squared error for a real-valued statistical functional of the parameter, without requiring that functional to be injective.

New to topics? Read the docs here!