Metric squared-loss two-point bound
ID: metric-squared-loss-two-point-bound
For any estimator in a metric parameter space, by the triangle inequality. Average the two risk functions and replace their probability density functions by their minimum. This proves . The overlap equals one minus total variation distance. The same proof applies to squared error for a real-valued statistical functional of the parameter, without requiring that functional to be injective.
New to topics? Read the docs here!