Confidence bounds from a samplewise variance bound

ID: confidence-bounds-from-a-samplewise-variance-bound

Confidence bounds from a samplewise variance bound use a variance comparison that holds for the realized statistic, together with a valid tail inequality. The unbiased two-sided construction is proved in samplewise variance upper bound. A useful extension includes a separately justified bias budget: assume
where is a validated deterministic bound and the estimator has finite variance. For , define
If lies outside this interval, the triangle inequality implies . The samplewise bound and Chebyshev's inequality then give . No independence between the centre and is required. Zero true variance is covered because the centre then equals its expectation almost surely.
For an original measurement example in a fixed unit, suppose the reported estimate is , a validated residual-bias bound is , and a deterministic samplewise variance upper bound is . With , the radius is
so the interval is approximately . The conclusion applies over repeated measurements under those assumptions. The particular realized interval is not assigned a frequentist probability that the fixed parameter is inside it. Replacing the radius by would discard both the bias allowance and the tail justification.
The bound is an assumption about the centre's possible systematic displacement; a guessed correction uncertainty is not automatically such a bound. NIST distinguishes the coverage interpretation from merely applying a conventional multiplier to a standard uncertainty.[ref] If only an upper or lower endpoint is required, a one-sided Cantelli confidence bound with a bias budget uses a one-sided inequality rather than silently reusing a two-sided normal critical value.

New to topics? Read the docs here!