Coverage failure under random variance-ratio limits
ID: coverage-failure-under-random-variance-ratio-limits
Coverage failure under random variance-ratio limits can persist even when the centre is exactly normal, the variance estimate is conservative in expectation, and its absolute error tends to zero. What fails is relative-scale concentration. Let and a positive random scale be independent, and defineThe variance ratio is at every sample size. Its nondegenerate distribution need not approach the constant required in asymptotic conservative Wald coverage under variance-ratio convergence.
Conditional on , a normal critical value gives interval coverage . Therefore unconditional coverage is under the independence assumption. A useful shape calculation isThe function is strictly concave. If , Jensen's inequality puts , with strict inequality for a nonconstant scale. An expectation equality therefore does not reproduce the normal interval's nominal coverage.
For an original strictly conservative example, let take and with equal probabilities. Then , but at nominal 95 percent the exact coverage isThis value is unchanged as grows. Meanwhile tends to zero, showing why absolute consistency at a vanishing variance scale is insufficient. The normal cdf evaluation uses the pinned primary numerical definition.[ref]
SciPy 1.16.2 documentation. scipy.stats.norm, cdf and ppf
If the scale depends on the standardized error, the conditional normal formula above cannot simply be retained; the joint law is needed. NIST likewise distinguishes a justified coverage probability from selecting a conventional uncertainty multiplier.[ref]
New to topics? Read the docs here!