 Resolution-limit conditioning in finite-input detector calibration

Resolution-limit conditioning in finite-input detector calibration is the sensitivity of a small inferred detector width to uncertainty in two nearly equal measured widths. In finite-input correction in pulse-detector calibration, the nonnegative normalized convolution model givesThe signed relative sensitivities areThey diverge as the measured output width ${\sigma }_q$ approaches the known input width ${\sigma }_p$. Subtracting two well-measured squared widths can therefore be a poorly conditioned inference.

For an original example, ${\sigma }_q=1.00\mathrm{ns}$ and ${\sigma }_p=0.99\mathrm{ns}$ give $D=0.0199\mathrm{n}{\mathrm{s}}^2$ and ${\sigma }_h\approx 0.1411\mathrm{ns}$. The two relative sensitivity coefficients are about $50.25$ and $-49.25$. A small independent fractional width error can produce a much larger fractional response-width error; a common multiplicative timebase error instead partly cancels because the coefficients sum to one. Correlations must therefore be retained.^[ref]

Near the boundary, report uncertainty in the variance difference before transforming it. For a chosen interval $D\in [-0.010,0.050]\mathrm{n}{\mathrm{s}}^2$, imposing the physical constraint $D\ge 0$ gives a detector-width interval $[0,\sqrt{0.050}]\mathrm{ns}$, approximately $[0,0.2236]\mathrm{ns}$. A coverage-preserving detector-width bound from a variance interval uses this monotone square-root transformation on the physical intersection. It need not resemble a symmetric error bar around a point estimate. An interval wholly below zero contains no admissible width under this model; replacing it silently with a zero-width result hides the inconsistency.

NIST characterized its detector/cable/oscilloscope chain with an optical pulse much shorter than the receiver response.^[ref] That design avoids subtracting two nearly equal broad widths. The variance identity still requires nonnegative profiles and finite second moments; arbitrary full widths at half maximum and responses with negative ringing need a different model.