Pairwise inclusion positivity
ID: pairwise-inclusion-positivity
Pairwise inclusion positivity requires every distinct pair of population units to have positive joint inclusion probability under the sampling design:For Horvitz-Thompson variance estimator, the probabilities must also be known, and individual inclusion probabilities must be positive. Each pair can then, at least in principle, contribute an observed product to a pair-expansion estimate. Positivity is not independence: need not equal .[ref]
Conservative variance estimation for sampling designs with zero pairwise inclusion probabilities by Peter M. Aronow and Cyrus Samii. Section 2, conditions for measurability; section 2.1, pair expansion
For simple random sampling of distinct labels from , . Consequently, gives pairwise positivity, whereas selecting exactly one label gives positive individual inclusion probabilities but zero probability of ever observing two distinct values together. This distinction separates unbiased total estimation from unbiased estimation of its sampling variance.
An original two-unit proof shows what information is missing. Sample one of two fixed values uniformly. The Horvitz-Thompson estimator is or , and its variance isAny estimator based only on the observed label and value has expected value of the form . Its mixed difference over is zero. The target's mixed difference is insteadNo such estimator can therefore be unbiased for this variance for every possible pair of values. Additional randomization internal to the estimator does not help: conditioning on the observed data still produces functions of this same separated form. This is an information limitation, not division by zero that can be repaired by assigning a convenient numerical convention.[ref]
Conservative variance estimation for sampling designs with zero pairwise inclusion probabilities by Peter M. Aronow and Cyrus Samii. Sections 1 and 2.2, impossible unbiased recovery of jointly unobservable cross-products
Strict positivity alone also does not guarantee useful precision. A very small produces a large inverse-probability multiplier on a rare observed pair. Designing a usable survey therefore requires attention to both observability and the resulting sampling variance.
New to topics? Read the docs here!