Exact bootstrap distribution for three observations

ID: exact-bootstrap-distribution-for-three-observations

Take the original observations , with sample mean . All ordered bootstrap samples have probability . The bootstrap sample has sample mean ; has sample mean ; has sample mean . These are illustrative possibilities, not three simulated measurements used to estimate the distribution.
For bootstrap count vectors , records the number of copies of observed slot . Their multinomial distribution is
and . Thus the unordered counts have probability , whereas have probability . Stars and bars gives ten count vectors, but assigning each probability would be wrong. Two different count vectors, and , both give sample mean ; combining their probabilities gives .
Figure 1.
Exact conditional sampling distribution of the sample mean from observations
. All 27 ordered bootstrap samples are enumerated. Bar labels give their counts out of 27, not empirical frequencies from a random simulation. The dashed line marks ; the gaps reflect this discrete three-point empirical measure. Details.
The conditional bootstrap variance of a sample mean gives a compact check on the enumeration. Each resampled draw has expected value and variance
Averaging three independent draws divides that variance by three:
The exact conditional bootstrap standard error is . The original sample variance with denominator is , so its usual estimated standard error for the sample mean is . Their squared ratio is here; the difference follows from the empirical measure's denominator , not a numerical simulation error. Neither number is the known true sampling standard error of the unknown source probability distribution.

New to topics? Read the docs here!