Bootstrap ratio bias with unequal cluster sizes arises because the pooled mean in a cluster bootstrap is a ratio with a random denominator. Let the empirical distribution over the observed groups assign mass to each pair of group size and response sum. One bootstrap replicate draws such pairs and computes . Its conditional expectation need not equal , even though the numerator and denominator averages are individually unbiased for their empirical means.
A second-order Taylor expansion of explains the leading effect. Write and for the empirical variance of one group size and empirical covariance of one group size with its response sum, using denominator . The conditional bootstrap bias is approximatelyThe second derivatives are and ; the variances/covariance of the averages bring in . This delta method approximation requires a denominator sufficiently concentrated away from zero and control of the remainder. It is not an exact identity for a few highly unequal groups.
For an original three-group example, take . Then , , , and . The second-order bias estimate is . Enumerating all ordered bootstrap draws instead gives mean about , hence exact conditional bias about . The approximation identifies the direction and mechanism but misses a visible remainder at this small group count.
Equal group sizes remove the random denominator and this particular ratio bias. If every group has the same response mean, , every replicate ratio is exactly regardless of size. Neither case justifies replacing a row-weighted estimand with an equally weighted group mean in general; see unequal-cluster weighting in a cluster bootstrap. The primary Stata specification samples entire clusters and allows replicate row counts to vary.[ref]
Bootstrap sampling and estimation in the Stata documentation. Printed pp. 3–5, cluster() and variable replicate size
Cluster bootstrap 2026-11-05
A cluster bootstrap resamples entire observed groups, retaining all observations and their dependence within each selected group. The sampling unit is the group: draw group labels with replacement from the observed groups, concatenate their observations, and recompute the desired statistic. This is a form of bootstrapping suited to independent groups whose internal observations need not be independent. The Stata manual implements it with cluster(); idcluster() distinguishes two resampled copies of the same original group when the fitted procedure needs group identifiers.[ref]
Bootstrap sampling and estimation in the Stata documentation. Printed pp. 3–5, Options: size(), cluster(), idcluster(); printed p. 18, Technical note on unique panel identifiers
For an original example, three sensors each supply two perfectly shared readings: , , and . The overall sample mean is . A cluster draw produces readings and sample mean ; the two copies of remain distinct resampling slots. Conditional on these data, the empirical variance of a group mean drawn uniformly from is . Averaging three independent draws therefore gives bootstrap varianceResampling six individual rows instead givesThe row procedure halves the conditional variance by pretending that two identical within-sensor readings are independent information. These fractions use the empirical drawing law directly, not a Bessel-corrected estimate of an unknown population variance.
With unequal group sizes, drawing the same number of groups can produce a different number of rows in each replicate. A pooled row mean and a mean of group means are different statistics: unequal-cluster weighting in a cluster bootstrap must follow the intended estimand. Many rows from a few sensors do not replace having many independent sensors; arbitrary dependence between sensors, a dominant group, or too few groups can defeat the intended inference.
Cluster-resampled wringing allocation 2026-11-05
Cluster-resampled wringing allocation uses pilot contacts as the resampling units when assessing how uncertain wringing and readout variability affect a planned gauge block study. Readings from one prepared contact stay grouped. Resampling them as unrelated observations would remove the dependence that motivates nested contact-study allocation.
Write the pilot as vectors from independently prepared contacts. A cluster bootstrap draws of these vectors with replacement, copies every reading in each selected vector, recomputes the variance-component estimates and then reevaluates candidate allocations. For an original five-contact illustration, drawn indices copy contact2 twice and omit contact3. Each draw is a separate bootstrap occurrence; neither duplication nor omission creates a new physical contact. The empirical-with-replacement construction is the general bootstrap procedure, applied here to contact vectors.[ref]
Lecture 12: The Bootstrap. “The Bootstrap”, resampling and recomputing the statistic; “High level idea”, conditional empirical law
For a balanced random-intercept linear mixed model, each resample can yield planning estimatesWith preparation/read costs , a finite candidate has cost and modeled mean variance . Comparing candidates within each resample reveals how often the preferred allocation changes, instead of treating one pilot ratio as known exactly.
For an original180-minute budget with and minute, consider . With and , their mean variances are approximately0.6222,0.5556 and0.5778nm², favoring12 contacts with6 readings. Changing only the planning between-contact variance to1nm² gives0.4222,0.3056 and0.2778nm², favoring10 contacts with9 readings. A resampling distribution of planning inputs can therefore matter to the design decision.
The cost of flattening the data is visible analytically. Under the same model, the true mean variance is , while an independence calculation over all readings gives . Their ratio isusing intraclass correlation . For and , the variance ratio is2.5, a design effect that an independence-based analysis misses.
This nonparametric analysis inherits the limited empirical contact distribution and any boundary estimate . More bootstrap draws do not provide more independent wrings. Drift, shared standards or an unbalanced pilot need an appropriate model or resampling design. NIST documents physical wringing films and their dependence on preparation and elapsed time, which is why contact preparation belongs in the experimental record.[ref]
Effective repetition count across independent calibration blocks accounts for dependence confined to each acquisition block rather than shared by every stored trace. Suppose block contains empty-interval indicator random variables, all with common probability and within-block correlation coefficient . Assume different blocks are independent. With , summing within-block covariances givesMatching this to the variance of an average of independent indicators yieldsFor equal blocks of size , this reduces to . The denominator involves the block size, not the total ; the single-block expression in effective repetition count for detector intervals with shared drift must not be applied as though the same drift state affected every block.
For an original comparison, fix and . One block gives . Six independent blocks of twenty give . Six very uneven blocks of sizes instead giveAll three designs store the same number of traces. The difference comes from how often the same fluctuating condition is reused. For fixed , , and positive , minimizing favors balanced blocks; this motivates optimal allocation of detector repetitions across calibration blocks when block-preparation costs also matter.
Independence must come from the physical acquisition model. Starting another file does not erase a shared clock, reference calibration, or slowly varying environmental influence. NIST's uncertainty law retains shared-input covariance explicitly.[ref]
Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Results by Barry N. Taylor and Chris E. Kuyatt. Appendix A, equation A-3
If drift persists between nominal blocks, those cross-block terms must be added and the displayed formula changes. A cluster bootstrap likewise requires blocks that are suitable independent resampling units.Unequal-cluster weighting in a cluster bootstrap must preserve the statistic's intended population target while resampling the independent groups. For group , let be its observed size, its observation sum, and . Two distinct estimates areThe first weights groups by their numbers of observations; the second gives each group equal weight. If group size is related to group response, the corresponding population targets need not agree. For identically distributed independent groups with suitable finite moments, they correspond to and , respectively.
For each cluster bootstrap replicate, draw group slots with replacement and recompute the selected statistic, including its denominator. The Stata manual explicitly notes that unequal group sizes cause replicate row counts to vary; keeping a fixed original row denominator would therefore compute a different statistic.[ref]
Bootstrap sampling and estimation in the Stata documentation. Printed pp. 3–5, Options: size(), cluster(), and idcluster()
For an original two-group example, take and . The original pooled sample mean is , while the equally weighted group-mean estimate is . The four ordered two-group draws have equal probability. Their pooled sample means are , whereas their equally weighted group-mean estimates are .
Consequently the conditional bootstrap expectation of the pooled estimate is , not . This bootstrap ratio bias with unequal cluster sizes is visible with only two observed groups: averaging a random ratio does not generally give the ratio of the averages. It is not a reason to substitute the equally weighted estimate, which changes the estimand, or a claim that every large-group bootstrap is invalid.
Resampling groups in proportion to and then retaining all their rows introduces an additional size preference; that design needs its own justification. Replicated group copies also need distinct identifiers when the fitted model uses those identifiers. The correct resampling unit, the target mean, and the statistic recomputed in each draw must all be specified.