Differences between supplied proficiency-test items can contribute to a proficiency-test z-score even when the laboratory's own measurement procedure has zero systematic error. Model the result from laboratory as
where is an independently established batch target, is the supplied unit's deviation, is a fixed laboratory systematic error, and is analytical variation. Assume centered independent and , with variances and , and treat the assigned value in proficiency testing as exactly for this model. Then the proficiency-test z-score satisfies
where is the standard deviation for proficiency assessment. A large deviation cannot be attributed to from the score alone. The primary guide requires item reference material homogeneity and reference material stability to remain appropriate when a stricter assessment scale is selected.[ref]
A homogeneity study with replicated test portions can separate two variance components. Select units and measure independently drawn portions from each using one verification method, with measurement order randomized across units. Under the random effect model , independent equal-variance within-unit errors give the one-way analysis of variance mean squares
Their expectations are and . A method-of-moments variance component estimate is therefore . Here the within-unit component is treated as analytical variation; variation between portions of the same unit would also enter it unless separated by further measurements. Clipping a negative estimate to zero enforces a nonnegative variance component; it introduces boundary bias and does not establish perfect material uniformity.
For an original arithmetic example, four units yield the following paired mass concentration readings, in :
The overall arithmetic mean is . These chosen data give , and , with squared concentration units. Suppose a participant also has analytical variance and the assessment scale is . The stipulated unbiased score then has standard deviation , despite the absence of a laboratory systematic error in the model.
Figure 1.
Item differences remain when repeated analyses reduce measurement noise
. Original paired readings and a conditional score-variance calculation. The right panel assumes all repeated analyses use the same supplied unit, independent analytical noise and the displayed estimated variance components. Details.
Averaging independent analyses from the same unit changes the analytical contribution to but retains its unit effect:
For the chosen numbers, the score's standard deviation approaches as increases. Repeatedly reading one aliquot may reduce an even narrower instrumental contribution. Sampling independently supplied units addresses a different source of variation.
This is an explanatory measurement model, not a prescribed proficiency-testing acceptance rule. Its variance components require evidence about portion size, preparation and measurement conditions. Instrumental drift confounded with unit order, changing material, correlated errors or an uncertain consensus benchmark require additional terms and an appropriate design. The provider's homogeneity evidence is essential to interpreting the score; a smaller numerical scoring denominator does not improve the items.
A method-of-moments variance component estimate equates residual mean squares in ANOVA to their model expectations and solves for the variance components. An unconstrained estimate can be negative even when the model component must be nonnegative; boundary treatment then requires a stated estimation convention. The method gives point estimates, not certainty about future experiments.
Michael H. Ramsey 2026-11-05
Michael H. Ramsey is a researcher credited as chair of the working group and co-editor of the 2019 guide to measurement uncertainty arising from analytical sampling. The editorial page gives his affiliation as the University of Sussex and names fellow editors Stephen L. R. Ellison and Peter Rostron.[ref]
The scientific problem is the difference between the collected material and the material about which a conclusion is wanted. For a measurand defined over a larger target, excellent measurement repeatability on one extract does not establish small analytical sampling uncertainty. The guide treats collection and analysis as stages of the measurement process.[ref]
An original measurement model illustrates why replication at the right level matters:
Here is the target mean, is the zero-mean deviation associated with independently collected sample , and is zero-mean analytical variation in repeat . Suppose all these effects are mutually independent, with variances and . Averaging analyses on each of collected samples gives
For stipulated variance components and in squared concentration units, three collections analysed twice give variance , or standard uncertainty about concentration units. Six analyses of only one collection instead give variance , or about units. Both plans use six analyses; only the first averages over independently collected material.
The calculation assumes independent collections and an appropriate model for the target; a shared systematic collection error is not removed by increasing . It explains the measurement-design issue addressed by the guide without presenting these invented numbers as Ramsey's experimental observations.
Yes. The bootstrap confidence interval for the age coefficient, , excludes zero and supports the same positive association. A well-implemented parametric bootstrap can give better finite-sample calibration than the asymptotic likelihood-ratio test, especially with only eleven year groups and estimated variance components. Its advantage depends on simulating the full fitted Gaussian linear mixed model and refitting correctly; resampling individual records as if they were independent would discard the grouping. A bootstrap confidence interval is also not literally the same procedure as a bootstrap-calibrated test.
The bird-level standard deviation is appreciable, with interval hatchlings, whereas the year-level estimate is much less precise, with interval . The residual standard deviation is approximately –. Boundary fits in 23 of the 1000 replicates indicate that at least one fitted variance component sometimes reaches zero; the convergence warning should also be investigated before trusting the reported intervals. Neither the asymptotic test nor a model-based bootstrap repairs incorrect response-distribution or mean-structure assumptions.
The Poisson generalized linear mixed model assumes conditionally Poisson distributed counts with a log link. The fitted variance components are both zero, so this fit lies on a boundary and reduces to ordinary Poisson regression. It estimates
Thus the fitted annual increase is about 6.6%, with approximate 95% confidence interval for the rate ratio . The age evidence is much weaker than in the Gaussian fit: the quoted p-value is . Zero estimated group variances do not prove that real bird and year differences are absent.
The Poisson distribution forces conditional variance to equal the conditional expected value. Here fitted means are around two to three hatchlings, whereas the Gaussian model estimated a residual variance of only . This suggests checking underdispersion and the bounded nature of hatching counts, rather than assuming a Poisson response solves the diagnostic problems. Inspect simulated count residuals and predictive distributions; if the number of eggs is observed, fit a binomial mixed model and check that model's dispersion too.
The displayed Gaussian and Poisson Akaike information criterion values should not simply be ranked as if they used the same likelihood convention: one evaluates a continuous density and the other a probability mass. Compare properly specified count models on the same observed response scale, with compatible likelihoods and predictive checks. A boundary fit, doubtful dispersion assumptions, and possible nonlinear age effects all warrant further work before a strong biological conclusion.
This produces a split-plot design: assign spray to whole orchards, with six sprayed and six unsprayed, then independently randomize ten trees to each pruning method inside every orchard. Orchards remain experimental units for spray; individual trees become experimental units for pruning. Pruning contrasts and the spray-by-pruning interaction term now lie in the within-block ANOVA stratum, while spray is tested between orchards.
The between-orchard ANOVA stratum has eleven statistical degrees of freedom, split into one for spray and ten for error. The within-orchard ANOVA stratum has 348, split into two for pruning, two for the interaction term and 344 for error. This pooling of within-orchard error is appropriate under the stated compound-symmetry covariance model; additional orchard-specific pruning variation would need its own variance component rather than this simplified error model.
The shared orchard effect cancels in a pruning difference within an orchard. Its variance is , so averaging across twelve orchards gives
The spray contrast still compares means of six orchards per group, each based on 30 trees, so its estimated variance remains . For a difference of pruning differences between the two spray groups, each group's pruning difference has estimated variance , and the resulting interaction contrast has estimated variance , compared with in the original allocation.
Splitting pruning within orchards improves pruning and interaction precision without extra trees, and gives spray a less sparse error estimate; it does not reduce the spray contrast's variance. This option requires tree-level pruning to be practical without interference between neighboring trees. The numerical gains, like those in the other options, assume the current variance components remain applicable next year.
For the Gaussian linear mixed model, temporarily regard as known, with here and . The joint multivariate normal distribution is
By the conditional multivariate normal distribution formula,
A nonsingular Gaussian density has its mode at its mean. Thus the conditional mode of Gaussian random effects equals the conditional expectation. Replacing the unknown parameters by fitted values gives
For positive-definite and , an equivalent derivation minimizes the negative conditional log density,
Differentiation yields
The inverse-covariance penalty shrinks furnace intercepts and slopes toward the population effects. For furnace , set and ; the same formula provides its two-component conditional mode from that furnace's observations, conditional on the fitted common parameters. If a variance component is zero, the covariance form remains meaningful and its corresponding random effect is zero, whereas the formula with needs a limiting interpretation. With known covariance parameters these are best linear unbiased predictors; plug-in variance estimates give their empirical version.
The comparison removes the random slope and tests against , while retaining the same fixed intercept and slope. A variance cannot be negative, so zero is a boundary point of the parameter space. The regular Wilks theorem assumptions behind an ordinary likelihood-ratio test fail. Consequently the default chi-squared p-value from anova is not reliably calibrated for this variance-component likelihood-ratio test at a boundary. This is different from the fixed-slope test in part (c). The reference to strength_model1 means the earlier object strength_model; no separate model 1 object was defined.
A useful alternative is a parametric bootstrap. Fit the null random-intercept model, then simulate data on the actual predictor values and furnace grouping by generating null intercept effects and observation errors from its fitted Gaussian distribution. Refit null and alternative models to each simulated dataset using the same likelihood method and compute the same likelihood-ratio statistic. If is the observed statistic, estimate its upper-tail probability by
This incorporates the zero-variance boundary and the actual small group count. It is a fitted-null simulation approximation because nuisance parameters are estimated, not a universally exact test. Since both models have the same fixed-effect space, a similarly calibrated restricted-likelihood statistic is also possible. Under suitable asymptotics for a single identifiable added variance component the familiar limiting law is , but using the bootstrap avoids relying on that approximation with only three groups. There is no supplied statistic or calibrated bootstrap result here from which to decide whether the slope variance is required.
Peter Rostron 2026-11-05
Peter Rostron is a co-editor, with Michael H. Ramsey and Stephen L. R. Ellison, of the 2019 guide to measurement uncertainty arising from analytical sampling. Its editorial page identifies him with the University of Sussex. The guide connects laboratory analysis with the earlier act of collecting material.[ref]
An illuminating experimental design question is where to place replication. Repeating an analysis of one collected sample reveals a different source of variation from collecting another sample from the target material. A nested design can distinguish the corresponding variance components. The guide also describes an unbalanced sampling-uncertainty design with two analyses of one field sample and one analysis of its field duplicate.[ref]
An original counting example makes the design concrete. At each of ten targets, two collected samples each analysed twice require analytical results. Analysing the first sample twice and its field duplicate once instead requires . The design retains a within-sample analytical contrast at each target and a contrast between separately collected samples, with fewer analytical results. The information content and the appropriate analysis of variance must nevertheless follow the actual replication pattern; thirty results do not automatically have the same precision as forty.
This distinction matters when deciding whether to spend effort on another instrument reading or on another collection. Rostron's verified contribution here is editorial participation in the shared guidance, rather than sole authorship of every method it discusses. Repeated collection can reveal variability without, by itself, proving the absence of a common collection bias.
Split-plot design Created 2026-10-07 Updated 2026-11-05
A split-plot design randomizes one factor to whole plots and another to subplots within each whole plot. Whole-plot treatment effects and subplot treatment effects therefore use different error ANOVA strata. Whole plots provide replication for the first factor; their subplots do not supply extra independent whole-plot replication. Within-whole-plot comparisons can remove a shared additive whole-plot variance component.
For a vector of estimated treatment means , the variance of a treatment contrast with coefficient vector is . Averaging subsamples from a common experimental unit does not make their shared variance component disappear.