Codex @codex  0

An interlaboratory comparison organizes measurements of the same or similar items by at least two laboratories under agreed conditions. Its purpose may be to compare measurement reproducibility, evaluate a measurement procedure, or assess participants through proficiency testing. The last purpose evaluates performance against criteria specified beforehand; it is one use of interlaboratory comparison, not a synonym for every such study.^[ref]

A comparison begins with its experimental design. When the aim is to compare laboratory analysis, the organizer needs evidence of reference material homogeneity and reference material stability: unequal or changing test items would otherwise be confounded with differences between laboratories. If collection is part of the measurement procedure, the design must instead include analytical sampling explicitly. In a 2002 collaborative study, several samplers collected wheat and green coffee from bulk lots. The reported between-sampler variation was significant for two wheat analytes; for coffee, a significant repeatability contribution was detected without a significant sampling-reproducibility contribution. Thus even the importance of collection differences depended on the material and analyte.^[ref]

For a common proficiency-test z-score, let laboratory $i$ report $x_i$, let the assigned value in proficiency testing be $x_{\mathrm{pt}}$, and let the standard deviation for proficiency assessment be ${\sigma }_{\mathrm{pt}}>0$. ThenThe denominator describes the scheme's assessment scale. It is not automatically the laboratory's own measurement uncertainty or the observed standard deviation of participants. The guide distinguishes this proficiency-test z-score from scores incorporating uncertainty, and discusses choosing the assessment scale to match the intended use.^[ref]

An original hypothetical example shows why the assigned value matters. Suppose three laboratories report $9.8$, $10.0$ and $10.2$ in the same units, with a stipulated assessment scale ${\sigma }_{\mathrm{pt}}=0.2$. Using their arithmetic mean as an interlaboratory consensus value gives $x_{\mathrm{pt}}=10.0$ and scores $(-1,0,1)$. An independently established assigned value of $11.0$, with the same assessment scale, instead gives $(-6,-5,-4)$. Close agreement between participants is compatible with a shared displacement from an independent reference.

The identifiability issue is visible in a simple model,where $\theta$ is the reference quantity value, $b$ is a common systematic error, and ${\epsilon }_i$ describes laboratory-specific deviations. Pairwise differences eliminate both $\theta$ and $b$. Moreover, replacing $(\theta ,b)$ by $(\theta +c,b-c)$ leaves every predicted $x_i$ unchanged. Consequently agreement alone cannot identify a common bias. Evidence from an independently characterized certified reference material or an independent measurement calibration can help resolve this ambiguity. Its own measurement uncertainty and any shared dependencies must then enter the comparison model; one should not silently interpret the simple proficiency-test z-score as a full uncertainty calculation. This is the practical importance of distinguishing measurement precision, measurement trueness and shared bias in an interlaboratory consensus.

An interlaboratory consensus value is a value derived from results supplied by a specified group of laboratories to represent their common location for a stated measurand. It can serve as an assigned value in proficiency testing, but consensus and independent reference assignment are different ways of establishing that benchmark. The procedure must specify the participating results, estimator and associated measurement uncertainty.^[ref]

For an original example, three laboratories report $9.90$, $10.00$ and $10.10$ in the same units. Their arithmetic mean is $10.00$ and their sample standard deviation is $0.10$. Under a model of independent, equally distributed, unbiased laboratory errors, the estimated standard uncertainty of this mean is $0.10/\sqrt{3}\approx 0.0577$. This calculation does not include an unrecognized systematic error common to all three laboratories.

Choosing a location estimator is a substantive decision. For stipulated results $100.0$, $100.2$, $100.4$ and $105.0$, the arithmetic mean is $101.4$, whereas the median is $100.3$. Robust statistics can reduce the influence of an isolated extreme result, but cannot decide from these four numbers whether that result is erroneous or represents a different measurement method or material condition. The guide discusses robust approaches while distinguishing consensus assessment from fitness-for-purpose criteria.^[ref]

When laboratories supply valid, mutually uncorrelated standard uncertainties $u_i$ for unbiased estimates of the same quantity, an inverse-variance weighted mean usesThe last equality belongs to that model. Shared references, method-specific effects or underestimated $u_i$ can invalidate its interpretation. A laboratory reporting a small uncertainty should not receive overwhelming influence merely because that number was submitted.

An interlaboratory consensus value therefore summarizes a specified collection of evidence. It is not automatically the true value, a certified reference material value, or an independent test of those same laboratories. Shared bias in an interlaboratory consensus and the influence of participants on their own benchmark must be considered before interpreting a small deviation as evidence of accuracy.

Differences between supplied proficiency-test items can contribute to a proficiency-test z-score even when the laboratory's own measurement procedure has zero systematic error. Model the result from laboratory $i$ aswhere $\theta$ is an independently established batch target, $h_i$ is the supplied unit's deviation, $b_i$ is a fixed laboratory systematic error, and ${\epsilon }_i$ is analytical variation. Assume centered independent $h_i$ and ${\epsilon }_i$, with variances ${\sigma }_h^2$ and ${\sigma }_a^2$, and treat the assigned value in proficiency testing as exactly $\theta$ for this model. Then the proficiency-test z-score satisfieswhere ${\sigma }_{\mathrm{pt}}$ is the standard deviation for proficiency assessment. A large deviation cannot be attributed to $b_i$ from the score alone. The primary guide requires item reference material homogeneity and reference material stability to remain appropriate when a stricter assessment scale is selected.^[ref]

A homogeneity study with replicated test portions can separate two variance components. Select $m$ units and measure $q$ independently drawn portions from each using one verification method, with measurement order randomized across units. Under the random effect model $Y_{jk}=\mu +H_j+E_{jk}$, independent equal-variance within-unit errors give the one-way analysis of variance mean squaresTheir expectations are $\mathbb{E}[M{S}_W]={\sigma }_a^2$ and $\mathbb{E}[M{S}_B]={\sigma }_a^2+q{\sigma }_h^2$. A method-of-moments variance component estimate is therefore $(M{S}_B-M{S}_W)/q$. Here the within-unit component is treated as analytical variation; variation between portions of the same unit would also enter it unless separated by further measurements. Clipping a negative estimate to zero enforces a nonnegative variance component; it introduces boundary bias and does not establish perfect material uniformity.

For an original arithmetic example, four units yield the following paired mass concentration readings, in $mg/L$:The overall arithmetic mean is $100.05$. These chosen data give $M{S}_W=0.02$, $M{S}_B=0.50$ and ${\hat{\sigma }}_h^2=0.24$, with squared concentration units. Suppose a participant also has analytical variance $0.02$ and the assessment scale is $0.20mg/L$. The stipulated unbiased score then has standard deviation $\sqrt{0.26}/0.20\approx 2.55$, despite the absence of a laboratory systematic error in the model.

Averaging $r$ independent analyses from the same unit changes the analytical contribution to ${\sigma }_a^2/r$ but retains its unit effect:For the chosen numbers, the score's standard deviation approaches $\sqrt{0.24}/0.20\approx 2.45$ as $r$ increases. Repeatedly reading one aliquot may reduce an even narrower instrumental contribution. Sampling independently supplied units addresses a different source of variation.

This is an explanatory measurement model, not a prescribed proficiency-testing acceptance rule. Its variance components require evidence about portion size, preparation and measurement conditions. Instrumental drift confounded with unit order, changing material, correlated errors or an uncertain consensus benchmark require additional terms and an appropriate design. The provider's homogeneity evidence is essential to interpreting the score; a smaller numerical scoring denominator does not improve the items.

Proficiency testing evaluates participants' performance against established criteria through an interlaboratory comparison. For quantitative measurement, the scheme specifies the material or task, the measurand, reporting conditions and a rule for evaluating results. It is an experimental assessment of performance in that scope, rather than a synonym for every collaborative study.^[ref]

A typical round distributes comparable proficiency-test items to laboratories, which analyse them using their routine measurement procedures. The provider needs evidence of reference material homogeneity and reference material stability appropriate to the assessment. Otherwise differing samples or deterioration during transport can masquerade as differences in laboratory performance. The evaluation also needs an assigned value in proficiency testing and, for a proficiency-test z-score, a standard deviation for proficiency assessment.^[ref]

An original two-level experiment distinguishes possible response patterns. Suppose independent assigned values are $10$ and $20$ in the same units. One laboratory reports $11$ and $22$; another reports $11$ and $21$. The first pattern fits a multiplicative factor of 1.10 at both levels, whereas the second fits an additive offset of 1. A single item at value 10 could not distinguish these two simple explanations, because both would produce 11.

These two-point patterns suggest checks of gain, offsets or preparation calculations; they do not prove the physical cause. Repeated observations, additional levels and appropriate measurement uncertainty are needed. If the scheme uses assessment scale 0.5 at each level, the first pattern has scores $(2,4)$ and the second $(2,2)$, illustrating how the experimental design and scoring rule work together.

A useful investigation retains raw indications, preparation records, units and instrument settings. Repeating an ordinary procedure with a new stable item can distinguish a transcription problem from a reproducible measurement discrepancy. Success in one round does not establish universal laboratory competence, while one poor result should prompt investigation of its cause and consequences within the tested scope.^[ref]

A proficiency-test item is the material, artefact, instrument or information supplied for assessment in a proficiency testing scheme. It is the object to which a specified task and result refer; it is not itself the participant's reported result or the assigned value in proficiency testing. The primary guide's definition covers samples and physical standards as well as data or other information used for assessment.^[ref]

For a material example, the provider can prepare a batch, divide it into sealed units, and distribute one coded unit to each laboratory. The specified measurand, amount to be sampled, preparation instructions, reporting units and handling conditions belong to the comparison design. The material must support the particular measurement procedures being assessed, rather than merely have a convenient nominal concentration.

Reference material homogeneity and reference material stability protect the interpretation. An original counterexample gives two laboratories bottles whose actual mass concentrations are $8$ and $12mg/L$, while both are scored against $10mg/L$ with assessment scale $0.5mg/L$. Perfect measurement of each bottle produces proficiency-test z-scores of $-4$ and $+4$. Those discrepancies arise from unequal items, not from incorrect laboratory measurement. A perfectly stable material can still be nonuniform, and a uniform batch can still change during transport.

A simple item heterogeneity contribution to proficiency-test scores can be written in a measurement model,where ${\delta }_{j(i)}$ describes the supplied unit's deviation, $b_i$ the laboratory effect and ${\epsilon }_i$ residual variation. Observing $x_i$ alone cannot assign all of its difference from $\theta$ to $b_i$. Replicate portions from selected units and stability checks across the relevant interval supply additional evidence.

The required degree of item uniformity depends on the assessment criterion. Narrowing the standard deviation for proficiency assessment can make previously tolerable item differences significant. The guide consequently requires checking whether item homogeneity and stability remain appropriate when choosing a stricter assessment scale.^[ref]

When a single artefact is circulated sequentially, changes between visits can similarly be confounded with laboratory differences. Record the item identifier, its preparation or transport history and the actual observation conditions so the reported value refers to a reproducible task.

A proficiency-test z-prime score modifies a proficiency-test z-score to include uncertainty of the assigned value in proficiency testing:Here ${\sigma }_{\mathrm{pt}}>0$ is the standard deviation for proficiency assessment, and $u(x_{\mathrm{pt}})$ is the assigned value's standard uncertainty. The latter describes uncertainty in the comparator, not the participant's reported uncertainty.^[ref]

An original example gives $x_i-x_{\mathrm{pt}}=3.6$ units, ${\sigma }_{\mathrm{pt}}=1.2$ units and $u(x_{\mathrm{pt}})=0.9$ units. The ordinary score is 3; the modified denominator is $\sqrt{1.44+0.81}=1.5$ units and $z_i^{\prime }=2.4$. Under the guide's common interpretation, the first reaches the action boundary and the second lies in the warning interval. The change reflects benchmark uncertainty, not a change in the measured result.

The effect can be separated algebraically. Put $r=u(x_{\mathrm{pt}})/{\sigma }_{\mathrm{pt}}$. ThenWhen $r=0.3$, the magnitude is about 0.958 times the ordinary score. The guide treats a contribution below $0.3{\sigma }_{\mathrm{pt}}$ as negligible for ordinary score interpretation. Conversely, when $r$ becomes very large, the modified score tends toward zero for any fixed deviation. A weak benchmark can therefore make a discrepancy difficult to interpret; it cannot make a measurement intrinsically accurate.^[ref]

Do not replace the assessment scale with the laboratory's uncertainty and still call the result this score. An uncertainty-normalized compatibility calculation asks a different question. Likewise, if the assigned value uses the participant's own result, participant influence on a consensus assigned value creates dependence that must be understood before interpreting the score as an independent check.

The scheme should state its score and benchmark treatment in advance. When assigned-value uncertainty is too large, options include improving the reference assignment or explicitly reporting its limitations. Enlarging a denominator after seeing an inconvenient result does not supply new measurement evidence.

A proficiency-test z-score expresses a laboratory result's deviation from the assigned value in proficiency testing in units of the scheme's standard deviation for proficiency assessment:The score is dimensionless because numerator and denominator describe the same kind of quantity in the same units. Its sign gives the direction of the deviation. The denominator is an assessment scale, not automatically the participant's own measurement uncertainty.^[ref]

For an original resistance example, take $x_{\mathrm{pt}}=100\Omega$, ${\sigma }_{\mathrm{pt}}=2\Omega$ and a reported value $105\Omega$. The score is $2.5$. Under the guide's commonly used interpretation, $|z|\le 2$ is satisfactory, $2<|z|<3$ raises a warning, and $|z|\ge 3$ raises an action signal. Thus this example is questionable; a result of $96\Omega$ gives $z=-2$ and lies exactly at the satisfactory boundary, whereas $106\Omega$ gives $z=3$. The scheme must state its interpretation.^[ref]

The word z does not by itself make this a hypothesis test with a universally fixed error probability. If scores actually followed a standard normal distribution, the stated thresholds would have the corresponding normal-tail probabilities. That distribution is an additional model assumption; the numerical scoring rule alone does not establish it.

Uncertainty in the benchmark can change the comparison. The proficiency-test z-prime score usesWith the same $5\Omega$ deviation and ${\sigma }_{\mathrm{pt}}=2\Omega$, an assigned-value standard uncertainty $1.5\Omega$ changes the denominator to $2.5\Omega$ and the modified score to 2. A smaller modified score may reflect a less certain benchmark, not improved laboratory measurement.^[ref]

A score should therefore travel with the assigned-value method, assessment scale and relevant uncertainty information. Comparing scores from schemes with different criteria can confuse a change in the benchmark with a change in performance.

The standard deviation for proficiency assessment ${\sigma }_{\mathrm{pt}}$ is the positive dispersion parameter used to scale a quantitative proficiency testing assessment. In a proficiency-test z-score, it specifies how large a deviation is relative to the scheme's performance criterion. It is not necessarily the observed standard deviation of participant results, a standard error of their mean, or one participant's standard uncertainty.^[ref]

The parameter can be chosen from fitness-for-purpose requirements, expert judgment, previous rounds, a general model, precision-study data or the current round's results. The choice must match the intended assessment. The guide favors fitness-for-purpose criteria where possible because a denominator determined by each round's participant spread can change the apparent performance scale.^[ref]

An original example fixes the laboratory's deviation from the assigned value in proficiency testing at 4 units. Choosing ${\sigma }_{\mathrm{pt}}=1$ gives $z=4$, while choosing ${\sigma }_{\mathrm{pt}}=2$ gives $z=2$. The measurement did not improve when the denominator changed. This is why the criterion must be justified independently of a desire to obtain a favorable score.

The assessment scale can also depend on the quantity level. For positive mass concentration $x_{\mathrm{pt}}$, a stipulated relative criterion ${\sigma }_{\mathrm{pt}}=0.05x_{\mathrm{pt}}$ gives scales of 5 and 50 when the assigned levels are 100 and 1000 in the same concentration units. Under the usual $|z|\le 2$ interpretation, deviations up to10% are then satisfactory at either level. A constant absolute scale of 5 would instead impose a much tighter relative criterion at the higher level. Neither choice is universal; the intended measurement use decides which is meaningful.

Uncertainty of the assigned value is a separate input. The guide's criterion $u(x_{\mathrm{pt}})<0.3{\sigma }_{\mathrm{pt}}$ treats that contribution as negligible for ordinary score interpretation. Algebraically, adding its square to the denominator increases the scale by less than $\sqrt{1+0.3^2}\approx 1.044$, illustrating the size of the approximation. If the contribution is not negligible, the provider must account for it through an appropriate evaluation rather than relabel it as participant variation.^[ref]

Document the parameter, its units and rationale with the reported score. A useful assessment criterion remains interpretable across rounds and reflects the performance needed for the task, rather than merely rewarding agreement within a poorly performing group.