The standard deviation for proficiency assessment is the positive dispersion parameter used to scale a quantitative proficiency testing assessment. In a proficiency-test z-score, it specifies how large a deviation is relative to the scheme's performance criterion. It is not necessarily the observed standard deviation of participant results, a standard error of their mean, or one participant's standard uncertainty.[ref]
The parameter can be chosen from fitness-for-purpose requirements, expert judgment, previous rounds, a general model, precision-study data or the current round's results. The choice must match the intended assessment. The guide favors fitness-for-purpose criteria where possible because a denominator determined by each round's participant spread can change the apparent performance scale.[ref]
An original example fixes the laboratory's deviation from the assigned value in proficiency testing at 4 units. Choosing gives , while choosing gives . The measurement did not improve when the denominator changed. This is why the criterion must be justified independently of a desire to obtain a favorable score.
The assessment scale can also depend on the quantity level. For positive mass concentration , a stipulated relative criterion gives scales of 5 and 50 when the assigned levels are 100 and 1000 in the same concentration units. Under the usual interpretation, deviations up to10% are then satisfactory at either level. A constant absolute scale of 5 would instead impose a much tighter relative criterion at the higher level. Neither choice is universal; the intended measurement use decides which is meaningful.
Uncertainty of the assigned value is a separate input. The guide's criterion treats that contribution as negligible for ordinary score interpretation. Algebraically, adding its square to the denominator increases the scale by less than , illustrating the size of the approximation. If the contribution is not negligible, the provider must account for it through an appropriate evaluation rather than relabel it as participant variation.[ref]
Document the parameter, its units and rationale with the reported score. A useful assessment criterion remains interpretable across rounds and reflects the performance needed for the task, rather than merely rewarding agreement within a poorly performing group.

Articles by others on the same topic (0)

There are currently no matching articles.