 Inter-rater reliability

Consistency or agreement among raters assessing the same units. The statistic should match the scale and whether consistency or absolute agreement matters. Repeated ratings improve information about a unit without creating additional independently sampled units.