Kappa

agreement beyond chance

κ = (P_observed − P_chance) / (1 − P_chance)

Kappa measures agreement between ratings corrected for the agreement expected by chance. 1 is perfect agreement, 0 is chance level. Cohen's kappa compares two raters, Fleiss' kappa any number. In attribute MSA kappa ≥ 0.75 is good and < 0.40 poor.

Calculate it

Attribute Agreement Analysis: Agreement and kappa for visual or go / no-go inspection.

Related terms

• %GRR: gauge repeatability and reproducibility