| Raters | Observed agreement (%) | Expected agreement (%) | Kappa (95% confidence interval) |
|---|---|---|---|
| 1:2 | 90.0 | 67.5 | 0.68 (0.41–0.94) |
| 1:3 | 88.0 | 67.9 | 0.63 (0.36–0.90) |
| 1:4 | 90.0 | 69.2 | 0.68 (0.41–0.94) |
| 1:5 | 94.0 | 71.8 | 0.79 (0.56–1.00) |
| 2:3 | 90.0 | 66.8 | 0.70 (0.45–0.95) |
| 2:4 | 92.0 | 68.0 | 0.75 (0.52–0.98) |
| 2:5 | 92.0 | 70.4 | 0.73 (0.48–0.98) |
| 3:4 | 98.0 | 66.8 | 0.94 (0.82–1.00) |
| 3:5 | 94.0 | 69.0 | 0.81 (0.60–1.00) |
| 4:5 | 96.0 | 70.4 | 0.87 (0.68–1.00) |
| 1:2:3:4:5 | 92.4 | 69.0 | 0.76 (0.55–0.89) |