Percentage agreement and Cohen's κ value for agreement with the gold-standard label, which was defined using the joint opinion of the three reviewers, from 100 spirometry curves
Agreement with gold standard | Cohen's κ | |
Reviewer 1 | 88% | 0.73 |
Reviewer 2 | 94% | 0.85 |
Reviewer 3 | 70% | 0.42 |
Majority opinion of reviewers | 89% | 0.75 |
AI software | 73% | 0.47 |
Original over-reader | 46% | −0.08 |
AI: artificial intelligence.