RT Journal Article SR Electronic T1 Artificial intelligence based software facilitates spirometry quality control in asthma and COPD clinical trials JF ERJ Open Research JO erjor FD European Respiratory Society SP 00292-2022 DO 10.1183/23120541.00292-2022 VO 9 IS 1 A1 Eva Topole A1 Sonia Biondaro A1 Isabella Montagna A1 Sandrine Corre A1 Massimo Corradi A1 Sanja Stanojevic A1 Brian Graham A1 Nilakash Das A1 Kevin Ray A1 Marko Topalovic YR 2023 UL http://openres.ersjournals.com/content/9/1/00292-2022.abstract AB Rationale Acquiring high-quality spirometry data in clinical trials is important, particularly when using forced expiratory volume in 1 s or forced vital capacity as primary end-points. In addition to quantitative criteria, the American Thoracic Society (ATS)/European Respiratory Society (ERS) standards include subjective evaluation which introduces inter-rater variability and potential mistakes. We explored the value of artificial intelligence (AI)-based software (ArtiQ.QC) to assess spirometry quality and compared it to traditional over-reading control.Methods A random sample of 2000 sessions (8258 curves) was selected from Chiesi COPD and asthma trials (n=1000 per disease). Acceptability using the 2005 ATS/ERS standards was determined by over-reader review and by ArtiQ.QC. Additionally, three respiratory physicians jointly reviewed a subset of curves (n=150).Results The majority of curves (n=7267, 88%) were of good quality. The AI agreed with over-readers in 91% of cases, with 97% sensitivity and 93% positive predictive value. Performance was significantly better in the asthma group. In the revised subset, n=50 curves were repeated to assess intra-rater reliability (κ=0.83, 0.86 and 0.80 for each of the three reviewers). All reviewers agreed on 63% of 100 unique tests (κ=0.5). When reviewers set the consensus (gold standard), individual agreement with it was 88%, 94% and 70%. The agreement between AI and “gold-standard” was 73%; over-reader agreement was 46%.Conclusion AI-based software can be used to measure spirometry data quality with comparable accuracy as experts. The assessment is a subjective exercise, with intra- and inter-rater variability even when the criteria are defined very precisely and objectively. By providing consistent results and immediate feedback to the sites, AI may benefit clinical trial conduct and variability reduction.In clinical trials, AI software can be used with high accuracy to evaluate the quality of spirometry data. This leads to increased consistency and repeatability and immediate feedback, allowing a real-time evaluation with the subject still at the site. https://bit.ly/3fzNDvf