The KNee OsteoArthritis Prediction (KNOAP2020) challenge: An image analysis challenge to predict incident symptomatic radiographic knee osteoarthritis from MRI and X-ray images
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Dokumenter
- Fulltext
Forlagets udgivne version, 1 MB, PDF-dokument
Objectives: The KNee OsteoArthritis Prediction (KNOAP2020) challenge was organized to objectively compare methods for the prediction of incident symptomatic radiographic knee osteoarthritis within 78 months on a test set with blinded ground truth. Design: The challenge participants were free to use any available data sources to train their models. A test set of 423 knees from the Prevention of Knee Osteoarthritis in Overweight Females (PROOF) study consisting of magnetic resonance imaging (MRI) and X-ray image data along with clinical risk factors at baseline was made available to all challenge participants. The ground truth outcomes, i.e., which knees developed incident symptomatic radiographic knee osteoarthritis (according to the combined ACR criteria) within 78 months, were not provided to the participants. To assess the performance of the submitted models, we used the area under the receiver operating characteristic curve (ROCAUC) and balanced accuracy (BACC). Results: Seven teams submitted 23 entries in total. A majority of the algorithms were trained on data from the Osteoarthritis Initiative. The model with the highest ROCAUC (0.64 (95% confidence interval (CI): 0.57–0.70)) used deep learning to extract information from X-ray images combined with clinical variables. The model with the highest BACC (0.59 (95% CI: 0.52–0.65)) ensembled three different models that used automatically extracted X-ray and MRI features along with clinical variables. Conclusion: The KNOAP2020 challenge established a benchmark for predicting incident symptomatic radiographic knee osteoarthritis. Accurate prediction of incident symptomatic radiographic knee osteoarthritis is a complex and still unsolved problem requiring additional investigation.
| Originalsprog | Engelsk |
|---|---|
| Tidsskrift | Osteoarthritis and Cartilage |
| Vol/bind | 31 |
| Sider (fra-til) | 115-125 |
| ISSN | 1063-4584 |
| DOI | |
| Status | Udgivet - 2023 |
Bibliografisk note
Funding Information:
ReumaNederland is acknowledged for sponsoring the prize for the challenge. Study supported in part by National Institutes of Health (R01AR074453).
Funding Information:
The PROOF study was funded by ZonMw, the Netherlands Organisation for Health Research and Development (Grant number: 120520001). Study supported in part by National Institutes of Health. The funding sources had no role in the study design, data collection or analysis, interpretation of data, writing of the manuscript, or in the decision to submit the manuscript for publication.AC has provided consulting services to SkopeMR, Inc., SubtleMedical, Chondrometrics GmbH, Image Analysis Group, ICM, Culvert Engineering, and Edge Analysis; is a stockholder of Subtle Medical, LVIS Corp., and Brain Key; is on the advisory board for Chondrometrics GmbH and Brain Key; has received royalties from LVIS Corp.; and reports grant support from NIH (R01AR063643, R01AR077604, R01EB002524, R01EB026136, K24AR062068, and P41EB015891). CD reports grant support from NIH NIAMS (R01AR074453). ED is a stockholder of Biomediq A/S. MN reports honoraria for lectures from General Electric. SBZ reports personal fees from Infirst Healthcare, Pfizer, and Osteoarthritis Research Society International and grants from The Netherlands Organisation for Health Research and Development, Dutch Research Council, European Union, Foreum, and Dutch Arthritis Association outside the submitted work. None of the mentioned organizations were involved in the design, execution, data analysis, or the reporting of this study.ReumaNederland is acknowledged for sponsoring the prize for the challenge. Study supported in part by National Institutes of Health (R01AR074453).
Funding Information:
The PROOF study was funded by ZonMw , the Netherlands Organisation for Health Research and Development (Grant number: 120520001). Study supported in part by National Institutes of Health . The funding sources had no role in the study design, data collection or analysis, interpretation of data, writing of the manuscript, or in the decision to submit the manuscript for publication.
Publisher Copyright:
© 2022 The Author(s)
ID: 326676724