Paper to Practice ·
External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms
An independent team in Stockholm ran 3 commercial mammography AI algorithms blind on 8805 screening exams (739 cancers, 8066 healthy controls). The best one (AI-1) reached an AUC of 0.956 and, at the first readers' specificity of 96.6%, a sensitivity of 81.9% versus 77.4% for first-reader radiologists; pairing AI-1 with the first reader found the most cancers (88.6% sensitivity) but at a lower specificity of 93.0%.


