Diagnostic efficiency of individual systems for automatic analysis of computed tomography images in the detection of ischemic stroke in the basin of the middle cerebral artery

Background. The diagnosis of ischemic stroke is of high importance in modern medical practice. One of the most promising methods for solving this problem is the introduction of machine learning algorithms into physicians’ work as an auxiliary tool for the interpretation of beam images.Aim: To compare automated computed tomography (CT) image analysis systems in detecting middle cerebral artery stroke.Material and Methods. The study included three anonymized (A, B, C) machine learning algorithms. Analytical validation was carried out on a database of one hundred patients admitted in St. Petersburg vascular center with suspected middle cerebral artery stroke, who underwent noncontrast head CTs. Ischemic stroke in half of the patients was confirmed on the basis of clinical examination findings and CT-angiography and CT-perfusion. The study evaluated the performance indicators (sensitivity, specificity, positive predictive value, negative predictive value, accuracy) for detecting a set of signs of early ischemic changes (by automatic segmentation and predicting a score on the ASPECTS scale). The article also provides a graph that allows you to evaluate the quality of a binary classification - characteristic curves (ROC-curves).Results. The meta-analyses showed all the considered automated algorithms did not reach the threshold values of accuracy (range from 0.67 to 0.75) required for programs according to clinical guidelines (0.80). The algorithms showed variability in sensitivity and specificity. One of the automatic analysis systems (A) had a high sensitivity (0.88), but at the same time a low specificity (0.46), which indicates its overtraining and a tendency to overdiagnoses. The remaining algorithms (B, C) showed low sensitivity (0.6; 0.55) and high specificity (0.9; 0.8).