Area under the curve with 95% CIs achieved by the imCMS classifier trained by domain adversarial training
(A) FOCUS | ||||||
CMS | 3× (n slides=510, n patients=278) | |||||
Model 1 | Model 2 | Model 3 | Model 4 | Model 5 | Overall | |
CMS1 | 0.85 (0.77 to 0.96) | 0.78 (0.64 to 0.93) | 0.95 (0.91 to 1) | 0.89 (0.82 to 0.97) | 0.83 (0.72 to 0.97) | 0.86 (0.81 to 0.92) |
CMS2 | 0.9 (0.85 to 0.97) | 0.96 (0.93 to 1) | 0.93 (0.89 to 0.98) | 0.9 (0.84 to 0.97) | 0.87 (0.8 to 0.94) | 0.91 (0.88 to 0.93) |
CMS3 | 0.89 (0.81 to 1.02) | 0.98 (0.97 to 1.01) | 0.81 (0.67 to 1.01) | 0.96 (0.92 to 0.99) | 0.91 (0.86 to 0.99) | 0.92 (0.88 to 0.98) |
CMS4 | 0.89 (0.84 to 0.99) | 0.9 (0.83 to 0.98) | 0.88 (0.82 to 0.97) | 0.89 (0.81 to 0.99) | 0.91 (0.86 to 0.97) | 0.89 (0.87 to 0.93) |
Macro-average | 0.88 (0.83 to 0.95) | 0.9 (0.86 to 0.95) | 0.89 (0.83 to 0.95) | 0.91 (0.87 to 0.94) | 0.88 (0.84 to 0.93) | 0.9 (0.87 to 0.91) |
(B) TCGA | ||||||
CMS | 3× (n slides=431, n patients=430) | |||||
Model 1 | Model 2 | Model 3 | Model 4 | Model 5 | Ensemble | |
CMS1 | 0.84 (0.79 to 0.91) | 0.87 (0.83 to 0.92) | 0.84 (0.78 to 0.91) | 0.82 (0.77 to 0.89) | 0.82 (0.75 to 0.88) | 0.85 (0.8 to 0.9) |
CMS2 | 0.88 (0.85 to 0.91) | 0.87 (0.83 to 0.91) | 0.87 (0.84 to 0.91) | 0.83 (0.79 to 0.88) | 0.83 (0.8 to 0.87) | 0.89 (0.85 to 0.92) |
CMS3 | 0.82 (0.76 to 0.88) | 0.76 (0.7 to 0.82) | 0.76 (0.7 to 0.83) | 0.76 (0.67 to 0.82) | 0.73 (0.66 to 0.81) | 0.78 (0.71 to 0.85) |
CMS4 | 0.84 (0.79 to 0.87) | 0.84 (0.8 to 0.88) | 0.8 (0.76 to 0.85) | 0.81 (0.77 to 0.86) | 0.8 (0.75 to 0.85) | 0.83 (0.78 to 0.87) |
Macro-average | 0.84 (0.81 to 0.87) | 0.83 (0.8 to 0.86) | 0.82 (0.78 to 0.85) | 0.8 (0.77 to 0.84) | 0.79 (0.76 to 0.83) | 0.84 (0.8 to 0.87) |
(C) GRAMPIAN | ||||||
CMS | 12× (n slides=265, n patients=144) | |||||
Model 1 | Model 2 | Model 3 | Model 4 | Model 5 | Ensemble | |
CMS1 | 0.79 (0.71 to 0.87) | 0.63 (0.51 to 0.74) | 0.78 (0.66 to 0.87) | 0.84 (0.77 to 0.93) | 0.87 (0.82 to 0.95) | 0.87 (0.81 to 0.94) |
CMS2 | 0.83 (0.78 to 0.89) | 0.73 (0.67 to 0.78) | 0.73 (0.67 to 0.8) | 0.75 (0.68 to 0.81) | 0.77 (0.71 to 0.83) | 0.79 (0.74 to 0.84) |
CMS3 | 0.84 (0.78 to 0.89) | 0.73 (0.65 to 0.81) | 0.76 (0.68 to 0.83) | 0.77 (0.72 to 0.83) | 0.8 (0.74 to 0.87) | 0.8 (0.75 to 0.86) |
CMS4 | 0.92 (0.88 to 0.96) | 0.84 (0.78 to 0.91) | 0.87 (0.81 to 0.95) | 0.92 (0.88 to 0.98) | 0.94 (0.9 to 0.98) | 0.93 (0.89 to 0.98) |
Macro-average | 0.84 (0.82 to 0.88) | 0.73 (0.69 to 0.79) | 0.78 (0.75 to 0.82) | 0.82 (0.78 to 0.86) | 0.85 (0.81 to 0.88) | 0.85 (0.82 to 0.89) |
CMS, consensus molecular subtype ; TCGA, The Cancer Genome Atlas.