Deep Bio Inc., Seoul, Korea
1Department of Hospital Pathology, College of Medicine, The Catholic University of Korea, Seoul, Korea
© 2019 The Korean Society of Pathologists/The Korean Society for Cytopathology
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Author (year) | Disease | Data | Task | Model | Augmentation | Performance |
---|---|---|---|---|---|---|
Garud et al. (2017) [46] | Breast cancer | FNA cytology/175 (images) | Decision Benign/cancer | CNN | None | Image level decision acc. 89.7% |
Li and Ping (2018) [47] | Lymph node metastasis | CAMELYON16/400 (WSIs) | Decision Yes/no | CNN + CRF | Color jitter, rotation, etc. | Patch level decision acc. 93.8% |
Rannen Triki et al. (2018) [48] | Breast cancer | Frozen section OCT/4,921 (frames) | Decision Benign/cancer | CNN | None | Patch level decision acc. 94.96% |
Ehteshami Bejnordi et al. (2018) [49] | Breast cancer | BREAST Stamp/2,387 (WSIs) | Decision Benign/cancer | CNN + CNN | None | WSI level decision AUC 0.962 |
Litjens et al. (2016) [50] | Lymph node metastasis | Lymph node specimen/271 (samples) | Decision Yes/no | CNN | None | Sample level decision AUC 0.90 |
Cires¸ an et al. (2013) [51] | Breast cancer | MITOS/300 mitosis in 50 images | Mitosis detection | CNN | Rotation, flip, etc. | Detection F1-score 0.782 |
Teramoto et al. (2017) [52] | Lung cancer | FNA cytology/298 (images) | Classification | CNN | Rotation, flip, etc. | Overall classification acc. 71.1% |
Adeno-Squamous cell | ||||||
Small cell | ||||||
Yu et al. (2016) [53] | Lung cancer | TCGA-LUAD/1,074 | Decision Benign/cancer | SVM | None | Patch level decision AUC 0.85 |
TCGA-LUSC/1,111 | Survival analysis | |||||
Stanford TMA/294 (samples) | ||||||
Coudray et al. (2018) [54] | Lung cancer | TCGA lung cancer/1,635 (samples) | Classification | CNN | None | Overall classification AUC 0.97 |
Adeno-Squamous cell | STK11 mutation decision AUC 0.85 | |||||
Benign | ||||||
Multi-task decision | ||||||
Gene mutation | ||||||
Campanella et al. (2018) [55] | Prostate cancer | Needle biopsy/12,160 (samples) | Decision Benign/cancer | CNN (MIL) | None | Sample level decision AUC 0.979 |
Arvaniti et al. (2018) [56] | Prostate cancer | TMA/886 (samples) | Classification Gleason score | CNN +scoring rule | Rotation, flip, color jitter | Model-pathologist Cohen’s kappa 0.71 |
Zhou et al. (2017) [57] | Prostate cancer | TCGA-PRAD/368 (cases) | Decision 3 + 4/4 + 3 | CNN | None | Sample level decision acc. 75% |
Nagpal et al. (2018) [58] | Prostate cancer | TCGA-PRAD + others/train 1,226, test 331 (slides) | Classification Gleason group | CNN + k-NN | None | Overall classification acc. 70% |
Survival analysis | C-index 0.697 | |||||
Litjens et al. (2016) [50] | Prostate cancer | Needle biopsy / 225 (WSIs) | Decision Benign/cancer | CNN | None | Slide level decision AUC 0.99 |
Ertosun and Rubin (2015) [59] | Brain cancer | TCGA-GBM & LGG (unknown size) | Classification | CNN + CNN | Color transform to H&E | GBM/LGG decision acc. 96% |
GBM | LGG grade decision acc. 71% | |||||
LGG grade 2 | ||||||
LGG grade 3 | ||||||
Mobadersany et al. (2018) [60] | Brain cancer | TCGA-GBM & LGG/1,061 (samples) | Survival analysis | CNN | Rotation, normalization | C-index 0.754 |
Wu et al. (2018) [61] | Ovarian cancer | Biopsy/7,392 (images) | Classification Subtypes | CNN | Rotation, image enhancement | Overall classification acc. 78.2% |
Zhang et al. (2017) [62] | Cervix cancer | HEMLBC/1,978 Herlev/917 (images) | Decision Benign/cancer | CNN | Rotation, translation, | Image level decision AUC 0.99 |
Xu et al. (2017) [63] | Sickle cell disease | Red-blood cell/7,206 (patches) | Classification Cell types | CNN | Rotation, flip, translation, etc. | Cell level classification acc. 87.5% |
Meier et al. (2018) [64] | Gastric cancer | TMA/469 (samples) CD8/Ki67 IHC | Survival analysis | CNN | None | Stratification by risk successful (p < .01) |
Xie et al. (2016) [65] | - | Synthetic fluorescence microscopy cell/200 (images) | Cell counting | CNN | None | Mean absolute error < 2% |
Tuominen et al. (2010) [66] | - | IHC stained breast cancer slides/100 | Cell counting | Comp. vision | None | Correlation coefficient 0.98 |
CNN, convolutional neural network; MIL, multiple instance learning; SVM, support vector machine; AUC, area under receiver operating characteristic curve; k-NN, k-nearest neighbor; WSI, whole slide image; CRF, Conditional random field; TCGA, The Cancer Genome Atlas; TMA, tissue microarray; IHC, immunohistochemistry; GBM, glioblastoma multiforme; LGG, lower grade glioma.
Term | Abbreviation | Explanation |
---|---|---|
Artificial intelligence | AI | Intelligence represented by artificial things |
Machine learning | ML | Data-driven statistical learning approach to AI |
Deep learning | DL | Deep neural network based ML |
Convolutional neural network | CNN | Neural network suitable for data with locality, e.g. image |
Recurrent neural network | RNN | Neural network suitable for data with order dependency, e.g. sentence |
Long short-term memory | LSTM | Recurrent neuron suitable for learning long-term dependency |
Support vector machine | SVM | ML method that separates with regard to the trained hyperplane |
k-nearest neighbor (search) | k-NN | ML method that classifies based on the classes of k similar training data |
Conditional random field | CRF | ML method suitable for data with spatial/temporal dependency |
Markov decision process | MDP | Modeling framework for a series of decisions and resulting outcomes |
Multiple instance learning | MIL | ML approach suitable for labeled sets (whole slides) of unlabeled instances (lesions) |
Region-of-interest | ROI | Image region containing things of predefined interest, e.g. nuclei, stroma, etc. |
Area under receiver operating characteristic curve | AUC | Performance measure based on the area under the receiver operating characteristic curve, varying from 0.5 (lowest) to 1.0 (highest) |
Author (year) | Disease | Data | Task | Model | Augmentation | Performance |
---|---|---|---|---|---|---|
Garud et al. (2017) [46] | Breast cancer | FNA cytology/175 (images) | Decision Benign/cancer | CNN | None | Image level decision acc. 89.7% |
Li and Ping (2018) [47] | Lymph node metastasis | CAMELYON16/400 (WSIs) | Decision Yes/no | CNN + CRF | Color jitter, rotation, etc. | Patch level decision acc. 93.8% |
Rannen Triki et al. (2018) [48] | Breast cancer | Frozen section OCT/4,921 (frames) | Decision Benign/cancer | CNN | None | Patch level decision acc. 94.96% |
Ehteshami Bejnordi et al. (2018) [49] | Breast cancer | BREAST Stamp/2,387 (WSIs) | Decision Benign/cancer | CNN + CNN | None | WSI level decision AUC 0.962 |
Litjens et al. (2016) [50] | Lymph node metastasis | Lymph node specimen/271 (samples) | Decision Yes/no | CNN | None | Sample level decision AUC 0.90 |
Cires¸ an et al. (2013) [51] | Breast cancer | MITOS/300 mitosis in 50 images | Mitosis detection | CNN | Rotation, flip, etc. | Detection F1-score 0.782 |
Teramoto et al. (2017) [52] | Lung cancer | FNA cytology/298 (images) | Classification | CNN | Rotation, flip, etc. | Overall classification acc. 71.1% |
Adeno-Squamous cell | ||||||
Small cell | ||||||
Yu et al. (2016) [53] | Lung cancer | TCGA-LUAD/1,074 | Decision Benign/cancer | SVM | None | Patch level decision AUC 0.85 |
TCGA-LUSC/1,111 | Survival analysis | |||||
Stanford TMA/294 (samples) | ||||||
Coudray et al. (2018) [54] | Lung cancer | TCGA lung cancer/1,635 (samples) | Classification | CNN | None | Overall classification AUC 0.97 |
Adeno-Squamous cell | STK11 mutation decision AUC 0.85 | |||||
Benign | ||||||
Multi-task decision | ||||||
Gene mutation | ||||||
Campanella et al. (2018) [55] | Prostate cancer | Needle biopsy/12,160 (samples) | Decision Benign/cancer | CNN (MIL) | None | Sample level decision AUC 0.979 |
Arvaniti et al. (2018) [56] | Prostate cancer | TMA/886 (samples) | Classification Gleason score | CNN +scoring rule | Rotation, flip, color jitter | Model-pathologist Cohen’s kappa 0.71 |
Zhou et al. (2017) [57] | Prostate cancer | TCGA-PRAD/368 (cases) | Decision 3 + 4/4 + 3 | CNN | None | Sample level decision acc. 75% |
Nagpal et al. (2018) [58] | Prostate cancer | TCGA-PRAD + others/train 1,226, test 331 (slides) | Classification Gleason group | CNN + k-NN | None | Overall classification acc. 70% |
Survival analysis | C-index 0.697 | |||||
Litjens et al. (2016) [50] | Prostate cancer | Needle biopsy / 225 (WSIs) | Decision Benign/cancer | CNN | None | Slide level decision AUC 0.99 |
Ertosun and Rubin (2015) [59] | Brain cancer | TCGA-GBM & LGG (unknown size) | Classification | CNN + CNN | Color transform to H&E | GBM/LGG decision acc. 96% |
GBM | LGG grade decision acc. 71% | |||||
LGG grade 2 | ||||||
LGG grade 3 | ||||||
Mobadersany et al. (2018) [60] | Brain cancer | TCGA-GBM & LGG/1,061 (samples) | Survival analysis | CNN | Rotation, normalization | C-index 0.754 |
Wu et al. (2018) [61] | Ovarian cancer | Biopsy/7,392 (images) | Classification Subtypes | CNN | Rotation, image enhancement | Overall classification acc. 78.2% |
Zhang et al. (2017) [62] | Cervix cancer | HEMLBC/1,978 Herlev/917 (images) | Decision Benign/cancer | CNN | Rotation, translation, | Image level decision AUC 0.99 |
Xu et al. (2017) [63] | Sickle cell disease | Red-blood cell/7,206 (patches) | Classification Cell types | CNN | Rotation, flip, translation, etc. | Cell level classification acc. 87.5% |
Meier et al. (2018) [64] | Gastric cancer | TMA/469 (samples) CD8/Ki67 IHC | Survival analysis | CNN | None | Stratification by risk successful (p < .01) |
Xie et al. (2016) [65] | - | Synthetic fluorescence microscopy cell/200 (images) | Cell counting | CNN | None | Mean absolute error < 2% |
Tuominen et al. (2010) [66] | - | IHC stained breast cancer slides/100 | Cell counting | Comp. vision | None | Correlation coefficient 0.98 |
CNN, convolutional neural network; MIL, multiple instance learning; SVM, support vector machine; AUC, area under receiver operating characteristic curve; k-NN, k-nearest neighbor; WSI, whole slide image; CRF, Conditional random field; TCGA, The Cancer Genome Atlas; TMA, tissue microarray; IHC, immunohistochemistry; GBM, glioblastoma multiforme; LGG, lower grade glioma.