Automatic cancer detection on digital histopathology images of mid-gland radical prostatectomy specimens

J Med Imaging (Bellingham) 2020 Medical Imaging 6 Explanations View Original
Original Paper (PDF)

Unable to display PDF. Download it here or view on PMC.

Plain-English Explanations
Pages 1-2
The Challenge of Prostate Cancer Pathology at Scale

After surgical removal of the prostate, pathologists must examine the entire specimen to map the extent, location, and grade of cancer. A radical prostatectomy specimen is processed into many glass slides, each containing a thin tissue section, and pathologists manually inspect each slide under the microscope to identify and grade cancer foci according to the Gleason grading system.

This examination is labor-intensive, time-consuming, and subject to inter-observer variability, particularly for challenging tissue types like high-grade cancer (Gleason pattern 5) or less common components such as cribriform or intraductal carcinoma. With increasing surgical volumes and a shortage of specialist genitourinary pathologists, there is strong motivation for automated tools that can assist in or partially replace the routine screening task.

Whole-slide images (WSIs) are high-resolution digital scans of entire glass slides, producing image files that can contain billions of pixels. Deep learning methods applied to WSIs can potentially replicate and scale the pattern recognition skills of expert pathologists, but require large annotated datasets and specialized computational approaches to handle the enormous image size.

TL;DR: Automated analysis of whole-slide pathology images could help pathologists manage growing prostatectomy volumes and reduce variability in Gleason grading.
Pages 3-5
Tissue Component Mapping Plus AlexNet Transfer Learning

The study's approach combined two components: a tissue component mapping (TCM) step and a deep learning classification step using AlexNet with transfer learning. TCM first segments each WSI into biologically meaningful tissue regions such as stroma, normal glands, atrophic glands, high-grade prostatic intraepithelial neoplasia (HGPIN), and various Gleason pattern cancer grades.

AlexNet is a pioneering deep convolutional neural network architecture that demonstrated the power of deep learning for image classification. Originally trained on ImageNet, it was fine-tuned here to classify small image patches extracted from prostatectomy slide regions into one of the predefined tissue component categories. This transfer learning approach allowed the network to adapt powerful pre-trained visual feature detectors to the specific appearance of prostate tissue.

The dataset comprised 286 whole-slide images from 68 patients who had undergone mid-gland radical prostatectomy sections. Approximately 1.3 million regions of interest (ROIs) were extracted and labeled across these slides, creating one of the largest annotated prostate pathology datasets reported at the time of publication.

Multiple AlexNet-based variants were compared: a standard fine-tuned AlexNet, a version using the TCM feature set as input (AlexNet-TCM), and a version combining both (tune-AlexNet-TCM). The combination model was designed to incorporate both learned deep features and explicitly engineered tissue composition features.

TL;DR: A tissue component mapping step combined with AlexNet transfer learning classified 1.3 million ROIs from 286 whole-slide images of radical prostatectomy specimens.
Pages 7-9
AUC of 0.96-0.98 Across Tissue Classification Tasks

The automated cancer detection system achieved an area under the ROC curve (AUC) of 0.96 to 0.98 across the tissue classification tasks, depending on the specific tissue type and model variant. This level of performance places the system comfortably in the range required for clinical utility.

The tune-AlexNet-TCM model, which combined deep features from fine-tuned AlexNet with tissue component mapping features, showed the most stable and consistent performance. It was particularly effective for rare tissue types, including Gleason pattern 5 cancer, the most aggressive grade, which is also the rarest category and therefore the hardest to learn from limited examples.

Processing time per slide ranged from 3 to 45 minutes per WSI depending on slide size and computational resources. While the slower end of this range may be too slow for high-throughput clinical deployment, the times reflect a proof-of-concept implementation and could likely be reduced significantly through hardware optimization and more efficient code.

TL;DR: The combined tune-AlexNet-TCM model achieved AUC of 0.96-0.98 and was most stable for rare high-grade cancer patterns, processing WSIs in 3-45 minutes.
Pages 5-7
Handling 1.3 Million ROIs: Training Deep Learning at Scale

Processing whole-slide images requires breaking the gigapixel image into smaller regions of interest (ROIs) or patches that are individually classifiable by a CNN. The choice of patch size and extraction strategy determines how much spatial context the network receives and how many training examples are generated per slide.

The 1.3 million ROIs generated from 286 slides provided a large training dataset by medical imaging standards, but still required careful handling to avoid class imbalance issues. Rare tissue types like Gleason pattern 5 represent a small fraction of total tissue area, meaning the model sees far fewer examples of these classes during training. The tissue component mapping step helped address this by providing an explicit feature representation of tissue composition.

The AlexNet architecture, despite being older than more recent architectures such as ResNet or DenseNet, remained effective for this patch-level classification task. The key insight the study contributes is that combining explicit pathological knowledge (tissue component maps) with learned deep features (AlexNet) produces more robust performance than either approach alone, especially for challenging edge cases.

TL;DR: Combining 1.3 million manually labeled ROIs with tissue component maps and AlexNet transfer learning provided robust training for all tissue categories including rare high-grade cancer.
Pages 10-12
Practical Pathology Workflow Integration

A system achieving AUC greater than 0.96 for cancer detection on prostatectomy slides could realistically serve as a screening tool that pre-processes slides before pathologist review. The system could highlight regions likely to contain cancer, allowing pathologists to focus their attention and reduce the time spent confirming negative areas.

For research applications, automated tissue mapping of entire prostatectomy specimens could enable large-scale correlative studies linking spatial patterns of cancer grade to clinical outcomes, genomic data, or imaging features. Manual mapping at this scale is practically infeasible, so automated tools are essential enablers of spatial pathology research.

Quality assurance is another potential application: automated re-review of cases to catch cancers that were missed or misgraded during initial evaluation. This use case is particularly relevant for high-stakes situations such as active surveillance monitoring biopsies, where a missed high-grade cancer focus could delay necessary treatment.

TL;DR: An automated prostate pathology tool could serve as a screening aid, enabling pathologists to focus on suspicious regions and supporting large-scale spatial pathology research.
Pages 22-23
Deep Learning Advances Automated Prostate Pathology

This study demonstrates that combining tissue component mapping with AlexNet transfer learning achieves AUC greater than 0.96 for automated cancer detection across the Gleason grading spectrum on radical prostatectomy whole-slide images. The inclusion of explicit tissue biology features alongside deep features improved performance on the most diagnostically challenging tissue categories.

The work represents a meaningful advance toward clinical-grade automated prostate pathology tools. The scale of the dataset, 286 slides from 68 patients with 1.3 million labeled ROIs, provides a strong foundation, but validation on multi-institutional datasets with diverse processing protocols remains necessary before deployment.

Future directions include extending the approach to biopsy specimens, incorporating additional tissue categories, improving processing speed for real-time clinical deployment, and integrating the automated tissue map with downstream molecular analyses for comprehensive prostatectomy specimen characterization.

TL;DR: Combining tissue component mapping with AlexNet transfer learning achieves high-accuracy prostate cancer detection across all Gleason grades on whole-slide pathology images.
Citation: Open Access, . Available at: PMC7363935.