Machine Learning for Differentiation of Breast Cancer and High-Risk Proliferative Lesions (original) (raw)

Key Points

Question Can computer vision and machine learning methods be used for automated diagnosis of preinvasive and invasive lesions of the breast to improve diagnostic accuracy?

Findings This diagnostic study of 240 breast biopsies categorized by 3 expert pathologists evaluated 2 sets of image features, which achieved sensitivity and specificity comparable with 87 pathologists in the diagnosis of breast biopsy samples. The computer-based, automated approach outperformed pathologists in differentiating ductal carcinoma in situ from atypia.

Meaning The findings suggest that machine learning methods are potentially suitable as diagnostic support systems in differentiating challenging preinvasive lesions of the breast.

Importance Following recent US Food and Drug Administration approval, adoption of whole slide imaging in clinical settings may be imminent, and diagnostic accuracy, particularly among challenging breast biopsy specimens, may benefit from computerized diagnostic support tools.

Objective To develop and evaluate computer vision methods to assist pathologists in diagnosing the full spectrum of breast biopsy samples, from benign to invasive cancer.

Design, Setting, and Participants In this diagnostic study, 240 breast biopsies from Breast Cancer Surveillance Consortium registries that varied by breast density, diagnosis, patient age, and biopsy type were selected, reviewed, and categorized by 3 expert pathologists as benign, atypia, ductal carcinoma in situ (DCIS), and invasive cancer. The atypia and DCIS cases were oversampled to increase statistical power. High-resolution digital slide images were obtained, and 2 automated image features (tissue distribution feature and structure feature) were developed and evaluated according to the consensus diagnosis of the expert panel. The performance of the automated image analysis methods was compared with independent interpretations from 87 practicing US pathologists. Data analysis was performed between February 2017 and February 2019.

Main Outcomes and Measures Diagnostic accuracy defined by consensus reference standard of 3 experienced breast pathologists.

Results The accuracy of machine learning tissue distribution features, structure features, and pathologists for classification of invasive cancer vs noninvasive cancer was 0.94, 0.91, and 0.98, respectively; the accuracy of classification of atypia and DCIS vs benign tissue was 0.70, 0.70, and 0.81, respectively; and the accuracy of classification of DCIS vs atypia was 0.83, 0.85, and 0.80, respectively. The sensitivity of both machine learning features was lower than that of the pathologists for the invasive vs noninvasive classification (tissue distribution feature, 0.70; structure feature, 0.49; pathologists, 0.84) but higher for the classification of atypia and DCIS vs benign cases (tissue distribution feature, 0.79; structure feature, 0.85; pathologists, 0.72) and the classification of DCIS vs atypia (tissue distribution feature, 0.88; structure feature, 0.89; pathologists, 0.70). For the DCIS vs atypia classification, the specificity of the machine learning feature classification was similar to that of the pathologists (tissue distribution feature, 0.78; structure feature, 0.80; pathologists, 0.82).

Conclusion and Relevance The computer-based automated approach to interpreting breast pathology showed promise, especially as a diagnostic aid in differentiating DCIS from atypical hyperplasia.

In 2019, more than 1 million individuals in the United States will undergo a breast biopsy, with an estimated 268 600 patients diagnosed with breast cancer and 3-fold that number receiving a noncancer diagnosis.1 There is growing concern in the medical community that the fear of underdiagnosing a patient leads to overdiagnosis and contributes to the ever-increasing numbers of cancer cases. Although an exact estimate of overdiagnosed cases is unknown, several studies2,3 have hypothesized and estimated its prevalence in breast cancer diagnosis. Whole-slide imaging (WSI), a technology that captures the contents of a glass slide in a multiresolution image, is revolutionizing diagnostic medicine by providing researchers with tools to study diagnostic missteps and develop diagnostic support systems. US Food and Drug Administration regulations limited the use of WSIs to nonclinical purposes, such as research and biorepositories, until April 2017, when the first Food and Drug Administration–approved WSI system for diagnostic medicine was announced.4 With this development, the US health care system will undergo a major shift toward digital pathology, and the resulting need for automated diagnosis tools that can lead to computer-aided diagnostic support systems will be significant.

Machine learning, including the use of deep neural networks, has been successfully used in a wide range of breast cancer image analysis tasks. These include differentiating between atypical ductal hyperplasia and ductal carcinoma in situ (DCIS) in mammograms,5 detecting lymph node metastases,6 automating diagnosis (including preinvasive lesions) in tissue microarray images,7 and identifying tumor-associated stroma in histopathology images.8 Automated breast cancer diagnosis has also been studied extensively in the computer vision and medical literature, yet little work exists on the full spectrum of breast lesions from benign lesions and atypia to DCIS and invasive cancer.9,10 Most methods deal with tumor detection only, ie, detection of invasive cancer vs noncancer,11 and the studies on preinvasive lesions considered the binary classification task of differentiating DCIS from benign proliferations.10 Invasive cancer constitutes only a quarter of the results of breast biopsies performed in the United States, while the rest are categorized into a diagnostic spectrum from benign to preinvasive disease.12 Preinvasive lesions, which include the categories atypia and DCIS, are associated with a higher risk of cancer, and individuals with these findings may require additional interventions and treatments. However, diagnostic disagreements are remarkably high for these preinvasive lesions. A study of 115 pathologists found that the level of agreement between pathologists and a consensus diagnosis of experts for atypia cases is only 48% (95% CI, 44%-52%).13 Preinvasive lesions are an integral part of the diagnostic evaluation of breast biopsy specimens and present a more difficult classification scenario for pathologists than the binary classification task of determining whether a breast biopsy sample shows invasive cancer.

We proposed novel image features for the differentiation of the full spectrum of breast lesions that covers benign, atypia, DCIS, and invasive breast cancer. In particular, we introduced the structure feature, which summarizes the architectural changes in ductal structures based on a semantic segmentation of tissue types in the breast. Our methods differ from prior work in that we attempted to emulate the behavior of pathologists as they interpret these cases by tackling successive binary decisions that were sequentially more challenging on the diagnostic difficulty scale.

Breast Biopsy Samples and WSIs

Digital WSIs of breast biopsies were selected from Breast Cancer Surveillance Consortium–associated tumor registries14 in New Hampshire and Vermont. Atypia and DCIS tend to be more challenging diagnostically; thus, these categories were oversampled relative to national estimates to increase statistical confidence for evaluating disease categories with lower prevalence. Other criteria taken into consideration during case selection included patient age and breast density. Development of the 240 cases has been previously described in detail.15 The hematoxylin-eosin–stained glass slides were scanned using an iScan CoreoAu scanner (Roche) (original magnification ×40). A technician and an experienced breast pathologist (D.L.W.) reviewed each digital image, rescanning as needed to obtain the highest quality. The average image size for the 240 individual WSIs was 90 000 × 70 000 pixels. Institutional review boards at the University of Washington, Dartmouth College, the University of Vermont, the Fred Hutchinson Cancer Research Center, and Providence Health and Services of Oregon approved all test set study activities.13

Expert Consensus Diagnosis and Regions of Interest

A set of 14 diagnoses and 4 diagnostic categories (benign, atypia, DCIS, and invasive) was developed for the analysis. Initial diagnoses and the mapping strategy used for the final diagnostic categories are provided in eTable 1 in the Supplement. The 240 digital WSIs were interpreted independently by 3 experienced pathologists using a web-based virtual slide viewer. Each expert marked 1 or more regions of interest (ROIs) on each slide that included the features supporting their final diagnosis. Several in-person meetings and webinars were held to determine a consensus diagnosis and consensus ROIs for each digital slide, resulting in a final set of 428 ROIs including 102 benign (23.8%), 128 atypia (29.9%), 162 DCIS (37.9%), and 36 invasive ROIs (8.4%). Additional detail regarding the expert consensus review and development of the diagnostic mapping have been described.16 The characteristics of the 240 cases are summarized in eTable 2 in the Supplement.

As part of a larger study on diagnostic concordance in digital and traditional glass slides,17 pathologists from 8 US states were invited to participate in the study. Pathologists who regularly interpreted breast biopsy specimens in their clinical practices were eligible. Overall, 87 participants interpreted a subset of 60 biopsy specimens in each of the 4 subsets, with interpretations performed on the digital slides using a web-based virtual slide viewer. Each participant was randomly assigned a test set, and each participant viewed the WSIs in a randomly determined order with no time constraints. The pathologists provided informed consent. The comparison of participants’ diagnoses with expert consensus diagnoses was previously reported.13,17 In this work, we compare the performance of the machine learning methods on the same data set with the average performance of multiple participating pathologists who independently interpreted the same cases.

We used a 2-step approach, starting with semantic segmentation of the biopsy images into tissue labels, followed by feature extraction and diagnostic classification. The semantic segmentation produced a label image in which each pixel has a single tissue label. Then, the tissue label image was used to extract 2 features: a tissue distribution feature and a structure feature that is based on breast anatomy. Finally, we evaluated our features in diagnostic classification tasks.

Tissue Label Segmentation

A set of 8 clinical labels was used to annotate the breast biopsy images as follows: (1) background, (2) normal stroma (connective tissue), (3) malignant epithelium, (4) blood, (5) benign epithelium, (6) secretion (benign discharge filling the ducts), (7) desmoplastic stroma (connective tissue associated with tumor), and (8) necrosis (dead epithelial cells secondary to hypoxia) (Figure 1). Because of the expertise needed to mark the tissue labels and the size of the images, a subset of 40 specimens with 58 ROIs were randomly selected for annotation by an experienced breast pathologist (J.B.), preserving the distribution of case characteristics of the original 240 cases.

We implemented an end-to-end tissuewise segmentation system using a state-of-the-art convolutional neural network architecture. Our system (Figure 2) is a multiresolution encoder-decoder network with residual connections following the work of Fakhry et al18 that is designed to address the challenges of these images, especially the variability in size and shape of different structures present in breast biopsy images. The convolutional neural network takes input at multiple resolutions and encodes strong spatial representations by performing convolutional, downsampling, and upsampling operations. Starting with a standard encoder-decoder architecture, we used residual blocks and residual connections between encoding and corresponding decoding blocks. To aggregate features learned at different resolutions, we implemented a multiresolution network that uses a larger patch around the input image, downsamples the image to different resolutions, and applies convolutions (and deconvolutions) at different resolutions, which are again connected with residual connections. A detailed study of our segmentation system was previously described.19

Tissue Distribution Feature for Diagnosis

A basic visual difference between diagnostic categories in pathology is the existence (and amount) of different biological structures. Using the simple linear iterative clustering20 algorithm, the images were segmented into superpixels_,_ which are regions of similar color with an area of about 3000 pixels. The size and other parameters of the superpixel segmentation were selected so that a superpixel covered at least 1 epithelial cell. Each superpixel was then assigned a tissue label (the label belonging to most of its pixels) based on the label image produced in the previous step. To capture the distribution and simple spatial relationships of the tissues, we calculated the tissue distribution by means of frequency and co-occurrence histograms over superpixels.

Structure Feature for Diagnosis

Our structure feature describes the changes in the shape of the epithelial structures in the breast biopsy slides. Using the epithelium labels assigned by the semantic segmentation, we identified objects of interest, which may be a duct, a group of ducts, or a tumor. Then, starting from the outer border of the object, we extracted 5 layers toward the inside of the object and 5 layers toward the outside. For each layer, we calculated a normalized frequency histogram of 8 tissue types. Figure 3A-C shows the calculation of the structure feature for a duct. Figure 3D-E illustrates the structure feature for 2 different duct images whose labels are shown as pseudocolors above and whose structure feature histograms are shown below. In the histograms, the columns represent the 8 labels, and the rows represent the 10 layers. The histogram bin values are shown as a heat map in which red is the highest value and dark blue is the lowest.

In our implementation, we used superpixels as the structural elements. The layers of the structure feature were defined 1-superpixel thick, and the layer histograms were built by counting superpixels. Although other structural elements can be used (eg, patches, pixels, or hexagons), superpixels provide a good definition for the object borders and are widely used in segmentation.21

The definition of a layer and the number of layers can be adapted for different data sets and different problems. In our implementation, we defined the layers starting from the outer border of the objects of interest, ie, ducts. We used 5 inner and 5 outer layers. Because the size of the superpixels was selected based on the size of an average epithelial cell in our images, the first 1 or 2 layers of epithelial superpixels at the circumference of the duct would define a normal duct. For our data set of breast biopsy images, 5 inner layers and 5 outer layers were generalizable to all diagnostic categories yet still powerful enough to describe the structural changes.

A critical step in the implementation of the structure feature is the definition and detection of the objects of interest, ie, ducts. Breast ducts are composed of epithelial cells; however, in certain cases, ducts were filled with secretion or necrosis. To get a complete picture of the structure, we used epithelium (both benign and malignant), secretion, and necrosis labels to obtain a binary image. After cleaning small objects, we applied connected components analysis to identify individual objects (ducts or duct groups). Figure 4 shows an example image with its tissue label segmentation, the binary image of the union of epithelium, secretion, and necrosis labels, and the detected objects overlaid on the original image.

The structure features were calculated for the ducts, but the diagnostic classes were assigned to the ROIs. To obtain a feature vector for each image, the histograms for each layer were summed up. Ideally, we would have liked to classify each duct. Although the experts marked the smallest possible ROI, some still contained benign ducts or lesser diagnoses than the ROI assigned. Although we averaged the structural properties of all the ducts in an ROI by summing the histograms, the feature vector should be dominated by the largest structures in the ROI.

Diagnostic Classification

The diagnostic decision-making process, during which pathologists interpret the whole slide at the resolution at which different image characteristics are best viewed, is complex. For example, the high-level organization of tissue that is needed to diagnose invasive cancer is available to the observer at lower resolutions, whereas the structural and cellular features that distinguish preinvasive lesions are usually observed at higher resolutions. Furthermore, the features that describe an invasive carcinoma do not apply to other diagnoses; in other words, different visual cues are used for different diagnoses. It may not be reasonable to expect a machine algorithm to accurately classify an image de novo into the full range of diagnostic categories. Based on this observation and discussions with expert pathologists and practicing clinicians on how a clinical diagnosis is performed, we designed a classification scheme in which a decision is made for a single diagnosis at a time, as follows: (1) classification of invasive cancer or noninvasive diagnosis, (2) classification of noninvasive diagnosis into preinvasive lesions (atypia and DCIS) or benign, and (3) classification of DCIS or atypia.

We evaluated the performance of the tissue distribution feature and the structure feature. Whole slide images can contain multiple diagnoses, but the ROIs were carefully marked by our clinical experts to represent the final diagnosis. Therefore, we used the 428 ROIs with the consensus diagnosis labels as our data set in diagnostic classification experiments.

For all experiments, we trained and tested support vector machine classifiers with a third degree polynomial kernel in a leave-1-out cross-validation setting. When the sample size was smaller than the number of features, we applied principal components analysis and used the first 20 principal components to reduce the number of features. During training, we subsampled the training data to have an equal number of samples for each class so that the random chance for classifying each slide to a diagnostic category was 50% and the trained machine learning model had no bias toward the larger diagnostic class. To reduce the effect of subsampling, we repeated all experiments 100 times and reported the average accuracies.

We reported classification accuracies as well as sensitivity and specificity metrics for the classification experiments. In terms of true positives (TPs), true negatives (TNs), false-positives (FPs), and false-negatives (FNs), accuracy was defined as (TP + TN) / (TP + TN + FP + FN). Sensitivity was defined as TP / (TP + FN), and specificity was defined as TN / (TN + FP). We also reported the accuracy (correct classification rate) for each classification task. Cross-validation experiments were repeated 100 times with subsampling, and accuracies were reported. All models were developed and trained in MATLAB (R) (Mathworks) using the LIBSVM open-source library.22

The Table shows the results of the automated analyses on the 3 tasks and for different features compared with the expert consensus reference standard for assessing accuracy. The comparison is between which feature was used (ie, tissue distribution feature or structure feature). In addition, the results of the automated analyses on each of the 3 tasks are shown compared with the results of the US pathologists who interpreted these samples in the digital WSI format. As there were 87 pathologists distributed to 1 of 4 test sets, each specimen was reviewed by 18 to 24 practicing pathologists.

In the classification of invasive cases, the tissue distribution feature achieved the highest accuracy (0.94). The same feature had a low sensitivity (0.70) but a high specificity (0.95). In other words, 30% of the invasive cases were missed, but there were very few FPs. In comparison, the participants had a 0.84 sensitivity and 0.99 specificity.

The most difficult task was the separation of benign samples from atypia and DCIS. We achieved only 0.70 accuracy using the structure feature with the support vector machine–based segmentation. The same feature had a sensitivity of 0.85 and a specificity 0.45. In other words, almost half the benign cases were overdiagnosed as atypia or DCIS, but the FN rates were low. In comparison, the participants had 0.72 sensitivity and 0.62 specificity.

The classification of DCIS and atypia with the structure feature achieved 0.85 accuracy, 0.89 sensitivity, and 0.80 specificity. In comparison, the participants had 0.70 sensitivity and 0.82 specificity for the DCIS cases.

We proposed a novel machine learning approach, the structure feature, for the classification of breast tissue. Our experiments showed that when there is no defined ductal structure, such as in invasive cancer, a tissue distribution feature, which captures the frequency and co-occurrence of the tissues, is sufficient for classification. In other words, simpler features may be considered for mass screenings that identify invasive carcinomas, and more sophisticated features, such as our structure feature, may be considered for a finer subclassification of preinvasive ductal lesions. Because invasive cancer does not follow the rules and principles of normal tissue organization, it is logical to remove invasive cancer from the larger pool of specimens prior to classification of the remaining high-risk lesions, which we accomplished with our stepped approach to classification.

Early work in this field by Mercan et al23,24 used an older class structure of 5 breast tissue classes. The ROI-level classification results obtained an accuracy of 0.77, but the sensitivity was only 0.42 with specificity of 0.85. In other words, their classifier was very good at finding TNs, but it was not very good at detecting cancer. The ensuing work by Gecer et al,25 which also used the 5-class diagnostic structure, obtained an overall accuracy of 0.55 with their method of majority voting and saliency detection, but they did not report sensitivity and specificity. Mehta et al26 developed an entirely new deep learning architecture called Y-net for simultaneous segmentation and classification at the ROI-level. Using the 4-class structure that is defined in the present article, they obtained an overall accuracy of 0.63 and did not report on sensitivity and specificity.26 A major emphasis of this paper by Mehta et al26 was the structure and speed of the deep neural network.

The work in our study expands beyond these articles, as we have designed a different method for classification, using a hierarchical structure instead of a single 4-way or 5-way classifier. Our approach mimics the diagnostic decision-making process of a pathologist who eliminates a single diagnosis at a time instead of choosing between multiple diagnoses. Our results also show improved accuracy compared with these earlier works. In clinical practice, data on sensitivity and specificity are important and useful parameters. The overall accuracy of a research test set may be influenced by the distribution of cases (eg, the test set used in earlier work had a higher prevalence of cases of atypia and DCIS, thus making the overall accuracy lower than expected in clinical practice). We therefore presented data on sensitivity and specificity for each step in our work. In the classification tasks of atypia and DCIS vs benign and DCIS vs atypia, the associated sensitivities are higher than the sensitivity of the practicing pathologists who independently interpreted the same specimens.

Strengths and Limitations

The strengths of our study include a large set of images that comprised a full spectrum of diagnostic categories and a novel approach to a difficult diagnostic classification problem. Although larger WSI data sets exist, they almost always lack the diagnostic diversity or image quality of our data set. Instead of approaching this topic as a multiclass classification, we ran multiple experiments to determine which features and approach work best for differentiating a range of diagnoses. An important aspect of our work is that we also compared our results with interpretations on each case from a large pool of actively practicing pathologists with varying experience in breast pathology. Our ground truth segmentation data was also provided by a surgical pathologist who spent months carefully painting the labels on a set of training data.

While machine learning methods hold great promise in the field of pathology, we recognize the limitations of our study. In clinical practice, a diagnosis is rendered with multiple cross-sections and images rather than a single image per patient, as provided in our study. Additional clinical information and second opinions are also available to pathologists, which may improve their accuracy in a real-life clinical setting. Furthermore, we expect that the finer classification of epithelial atypia will require more annotation work but may improve the performance of diagnostic classification. Additionally, our system works on manually marked regions of interest, but with the use of an ROI-detection system,25,27 it could be extended to WSIs.

This study presents a novel machine learning feature, called the structure feature, for describing the area around a duct in WSIs of breast biopsies. Using a data set of 240 breast biopsy samples ranging from benign epithelial proliferation to invasive carcinoma, we conducted a thorough set of experiments with multiple methods of tissue segmentation and diagnostic classification and compared the machine learning results with interpretations from a group of practicing pathologists. The best classification results came close to those of the pathologists for invasive vs noninvasive diagnoses, lagged behind them in diagnosing atypia and DCIS vs benign specimens (which the pathologists also found difficult), and outperformed them in differentiating DCIS from atypia, which is considered the most diagnostically difficult task in clinical practice. With further improvements in the machine learning techniques we used—or even improvements at the cellular level—it may be possible for computer vision methods to be used in conjunction with pathologists’ intuition to improve diagnostic performance.

Article Information

Accepted for Publication: June 18, 2019.

Published: August 9, 2019. doi:10.1001/jamanetworkopen.2019.8777

Corresponding Author: Joann G. Elmore, MD, MPH, Division of General Internal Medicine and Health Services Research, Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, 1100 Glendon Ave, Ste 900, Los Angeles, CA 90024 (jelmore@mednet.ucla.edu).

Author Contributions: Drs Shapiro and Elmore had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Mercan, Mehta, Shapiro, Weaver, Elmore.

Acquisition, analysis, or interpretation of data: Mercan, Mehta, Bartlett, Weaver, Elmore.

Drafting of the manuscript: Mercan, Mehta, Elmore.

Critical revision of the manuscript for important intellectual content: Mercan, Bartlett, Shapiro, Weaver, Elmore.

Statistical analysis: Mercan, Mehta.

Obtained funding: Weaver, Elmore.

Administrative, technical, or material support: Mercan, Bartlett, Weaver, Elmore.

Supervision: Mercan, Shapiro, Weaver.

Conflict of Interest Disclosures: Dr Elmore reported serving as editor in chief for primary care topics at UpToDate. No other disclosures were reported.

Funding/Support: Research reported in this article was supported by grants R01 CA172343, R01 CA140560, U01 CA231782, and R01 CA200690 from the National Cancer Institute of the National Institutes of Health.

Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Additional Contributions: Selim Aksoy, PhD (Department of Computer Engineering, Bilkent University), helped with the project during his sabbatical at University of Washington. He was not compensated for his work on this project. We thank Ventana Medical Systems, a member of the Roche Group, for use of iScan CoreoAu digital scanning equipment.

Nelson HD, Cantor A, Humphrey L, et al. Screening for breast cancer: a systematic review to update the 2009 U.S. Preventive Services Task Force Recommendation. http://europepmc.org/abstract/med/26889531. Accessed July 2, 2019.

Ha R, Mutasa S, Sant EPV, et al. Accuracy of distinguishing atypical ductal hyperplasia from ductal carcinoma in situ with convolutional neural network-based machine learning approach using mammographic image data. AJR Am J Roentgenol. 2019:1-6.PubMed Google Scholar

Ehteshami Bejnordi B, Veta M, Johannes van Diest P, et al; CAMELYON16 Consortium. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA. 2017;318(22):2199-2210. doi:10.1001/jama.2017.14585 PubMed Google Scholar Crossref

Motlagh NH, Jannesary M, Aboulkheyr H, et al. Breast cancer histopathological image classification: a deep learning approach. bioRxiv. 2018:242818. doi:10.1101/242818 Google Scholar

Nahid AA, Mehrabi MA, Kong Y. Histopathological breast cancer image classification by deep neural network techniques guided by local clustering. Biomed Res Int. 2018:2362108. doi:10.1155/2018/2362108 Google Scholar

Weaver DL, Rosenberg RD, Barlow WE, et al. Pathologic findings from the Breast Cancer Surveillance Consortium: population-based outcomes in women undergoing biopsy after screening mammography. Cancer. 2006;106(4):732-742. doi:10.1002/cncr.21652 PubMed Google Scholar Crossref

Oster NV, Carney PA, Allison KH, et al. Development of a diagnostic test set to assess agreement in breast pathology: practical application of the Guidelines for Reporting Reliability and Agreement Studies (GRRAS). BMC Womens Health. 2013;13(1):3. doi:10.1186/1472-6874-13-3 PubMed Google Scholar Crossref

Allison KH, Reisch LM, Carney PA, et al. Understanding diagnostic variability in breast pathology: lessons learned from an expert consensus review panel. Histopathology. 2014;65(2):240-251. doi:10.1111/his.12387 PubMed Google Scholar Crossref

Mehta S, Mercan E, Bartlett J, Weaver DL, Elmore JG, Shapiro LG. Learning to segment breast biopsy whole slide images. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). New York, NY: Institute of Eletrical and Electronics Engineers. 2018:663-672. doi:10.1109/WACV.2018.00078.

Ren X, Malik J. Learning a classification model for segmentation. In: Proceedings Ninth IEEE International Conference on Computer Vision. New York, NY: Institute of Eletrical and Electronics Engineers. 2003:10-17. doi:10.1109/ICCV.2003.1238308.

Mercan C, Aksoy S, Mercan E, Shapiro LG, Weaver DL, Elmore JG. Multi-instance multi-label learning for multi-class classification of whole slide breast histopathology images. IEEE Trans Med Imaging. 2017;37(1):316-325. doi:10.1109/TMI.2017.2758580 PubMed Google Scholar Crossref

Mercan C, Mercan E, Aksoy S, Shapiro LG, Weaver DL, Elmore JG. Multi-instance multi-label learning for whole slide breast histopathology. SPIE Proc. 2016;9791. doi:10.1117/12.2216458.

Mehta S, Mercan E, Bartlett J, Weave D, Elmore JG, Shapiro L. Y-Net: joint segmentation and classification for diagnosis of breast biopsy images. https://arxiv.org/abs/1806.01313. Accessed July 2, 2019.