Integrating context for superior cancer prognosis (original) (raw)

COMPUTATIONAL PATHOLOGY

Nature Biomedical Engineering volume 6, pages 1323–1325 (2022)Cite this article

Subjects

Weakly supervised deep-learning models for the analysis of whole-slide images from tumour biopsies perform better at prognostic tasks if the models incorporate context from the local microenvironment.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

$29.99 / 30 days

cancel any time

Subscribe to this journal

Receive 12 digital issues and online access to articles

$119.00 per year

only $9.92 per issue

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Additional access options:

Fig. 1: Incorporation of context in weakly supervised computational pathology.

References

  1. Bera, K. et al. Nat. Rev. Clin. Oncol. 16, 703–715 (2019).
    Article Google Scholar
  2. Coudray, N. et al. Nat. Med. 24, 1559–1567 (2018).
    Article CAS Google Scholar
  3. Campanella, G. et al. Nat. Med. 25, 1301–1309 (2019).
    Article CAS Google Scholar
  4. Lu, M. Y. et al. Nat. Biomed. Eng. 5, 555–570 (2021).
    Article Google Scholar
  5. Chen, R. J. et al. Whole slide images are 2D point clouds: context-aware survival prediction using patch-based graph convolutional networks. In MICCAI 2021: Medical Image Computing and Computer Assisted Intervention (eds de Bruijne, M. et al.) 339–349 (Springer, 2021).
  6. Lee, Y. et al. Nat. Biomed. Eng. https://doi.org/10.1038/s41551-022-00923-0 (2022).
    Article Google Scholar
  7. Jaume, G. et al. Quantifying explainers of graph neural networks in computational pathology. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds IEEE staff) 8102–8112 (IEEE, 2021).
  8. Dosovitskiy, A. et al. An image is worth 16x16 words: transformers for image recognition at scale. In International Conference on Learning Representations 2021 Paper 1909 (ICLR, 2021).
  9. Shao, Z. C. et al. TransMIL: transformer based correlated multiple instance learning for whole slide image classification. In Advances in Neural Information Processing Systems 34 (eds Ranzato, M., Beygelzimer, A., Dauphin, Y., Liang, P. S. & Wortman Vaughan, J.) 2136–2147 (NeurIPS, 2021).
  10. Chen, R. J. et al. Scaling vision transformers to gigapixel images via hierarchical self-supervised learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (eds IEEE staff) 16144–16155 (IEEE, 2022).

Download references

Author information

Authors and Affiliations

  1. Department of Pathology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
    Guillaume Jaume, Andrew H. Song & Faisal Mahmood
  2. Department of Pathology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
    Guillaume Jaume, Andrew H. Song & Faisal Mahmood
  3. Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA
    Guillaume Jaume, Andrew H. Song & Faisal Mahmood
  4. Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
    Guillaume Jaume, Andrew H. Song & Faisal Mahmood
  5. Harvard Data Science Initiative, Harvard University, Cambridge, MA, USA
    Faisal Mahmood

Authors

  1. Guillaume Jaume
    You can also search for this author inPubMed Google Scholar
  2. Andrew H. Song
    You can also search for this author inPubMed Google Scholar
  3. Faisal Mahmood
    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toFaisal Mahmood.

Ethics declarations

Competing interests

The authors declare no competing interests.

Rights and permissions

About this article

Cite this article

Jaume, G., Song, A.H. & Mahmood, F. Integrating context for superior cancer prognosis.Nat. Biomed. Eng 6, 1323–1325 (2022). https://doi.org/10.1038/s41551-022-00924-z

Download citation

This article is cited by

Associated content