Whole-brain tissue mapping toolkit using large-scale highly multiplexed immunofluorescence imaging and deep neural networks - PubMed (original) (raw)
Whole-brain tissue mapping toolkit using large-scale highly multiplexed immunofluorescence imaging and deep neural networks
Dragan Maric et al. Nat Commun. 2021.
Abstract
Mapping biological processes in brain tissues requires piecing together numerous histological observations of multiple tissue samples. We present a direct method that generates readouts for a comprehensive panel of biomarkers from serial whole-brain slices, characterizing all major brain cell types, at scales ranging from subcellular compartments, individual cells, local multi-cellular niches, to whole-brain regions from each slice. We use iterative cycles of optimized 10-plex immunostaining with 10-color epifluorescence imaging to accumulate highly enriched image datasets from individual whole-brain slices, from which seamless signal-corrected mosaics are reconstructed. Specific fluorescent signals of interest are isolated computationally, rejecting autofluorescence, imaging noise, cross-channel bleed-through, and cross-labeling. Reliable large-scale cell detection and segmentation are achieved using deep neural networks. Cell phenotyping is performed by analyzing unique biomarker combinations over appropriate subcellular compartments. This approach can accelerate pre-clinical drug evaluation and system-level brain histology studies by simultaneously profiling multiple biological processes in their native anatomical context.
Conflict of interest statement
The authors declare no competing interests.
Figures
Fig. 1. Overview of the whole brain tissue phenotyping pipeline for processing highly multiplexed immunohistological (MP-IHC) image datasets acquired using a customized wide-field multispectral epifluorescence imaging platform (refer to Fig. 2 for details) in conjunction with integrated open source computational modules for image reconstruction, optimization and quantitative deep machine learning data analyses (refer to Figs. 3–6 for details).
a The pipeline input consists of raw high-content 2D multispectral MP-IHC imaging datasets sourced from batch slide scans of 10 μm thick serial rat brain tissue sections iteratively probed with a myriad of biomarkers, which are then computationally processed for image registration, and intra- and inter-channel correction prior to deep learning-based quantitative analyses for cell phenotyping, cell counting, and anatomical mapping. b Additional modules include 3D reconstruction from MP-IHC image datasets sourced from multiple batches of serial whole rat brain tissue sections imaged in 2D and processed for volumetric 3D data analyses.
Fig. 2. Overview of the multiplex IHC staining and multispectral epifluorescence imaging platform.
a The imaging platform optimally utilizes the commercial availability of a wide selection of spectrally compatible fluorophores across the full usable light spectrum ranging from ultraviolet to near-infrared (350–800 nm). Components of the wide-field epifluorescence microscope required for 10-color multispectral imaging include a Zeiss AxioImager.Z2 upright fluorescence microscope (left) equipped with a high-resolution objective, a high sensitivity digital camera, a broad-spectrum light excitation source and 10 self-contained excitation/dichroic/emission filter sets optimized to detect up to 10 commonly used or custom-derived spectrally compatible fluorescent reporters (Supplementary Table 2), with minimal spectral cross-talk (Supplementary Table 4), as specified in the excitation/dichroic/emission filter table (right), and exemplified in the included representative images (bottom) of major brain cell types as visualized using a 10-plex immunostaining protocol outlined in Supplementary Table 5. b The basic 10-color fluorescence imaging platform can be user-configured to include different combinations of customized filters to accommodate optimal imaging of different selections of commonly applied and custom-derived fluorescent dyes (Supplementary Table 2) and used iteratively with different selection of immunocompatible biomarkers to label a myriad of brain cell types exemplified in the included representative images in the 50-plex image dataset as visualized using a 5-round immunostaining protocol outlined in Supplementary Table 6.
Fig. 3. Overview of the post-acquisition image optimization module.
a Pixel-to-pixel registration of the separate imaging rounds by detecting the nuclei landmarks from the DAPI channel in each round (top) and applying affine transformation to register the images to the target round (bottom). b Intra-channel correction of non-specific signals introduced during imaging including uneven illumination (left), photobleaching (center), and tissue folds (right) using Alternating Sequential Filters (ASF). The registered image (top) is subtracted from the estimated intra-channel non-specific signal to get the corrected signal (bottom). c Inter-channel correction of non-specific signal to extract spectral bleed-through (left) and molecular co-localization (right) utilizing a semi-supervised sparse linear spectral unmixing approach. Original signal (top) is subtracted from the estimated mixed channel (middle) to get the specific fluorescent signal of interest (bottom).
Fig. 4. Improved nuclei detection in whole brain images using a multiplexed approach.
a Montage showing variability in DAPI (pan-nuclear DNA stain) and histone (pan-nuclear protein) expression labeling across the whole rat brain tissue slice. b–e The sum of the DAPI and pan-histone markers capture nuclear morphology more reliably than either marker alone. f–i Close-up images showing DAPI and pan-histone labeling variations in a sparse and a densely packed region and the generated location (bounding box) results of the proposed model for reliable detection of the cell nuclei using transfer learning approach in conjunction with a Faster-RCNN network. j Receiver Operating Characteristic (ROC) curve of cell nuclei detection using single marker and combination of markers shows significant improvement in performance when both markers are included.
Fig. 5. Improved methods for cell-type classification and quantification using deep morphological features compared to traditional intensity levels thresholding.
a Architecture of the proposed Capsule Network (CapsNet) to extract more comprehensive features for more accurate cell classification. b Pseudo-colored multichannel montage image of 5 major brain cell types. c Computational reconstruction of major cell-type montage from classified seeds (centers of bounding boxes) pseudo-colored to match the color of the actual biomarker expression recapitulating the specific cellular distribution of each cell type in the original raw image in (b) with high fidelity. Histogram of lengths of capsule vectors in the last layer of the network (right) compared to traditional phenotyping approach by thresholding on the histogram of mean signal intensity of the major brain cell-type classification biomarkers (left) measured inside individual bounding boxes using DAPI+histone for seed detection (depicted in Fig. 4f-i) identifying (d) neurons (NeuN), (e) astrocytes (S100β), (f) oligodendrocytes (Olig2), (g) endothelial cells (RECA1), and (h) microglia (Iba1). The histograms of the proposed method shows bimodal distribution with well-separated peaks for better separation of negative and positive population of cells for each cell phenotype with enlarged regions of interest from insets with single biomarker channels and overlaid classified seeds (white dots) illustrates the complete match of the generated cell phenotypes in the raw images.
Fig. 6. Summary of quantification and morphological modules.
a Pseudo-colored multichannel montage of the whole rat brain image scan (left) showing biomarkers used for morphological masking. b–f Selected close-up regions illustrate the original image (top), nucleus/soma mask (middle) and whole cell mask (bottom) including nucleus, cytoplasm, cell processes, plasma membrane for each major brain cell type including oligodendrocytes (b), neurons (c), astrocytes (d), microglia (e) and endothelial cells (f). g Summarized table of enumeration and percentage of cell types and subtypes in a single whole-brain 2D tissue slice shown in (a). h Pseudo-colored multichannel montage image of neuronal cell-subtype classification biomarkers including glutamatergic (GLUT), GABAergic (GAD67), cholinergic (CHAT), catecholaminergic (TH), and uncharacterized neurons. i Computational reconstruction of neuronal cell-subtype montage from classified seeds pseudo-colored to match the color of the actual biomarker expression recapitulating the specific cellular distribution in the original raw image with high fidelity. j–m Enlarged regions of interest from insets in panel (h) with single biomarker channels and overlaid classified seeds (white dots) illustrates the complete match of the generated cell phenotypes in the raw images. n Manually-fitted Paxinos atlas on the 2D brain section to quantify the number of the cells per unit area for phenotypic analysis of cells in defined anatomical regions. Heatmap plot showing the number of positive cells per 106 pixel2 area, exemplified for neurons (o) and the oligodendrocyte (p) population.
Similar articles
- Convolutional neural networks for cytoarchitectonic brain mapping at large scale.
Schiffer C, Spitzer H, Kiwitz K, Unger N, Wagstyl K, Evans AC, Harmeling S, Amunts K, Dickscheid T. Schiffer C, et al. Neuroimage. 2021 Oct 15;240:118327. doi: 10.1016/j.neuroimage.2021.118327. Epub 2021 Jul 2. Neuroimage. 2021. PMID: 34224853 - Automatic recognition of holistic functional brain networks using iteratively optimized convolutional neural networks (IO-CNN) with weak label initialization.
Zhao Y, Ge F, Liu T. Zhao Y, et al. Med Image Anal. 2018 Jul;47:111-126. doi: 10.1016/j.media.2018.04.002. Med Image Anal. 2018. PMID: 29705574 Free PMC article. - Accelerating quantitative susceptibility and R2* mapping using incoherent undersampling and deep neural network reconstruction.
Gao Y, Cloos M, Liu F, Crozier S, Pike GB, Sun H. Gao Y, et al. Neuroimage. 2021 Oct 15;240:118404. doi: 10.1016/j.neuroimage.2021.118404. Epub 2021 Jul 16. Neuroimage. 2021. PMID: 34280526 - In Vivo Observations of Rapid Scattered Light Changes Associated with Neurophysiological Activity.
Rector DM, Yao X, Harper RM, George JS. Rector DM, et al. In: Frostig RD, editor. In Vivo Optical Imaging of Brain Function. 2nd edition. Boca Raton (FL): CRC Press/Taylor & Francis; 2009. Chapter 5. In: Frostig RD, editor. In Vivo Optical Imaging of Brain Function. 2nd edition. Boca Raton (FL): CRC Press/Taylor & Francis; 2009. Chapter 5. PMID: 26844322 Free Books & Documents. Review. - Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review.
Bernal J, Kushibar K, Asfaw DS, Valverde S, Oliver A, Martí R, Lladó X. Bernal J, et al. Artif Intell Med. 2019 Apr;95:64-81. doi: 10.1016/j.artmed.2018.08.008. Epub 2018 Sep 6. Artif Intell Med. 2019. PMID: 30195984 Review.
Cited by
- Hippocampal aggregation signatures of pathogenic UBQLN2 in amyotrophic lateral sclerosis and frontotemporal dementia.
Thumbadoo KM, Dieriks BV, Murray HC, Swanson MEV, Yoo JH, Mehrabi NF, Turner C, Dragunow M, Faull RLM, Curtis MA, Siddique T, Shaw CE, Newell KL, Henden L, Williams KL, Nicholson GA, Scotter EL. Thumbadoo KM, et al. Brain. 2024 Oct 3;147(10):3547-3561. doi: 10.1093/brain/awae140. Brain. 2024. PMID: 38703371 Free PMC article. - Analgesic candidate adenosine A 3 receptors are expressed by perineuronal peripheral macrophages in human dorsal root ganglion and spinal cord microglia.
Sapio MR, Staedtler ES, King DM, Maric D, Jahanipour J, Ghetti A, Jacobson KA, Mannes AJ, Iadarola MJ. Sapio MR, et al. Pain. 2024 Oct 1;165(10):2323-2343. doi: 10.1097/j.pain.0000000000003242. Epub 2024 Apr 30. Pain. 2024. PMID: 38691673 - Classification of Activated Microglia by Convolutional Neural Networks.
Hsu CH, Agaronyan A, Katherine R, Kadden M, Ton HT, Wu F, Lin YS, Lee YJ, Wang PC, Shoykhet M, Tu TW. Hsu CH, et al. IEEE Biomed Circuits Syst Conf. 2022 Oct;2022:198-202. doi: 10.1109/biocas54905.2022.9948635. Epub 2022 Nov 16. IEEE Biomed Circuits Syst Conf. 2022. PMID: 38544681 Free PMC article. - Histological Characterisation of a Sheep Model of Mild Traumatic Brain Injury: A Pilot Study.
Tan S, Hamlin D, Kwon E, Scadeng M, Shim V, Holdsworth S, Guild SJ, Murray H. Tan S, et al. Neurotrauma Rep. 2024 Mar 6;5(1):194-202. doi: 10.1089/neur.2023.0105. eCollection 2024. Neurotrauma Rep. 2024. PMID: 38463420 Free PMC article. - Spatial landmark detection and tissue registration with deep learning.
Ekvall M, Bergenstråhle L, Andersson A, Czarnewski P, Olegård J, Käll L, Lundeberg J. Ekvall M, et al. Nat Methods. 2024 Apr;21(4):673-679. doi: 10.1038/s41592-024-02199-5. Epub 2024 Mar 4. Nat Methods. 2024. PMID: 38438615 Free PMC article.
References
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources