Microscopy Image Browser: A Platform for Segmentation and Analysis of Multidimensional Datasets - PubMed (original) (raw)
Microscopy Image Browser: A Platform for Segmentation and Analysis of Multidimensional Datasets
Ilya Belevich et al. PLoS Biol. 2016.
Abstract
Understanding the structure-function relationship of cells and organelles in their natural context requires multidimensional imaging. As techniques for multimodal 3-D imaging have become more accessible, effective processing, visualization, and analysis of large datasets are posing a bottleneck for the workflow. Here, we present a new software package for high-performance segmentation and image processing of multidimensional datasets that improves and facilitates the full utilization and quantitative analysis of acquired data, which is freely available from a dedicated website. The open-source environment enables modification and insertion of new plug-ins to customize the program for specific needs. We provide practical examples of program features used for processing, segmentation and analysis of light and electron microscopy datasets, and detailed tutorials to enable users to rapidly and thoroughly learn how to use the program.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
Fig 1. MIB recognizes a large array of imaging formats and offers many essential image processing tools.
(A) Most common image formats can be imported to (left column) and exported from (right column) MIB. Most commonly used image processing tools are listed in the middle column (see MIB website for the full list). (B) Image segmentation workflow usually comprises a combination of several approaches. Datasets can be segmented iteratively using various manual and semiautomatic tools combined with quantification filtering of results in order to generate a model. Data in MIB are organized in four layers: Image (raw data), Selection (active layer for segmentation), Mask (an optional supporting layer for temporal storage of the segmentation results for evaluation and filtering), and Model (containing the final segmentation).
Fig 2. The selection of the best suitable tool for segmentation depends on specimen and object of interest.
Five examples are given: in (A–D), the top row of each image shows a preprocessed slice and a segmentation overlay, and the bottom row shows the final 3-D visualization. Segmentation was done with MIB, and the 3-D rendering using different freeware (A–D) and commercial (E) software packages. (A) Trypanosoma brucei was chemically fixed and imaged with electron tomography (ET). Each Golgi cisternae (four shades of blue) was manually segmented using the brush tool, while ER and ER-derived vesicles (yellow) were segmented using a combination of the brush tool and shape interpolation. The resulting 3-D model was rendered directly in MIB. (B) A Huh-7 cell was high-pressure frozen and freeze-substituted, and a portion of the cell was subjected to ET [11]. ER (yellow) was segmented using the brush tool with shape interpolation and microtubules (magenta) using the line tracker tool. The resulting model was exported in the IMOD-compatible format and rendered in IMOD [6]. (C) A Huh-7 cell transiently expressing ssHRP-KDEL was cytochemically stained (dark precipitate) and imaged with a serial block-face scanning electron microscope (SB-EM) [11]. The ER network (yellow) was segmented semiautomatically using global black-and-white thresholding and further polished using quantification filtering [11]. The model was exported in the nearly raw raster data (NRRD) format and rendered in 3D Slicer [8]. (D) Mouse cochlea was perilymphatically fixed, and the sensory epithelium of the medial part of the cochlear duct was imaged with SB-EM [13]. Different cell types of the organ of Corti (inner hairs in green, outer hair cells in yellow, external rod in vermilion, internal rod in sapphire blue, and phalangeal part of the Deiters’ cells in greyish blue) were segmented using local thresholding combined with shape interpolation and model rendered using 3D Slicer. (E) Stepwise segmentation workflow is needed to generate a 3-D model of a complex structure. A metaphase Huh-7 cell transiently expressing ssHRP-KDEL was cytochemically stained (dark precipitate in ER lumen) and imaged with SB-EM [10]. The modelling workflow for ER consists of 13 steps (S1 Table). For the visualization, the model was exported in the AmiraMesh format and rendered in Amira. Scale bars: A, B 500 nm; C, D, E 5 μm.
Fig 3. Semiautomatic image segmentation in MIB can dramatically decrease the time spent on modelling.
(A) The Random Forest classifier was used to segment ER from wide-field time-lapse LM videos of Huh-7 cells. Labels were assigned (central image) to mark ER (Hsp47-GFP marker seen in green) and background (red), which were then used to train the classifier and segment ER throughout the time-lapse video (right image). (B) The semiautomatic watershed segmentation was used for segmentation of nucleus in the sieve element of A. thaliana root imaged with SB-EM [14]. Assigning of just two labels (green for nucleus and vermilion for background) was sufficient to segment the complete nucleus in 3-D (light blue, image on the right). (C) The separation of the fused objects using the watershed segmentation. The human U251MG astrocytoma cells were loaded with oleic acid producing a large amount of lipid droplets (LDs) (left image) that tend to form clusters. LDs were segmented using marker-controlled watershed; however, because of close proximity, most of the LDs appear merged (the second image). The object separation mode of the watershed tool was used to separate individual LDs for quantitative analysis (third and fourth images). The 3-D models were rendered with 3D Slicer [8]. Scale bars: 2 μm.
Fig 4. Quantification and visualization of results are the final steps of the imaging workflow.
Generated models may be quantified to extract different parameters of the segmented objects and visualized using a number of programs. As an example, the volumes (μm3) and numbers of segmented mitochondria were calculated (the plot in red). The quantifications results can either be plotted directly in MIB or exported to MATLAB or Microsoft Excel. The manual measurements of angles, distances, caliper, and radius complement automatic quantification. The visualization of the mitochondria model (in green) is demonstrated using six alternative programs (the lower row).
Fig 5. MIB has a user-friendly graphical user interface and is freely available from the website.
(A) A screenshot of the MIB user interface. The program menu, toolbar, and panels are highlighted. A brief description of each element is provided. (B) A dedicated website includes direct links for software download and covers various topics and aspects of MIB functionality. Image credit: Ilya Belevich, on behalf of MIB.
Similar articles
- Modular segmentation, spatial analysis and visualization of volume electron microscopy datasets.
Müller A, Schmidt D, Albrecht JP, Rieckert L, Otto M, Galicia Garcia LE, Fabig G, Solimena M, Weigert M. Müller A, et al. Nat Protoc. 2024 May;19(5):1436-1466. doi: 10.1038/s41596-024-00957-5. Epub 2024 Feb 29. Nat Protoc. 2024. PMID: 38424188 Review. - LOBSTER: an environment to design bioimage analysis workflows for large and complex fluorescence microscopy data.
Tosi S, Bardia L, Filgueira MJ, Calon A, Colombelli J. Tosi S, et al. Bioinformatics. 2020 Apr 15;36(8):2634-2635. doi: 10.1093/bioinformatics/btz945. Bioinformatics. 2020. PMID: 31860062 - The ImageJ ecosystem: Open-source software for image visualization, processing, and analysis.
Schroeder AB, Dobson ETA, Rueden CT, Tomancak P, Jug F, Eliceiri KW. Schroeder AB, et al. Protein Sci. 2021 Jan;30(1):234-249. doi: 10.1002/pro.3993. Epub 2020 Nov 20. Protein Sci. 2021. PMID: 33166005 Free PMC article. - Mol* Volumes and Segmentations: visualization and interpretation of cell imaging data alongside macromolecular structure data and biological annotations.
Chareshneu A, Midlik A, Ionescu CM, Rose A, Horský V, Cantara A, Svobodová R, Berka K, Sehnal D. Chareshneu A, et al. Nucleic Acids Res. 2023 Jul 5;51(W1):W326-W330. doi: 10.1093/nar/gkad411. Nucleic Acids Res. 2023. PMID: 37194693 Free PMC article. - The ImageJ ecosystem: An open platform for biomedical image analysis.
Schindelin J, Rueden CT, Hiner MC, Eliceiri KW. Schindelin J, et al. Mol Reprod Dev. 2015 Jul-Aug;82(7-8):518-29. doi: 10.1002/mrd.22489. Epub 2015 Jul 7. Mol Reprod Dev. 2015. PMID: 26153368 Free PMC article. Review.
Cited by
- DeepMIB: User-friendly and open-source software for training of deep learning network for biological image segmentation.
Belevich I, Jokitalo E. Belevich I, et al. PLoS Comput Biol. 2021 Mar 2;17(3):e1008374. doi: 10.1371/journal.pcbi.1008374. eCollection 2021 Mar. PLoS Comput Biol. 2021. PMID: 33651804 Free PMC article. - A high-throughput quantitative method to evaluate peroxisome-chloroplast interactions in Arabidopsis thaliana.
Oikawa K, Midorikawa K, Kodama Y, Numata K. Oikawa K, et al. Front Plant Sci. 2022 Oct 20;13:998960. doi: 10.3389/fpls.2022.998960. eCollection 2022. Front Plant Sci. 2022. PMID: 36340392 Free PMC article. - Synaptic pruning of murine adult-born neurons by microglia depends on phosphatidylserine.
Kurematsu C, Sawada M, Ohmuraya M, Tanaka M, Kuboyama K, Ogino T, Matsumoto M, Oishi H, Inada H, Ishido Y, Sakakibara Y, Nguyen HB, Thai TQ, Kohsaka S, Ohno N, Yamada MK, Asai M, Sokabe M, Nabekura J, Asano K, Tanaka M, Sawamoto K. Kurematsu C, et al. J Exp Med. 2022 Apr 4;219(4):e20202304. doi: 10.1084/jem.20202304. Epub 2022 Mar 17. J Exp Med. 2022. PMID: 35297954 Free PMC article. - MANF supports the inner hair cell synapse and the outer hair cell stereocilia bundle in the cochlea.
Ikäheimo K, Herranen A, Iivanainen V, Lankinen T, Aarnisalo AA, Sivonen V, Patel KA, Demir K, Saarma M, Lindahl M, Pirvola U. Ikäheimo K, et al. Life Sci Alliance. 2021 Nov 23;5(2):e202101068. doi: 10.26508/lsa.202101068. Print 2022 Feb. Life Sci Alliance. 2021. PMID: 34815294 Free PMC article. - How innovations in methodology offer new prospects for volume electron microscopy.
Kievits AJ, Lane R, Carroll EC, Hoogenboom JP. Kievits AJ, et al. J Microsc. 2022 Sep;287(3):114-137. doi: 10.1111/jmi.13134. Epub 2022 Jul 27. J Microsc. 2022. PMID: 35810393 Free PMC article. Review.
References
Publication types
MeSH terms
Grants and funding
This work was supported by Biocenter Finland, Biological Imaging Network (EJ), Academy of Finland (projects 131650 and 1287975; EJ) and the Integrative Life Science Doctoral Program of the University of Helsinki (MJ and DK). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
LinkOut - more resources
Full Text Sources
Other Literature Sources
Molecular Biology Databases
Research Materials