A reproducible evaluation of ANTs similarity metric performance in brain image registration - PubMed (original) (raw)
A reproducible evaluation of ANTs similarity metric performance in brain image registration
Brian B Avants et al. Neuroimage. 2011.
Abstract
The United States National Institutes of Health (NIH) commit significant support to open-source data and software resources in order to foment reproducibility in the biomedical imaging sciences. Here, we report and evaluate a recent product of this commitment: Advanced Neuroimaging Tools (ANTs), which is approaching its 2.0 release. The ANTs open source software library consists of a suite of state-of-the-art image registration, segmentation and template building tools for quantitative morphometric analysis. In this work, we use ANTs to quantify, for the first time, the impact of similarity metrics on the affine and deformable components of a template-based normalization study. We detail the ANTs implementation of three similarity metrics: squared intensity difference, a new and faster cross-correlation, and voxel-wise mutual information. We then use two-fold cross-validation to compare their performance on openly available, manually labeled, T1-weighted MRI brain image data of 40 subjects (UCLA's LPBA40 dataset). We report evaluation results on cortical and whole brain labels for both the affine and deformable components of the registration. Results indicate that the best ANTs methods are competitive with existing brain extraction results (Jaccard=0.958) and cortical labeling approaches. Mutual information affine mapping combined with cross-correlation diffeomorphic mapping gave the best cortical labeling results (Jaccard=0.669±0.022). Furthermore, our two-fold cross-validation allows us to quantify the similarity of templates derived from different subgroups. Our open code, data and evaluation scripts set performance benchmark parameters for this state-of-the-art toolkit. This is the first study to use a consistent transformation framework to provide a reproducible evaluation of the isolated effect of the similarity metric on optimal template construction and brain labeling.
Copyright © 2010 Elsevier Inc. All rights reserved.
Figures
Figure 1
The evaluation pipeline employs two-fold cross-validation and evaluates the following (affine, deformable) metric pairs: (MSQ,MSQ), (CC,CC), (MI,MI), (MI,MSQ), (MI,CC). The LPBA dataset’s labels provide the ground truth for the subject registration being evaluated.
Figure 2
Two rows of axial slices (neurological convention, i.e. subject left is viewer’s left) taken from each of the templates, constructed from subject group A or B, and by (affine, diffeomorphic) registration according to (MI, MSQ), (MI, CC), or (MI, MI). The top row shows the templates before registration to the (MI, CC) group A template and the bottom row shows them after diffeomorphic registration. The high Jaccard overlaps between these templates’ label sets quantifies and affirms, from an anatomical perspective, the visual similarity in the appearance of the templates. One may see, in the top row, the relative clarity of the MSQ, CC and MI templates. As template acutance does not strictly increase with our performance evaluation outcome, one may conclude that template clarity, alone, is insufficient to determine the neuroanatomical accuracy of an algorithm.
Figure 3
We use the Jaccard overlap metric (intersection of coregistered labeled regions over their union) to compare performance in this evaluation. The data is visualized with a box and whisker plot, with notches. These plots show the median toward the center of the box. The edges of the box delimit the medians of the data above and below the median. The whiskers and points show the minimum and maximum of the data and any points that are plotted may be considered outliers. We used pairwise Student T-tests to determine whether performance differences are significant. In this figure, the MSQAff, CCAff and MIAff overlap results all report the quality of the affine mapping to the derived template from the (MSQ, MSQ), (CC, CC) and (MI, MI) results. Deformable results for these three runs are not shown. The MI-based affine registration gave the best performance for both brain and cortex labeling thus providing the best initialization for follow-up deformable registration. For this reason, the MSQDiff, CCDiff and MIDiff results all use the MI metric for the affine component and MSQ, CC and MI during deformable registration.
Figure 4
A table representing the data used within the box plots of Figure 3 and also showing region-by-region performance for each method. The correlation of the results in the MIAff column with the (MSQ, CC, MI)Diff columns is (0.921, 0.922, 0.944), suggesting the critical role of the affine initialization.
Figure 5
The Jaccard ratios may be similar but show very different errors, as identified visually. We highlight one region of error in the circled region. The Jaccard values are, from left to right, 0.945078, 0.951205 and 0.952316. The (MI,CC)-based Jaccard mean/sd for diffeomorphic brain extraction, over the full dataset, is: 0.958 ± 0.005. This number is determined from taking the mean and standard deviation of the brain extraction overlaps from mapping the group B to the (MI,CC) group A template and vice versa.
Similar articles
- Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements.
Tustison NJ, Cook PA, Klein A, Song G, Das SR, Duda JT, Kandel BM, van Strien N, Stone JR, Gee JC, Avants BB. Tustison NJ, et al. Neuroimage. 2014 Oct 1;99:166-79. doi: 10.1016/j.neuroimage.2014.05.044. Epub 2014 May 29. Neuroimage. 2014. PMID: 24879923 - Improved labeling of subcortical brain structures in atlas-based segmentation of magnetic resonance images.
Yousefi S, Kehtarnavaz N, Gholipour A. Yousefi S, et al. IEEE Trans Biomed Eng. 2012 Jul;59(7):1808-17. doi: 10.1109/TBME.2011.2122306. Epub 2011 Mar 3. IEEE Trans Biomed Eng. 2012. PMID: 21382762 - A comparison of publicly available linear MRI stereotaxic registration techniques.
Dadar M, Fonov VS, Collins DL; Alzheimer’s Disease Neuroimaging Initiative. Dadar M, et al. Neuroimage. 2018 Jul 1;174:191-200. doi: 10.1016/j.neuroimage.2018.03.025. Epub 2018 Mar 13. Neuroimage. 2018. PMID: 29548850 - Accelerating Neuroimage Registration through Parallel Computation of Similarity Metric.
Luo YG, Liu P, Shi L, Luo Y, Yi L, Li A, Qin J, Heng PA, Wang D. Luo YG, et al. PLoS One. 2015 Sep 9;10(9):e0136718. doi: 10.1371/journal.pone.0136718. eCollection 2015. PLoS One. 2015. PMID: 26352412 Free PMC article. - [Contribution of free software to medical imaging].
Jodogne S. Jodogne S. Rev Med Liege. 2024 May;79(S1):75-83. Rev Med Liege. 2024. PMID: 38778654 Review. French.
Cited by
- The human claustrum tracks slow waves during sleep.
Lamsam L, Gu B, Liang M, Sun G, Khan KJ, Sheth KN, Hirsch LJ, Pittenger C, Kaye AP, Krystal JH, Damisah EC. Lamsam L, et al. Nat Commun. 2024 Oct 17;15(1):8964. doi: 10.1038/s41467-024-53477-x. Nat Commun. 2024. PMID: 39419999 - Human Claustrum Connections: Robust In Vivo Detection by DWI-Based Tractography in Two Large Samples.
Wendt J, Neubauer A, Hedderich DM, Schmitz-Koep B, Ayyildiz S, Schinz D, Hippen R, Daamen M, Boecker H, Zimmer C, Wolke D, Bartmann P, Sorg C, Menegaux A. Wendt J, et al. Hum Brain Mapp. 2024 Oct;45(14):e70042. doi: 10.1002/hbm.70042. Hum Brain Mapp. 2024. PMID: 39397271 Free PMC article. - Functional specialization and distributed processing across marmoset lateral prefrontal subregions.
Wong RK, Selvanayagam J, Johnston K, Everling S. Wong RK, et al. Cereb Cortex. 2024 Oct 3;34(10):bhae407. doi: 10.1093/cercor/bhae407. Cereb Cortex. 2024. PMID: 39390711 Free PMC article. - Genetic Architectures of Medical Images Revealed by Registration of Multiple Modalities.
Friedman SF, Moran GE, Rakic M, Phillipakis A. Friedman SF, et al. Bioinform Biol Insights. 2024 Sep 28;18:11779322241282489. doi: 10.1177/11779322241282489. eCollection 2024. Bioinform Biol Insights. 2024. PMID: 39372505 Free PMC article. - Watershed regions are more susceptible to tissue microstructural injury in multiple sclerosis.
Toubasi AA, Xu J, Eisma JJ, AshShareef S, Gheen C, Vinarsky T, Adapa P, Shah S, Eaton J, Dortch RD, Donahue MJ, Bagnato F. Toubasi AA, et al. Brain Commun. 2024 Sep 3;6(5):fcae299. doi: 10.1093/braincomms/fcae299. eCollection 2024. Brain Commun. 2024. PMID: 39372138 Free PMC article.
References
- Acosta-Cabronero J, Williams GB, Pereira JMS, Pengas G, Nestor PJ. The impact of skull-stripping and radio-frequency bias correction on grey-matter segmentation for voxel-based morphometry. Neuroimage. 2008 Feb;39(4):1654–1665. - PubMed
- Ardekani BA, Guckemus S, Bachman A, Hoptman MJ, Wojtaszek M, Nierenberg J. Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans. J Neurosci Methods. 2005 Mar;142(1):67–76. - PubMed
- Arnold VI. Ordinary Differential Equations. Springer-Verlag; 1991.
- Ashburner J. A fast diffeomorphic image registration algorithm. Neuroimage. 2007 Oct;38(1):95–113. - PubMed
- Ashburner J, Friston K. Voxel-based morphometry—The methods. Neuroimage. 2000;11:805–821. - PubMed
Publication types
MeSH terms
Grants and funding
- R01 DA022807-01A1/DA/NIDA NIH HHS/United States
- L40 DA025520-01/DA/NIDA NIH HHS/United States
- R21 DA015886-01/DA/NIDA NIH HHS/United States
- R01 NS033662-04/NS/NINDS NIH HHS/United States
- R01 EB006266-01/EB/NIBIB NIH HHS/United States
- R21 DA015886/DA/NIDA NIH HHS/United States
- R01 NS033662/NS/NINDS NIH HHS/United States
- L40 DA025520-02/DA/NIDA NIH HHS/United States
- L40 DA025520/DA/NIDA NIH HHS/United States
- R01 DA022807/DA/NIDA NIH HHS/United States
- R01EB006266-01/EB/NIBIB NIH HHS/United States
- R01 EB006266/EB/NIBIB NIH HHS/United States
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical