Inferring correlation networks from genomic survey data - PubMed (original) (raw)
Inferring correlation networks from genomic survey data
Jonathan Friedman et al. PLoS Comput Biol. 2012.
Abstract
High-throughput sequencing based techniques, such as 16S rRNA gene profiling, have the potential to elucidate the complex inner workings of natural microbial communities - be they from the world's oceans or the human gut. A key step in exploring such data is the identification of dependencies between members of these communities, which is commonly achieved by correlation analysis. However, it has been known since the days of Karl Pearson that the analysis of the type of data generated by such techniques (referred to as compositional data) can produce unreliable results since the observed data take the form of relative fractions of genes or species, rather than their absolute abundances. Using simulated and real data from the Human Microbiome Project, we show that such compositional effects can be widespread and severe: in some real data sets many of the correlations among taxa can be artifactual, and true correlations may even appear with opposite sign. Additionally, we show that community diversity is the key factor that modulates the acuteness of such compositional effects, and develop a new approach, called SparCC (available at https://bitbucket.org/yonatanf/sparcc), which is capable of estimating correlation values from compositional data. To illustrate a potential application of SparCC, we infer a rich ecological network connecting hundreds of interacting species across 18 sites on the human body. Using the SparCC network as a reference, we estimated that the standard approach yields 3 spurious species-species interactions for each true interaction and misses 60% of the true interactions in the human microbiome data, and, as predicted, most of the erroneous links are found in the samples with the lowest diversity.
Conflict of interest statement
The authors have declared that no competing interests exist.
Figures
Figure 1. Similar correlation networks are observed for real world vs. randomly shuffled bacterial abundance data.
Correlation networks based on 16S rRNA gene survey data collected as part of the Human Microbiome Project (HMP), inferred using Pearson correlations (left column), and SparCC (right column). Additionally, Pearson correlation networks were inferred from shuffled HMP data (middle column), where all OTUs are independent. The Pearson networks inferred from shuffled data show patterns similar to the ones seen in the Pearson networks of the real data, especially for low diversity body sites. This indicates that the observed Pearson network structure may be due to biases inherent in compositional data rather than a real biological signal. In contrast, no significant correlation were inferred from the shuffled data using SparCC (data not shown). Nodes represent OTUs, with size reflecting the OTU's average fraction in the community. Edges between nodes represent correlations between the nodes they connect, with edge width and shade indicating the correlation magnitude, and green and red colors indicating positive and negative correlations, respectively. For clarity, only edges corresponding to correlations whose magnitude is greater than 0.3 are drawn. See Fig. S1 for all 18 HMP body sites.
Figure 2. Pearson correlations inference quality deteriorates with decreasing diversity.
Basis data was simulated with a known correlation structure. OTU counts were generated by randomly drawing from the basis, and were subsequently subject to both correlation inference procedures. (A–C) True basis correlation network. (D–F) Networks inferred using standard procedure. (G–I) Networks inferred using SparCC. The average community diversities, as given by the Shannon entropy effective number of components , used in the simulations and observed in the HMP data are indicated on left indicates. As in Fig. 1, nodes represent OTUs, with size reflecting the OTU's average fraction in the community. Nodes represent OTUs, with size reflecting the OTU's average fraction in the community. Edges between nodes represent correlations between the nodes they connect, with edge width and shade indicating the correlation magnitude, and green and red colors indicating positive and negative correlations, respectively. For clarity, only edges corresponding to correlations whose magnitude is greater than 0.3 are drawn.
Figure 3. SparCC outperforms standard inference.
Root-mean-square error (RMSE) of both Pearson (A) and SparCC (B) inferred correlations, as a function of the density of the underlying correlation network, as given by the probability that any pair of components be strongly correlated , and community diversity, as given by the Shannon entropy effective number of components . SparCC errors are smaller than Pearson errors for all parameter values. For the maximal diversity plotted, 50 effective OTU, the inference error obtained using Pearson correlations is greatly decreased. Therefore, it is likely that Pearson correlations perform well on gene expression data, where the effective number of genes is typically in the hundreds or thousands. For each combination of density and diversity, multiple basis correlation networks were randomly generated, and corresponding data was sampled and used for correlation estimation. Dots labeled mid-vagina and gut indicate the average diversity observed in the mid-vagina and gut communities, and the density of their estimated correlation networks. Dots labeled 2D–I indicate the diversity and density used to generate the communities analyzed in Fig. 2.
Figure 4. HMP correlation networks inferred using SparCC.
Networks inferred using SparCC from the same data as in Fig. 1 (see Fig. S2 for SparCC networks of all HMP body sites). No correlations with magnitude greater than the 0.3 cutoff were inferred from the shuffled data (not shown). Nodes represent OTUs, with size reflecting the OTU's average fraction in the community, and color corresponding to the phylum to which the OTU belongs. Edges between nodes represent correlations between the nodes they connect, with edge width and shade indicating the correlation magnitude, and green and red colors indicating positive and negative correlations, respectively. For clarity, only edges corresponding to correlations whose magnitude is greater than 0.3 are drawn, and unconnected nodes are omitted. See Fig. S6 for all 18 HMP body sites.
Figure 5. Flow chart of iterative basis correlation inference procedure.
Similar articles
- CCLasso: correlation inference for compositional data through Lasso.
Fang H, Huang C, Zhao H, Deng M. Fang H, et al. Bioinformatics. 2015 Oct 1;31(19):3172-80. doi: 10.1093/bioinformatics/btv349. Epub 2015 Jun 4. Bioinformatics. 2015. PMID: 26048598 Free PMC article. - Direct interaction network inference for compositional data via codaloss.
Chen L, He S, Zhai Y, Deng M. Chen L, et al. J Bioinform Comput Biol. 2020 Dec;18(6):2050037. doi: 10.1142/S0219720020500377. Epub 2020 Oct 27. J Bioinform Comput Biol. 2020. PMID: 33106076 - Inferring microbial co-occurrence networks from amplicon data: a systematic evaluation.
Kishore D, Birzu G, Hu Z, DeLisi C, Korolev KS, Segrè D. Kishore D, et al. mSystems. 2023 Aug 31;8(4):e0096122. doi: 10.1128/msystems.00961-22. Epub 2023 Jun 20. mSystems. 2023. PMID: 37338270 Free PMC article. - Compositional data analysis of the microbiome: fundamentals, tools, and challenges.
Tsilimigras MC, Fodor AA. Tsilimigras MC, et al. Ann Epidemiol. 2016 May;26(5):330-5. doi: 10.1016/j.annepidem.2016.03.002. Epub 2016 Mar 31. Ann Epidemiol. 2016. PMID: 27255738 Review. - PCR-based quantification of taxa-specific abundances in microbial communities: Quantifying and avoiding common pitfalls.
Bonk F, Popp D, Harms H, Centler F. Bonk F, et al. J Microbiol Methods. 2018 Oct;153:139-147. doi: 10.1016/j.mimet.2018.09.015. Epub 2018 Sep 26. J Microbiol Methods. 2018. PMID: 30267718 Review.
Cited by
- Bacterial and Symbiodiniaceae communities' variation in corals with distinct traits and geographical distribution.
Villela LB, da Silva-Lima AW, Moreira APB, Aiube YRA, Ribeiro FV, Villela HDM, Majzoub ME, Amario M, de Moura RL, Thomas T, Peixoto RS, Salomon PS. Villela LB, et al. Sci Rep. 2024 Oct 16;14(1):24319. doi: 10.1038/s41598-024-70121-2. Sci Rep. 2024. PMID: 39414857 Free PMC article. - Invasions of Host-Associated Microbiome Networks.
Murall CL, Abbate JL, Touzel MP, Allen-Vercoe E, Alizon S, Froissart R, McCann K. Murall CL, et al. Adv Ecol Res. 2017;57:201-281. doi: 10.1016/bs.aecr.2016.11.002. Adv Ecol Res. 2017. PMID: 39404686 Free PMC article. - Impact of mixed-species forest plantations on soil mycobiota community structure and diversity in the Congolese coastal plains.
Koutika LS, Pereira APA, Fiore A, Tabacchioni S, Costanzo M, Di Gregorio L, Bevivino A. Koutika LS, et al. PLoS One. 2024 Oct 10;19(10):e0311781. doi: 10.1371/journal.pone.0311781. eCollection 2024. PLoS One. 2024. PMID: 39388424 Free PMC article. - Networks as tools for defining emergent properties of microbiomes and their stability.
Kajihara KT, Hynson NA. Kajihara KT, et al. Microbiome. 2024 Sep 28;12(1):184. doi: 10.1186/s40168-024-01868-z. Microbiome. 2024. PMID: 39342398 Free PMC article. Review. - Soil Fungal Community Diversity, Co-Occurrence Networks, and Assembly Processes under Diverse Forest Ecosystems.
Yang B, Yang Z, He K, Zhou W, Feng W. Yang B, et al. Microorganisms. 2024 Sep 20;12(9):1915. doi: 10.3390/microorganisms12091915. Microorganisms. 2024. PMID: 39338589 Free PMC article.
References
- Medini D, Serruto D, Parkhill J, Relman D, Donati C, et al. (2008) Microbiology in the post-genomic era. Nat Rev Microbiol 6: 419–430. - PubMed
- Bent SJ, Forney LJ (2008) The tragedy of the uncommon: understanding limitations in the analysis of microbial diversity. ISME J 2: 689. - PubMed
Publication types
MeSH terms
Grants and funding
This work was conducted by ENIGMA- Ecosystems and Networks Integrated with Genes and Molecular Assemblies (http://enigma.lbl.gov), a Scientific Focus Area Program at Lawrence Berkeley National Laboratory, was supported by the Office of Science, Office of Biological and Environmental Research, of the U. S. Department of Energy under Contract No. DE-AC02-05CH11231. JF was supported by the Merck-MIT Fellowship. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
LinkOut - more resources
Full Text Sources
Other Literature Sources