Babelomics: an integrative platform for the analysis of transcriptomics, proteomics and genomic data with advanced functional profiling (original) (raw)
Journal Article
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
,
1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain
Search for other works by this author on:
Received:
21 February 2010
Revision received:
16 April 2010
Cite
Ignacio Medina, Jos� Carbonell, Luis Pulido, Sara C. Madeira, Stefan Goetz, Ana Conesa, Joaqu�n T�rraga, Alberto Pascual-Montano, Ruben Nogales-Cadenas, Javier Santoyo, Francisco Garc�a, Martina Marb�, David Montaner, Joaqu�n Dopazo, Babelomics: an integrative platform for the analysis of transcriptomics, proteomics and genomic data with advanced functional profiling, Nucleic Acids Research, Volume 38, Issue suppl_2, 1 July 2010, Pages W210–W213, https://doi.org/10.1093/nar/gkq388
Close
Navbar Search Filter Mobile Enter search term Search
Abstract
Babelomics is a response to the growing necessity of integrating and analyzing different types of genomic data in an environment that allows an easy functional interpretation of the results. Babelomics includes a complete suite of methods for the analysis of gene expression data that include normalization (covering most commercial platforms), pre-processing, differential gene expression (case-controls, multiclass, survival or continuous values), predictors, clustering; large-scale genotyping assays (case controls and TDTs, and allows population stratification analysis and correction). All these genomic data analysis facilities are integrated and connected to multiple options for the functional interpretation of the experiments. Different methods of functional enrichment or gene set enrichment can be used to understand the functional basis of the experiment analyzed. Many sources of biological information, which include functional (GO, KEGG, Biocarta, Reactome, etc.), regulatory (Transfac, Jaspar, ORegAnno, miRNAs, etc.), text-mining or protein–protein interaction modules can be used for this purpose. Finally a tool for the de novo functional annotation of sequences has been included in the system. This provides support for the functional analysis of non-model species. Mirrors of Babelomics or command line execution of their individual components are now possible. Babelomics is available at http://www.babelomics.org.
INTRODUCTION
High-throughput technologies such as transcriptomics (microarrays) proteomics, large-scale genotyping [genome wide association studies (GWAS)], next generation sequencing, etc., produce huge amounts of data of unfeasible interpretation without the application of automatic procedures for functional profiling (1). The idea behind this new version of Babelomics is to integrate primary (normalization, calls, etc.) and secondary [signatures, predictors, associations, Transmission/disequilibrium tests (TDTs), clustering, etc.] analysis tools within an multiple-purpose platform that allows relating some of these genomic data and/or interpreting them by means of different functional enrichment or gene set methods. Such interpretation is made not only using functional definitions [GO (2), KEGG (3), Biocarta, Interpro (4), reactome (5)] but also regulatory information [Transfac (6), Jaspar (7), ORegAnno (8)] protein–protein interactions (9), text-mining module definitions (10) and the possibility of producing de novo annotations through the Blast2GO system (11).
Babelomics (12,13) as well as Gene Expression Pattern Analysis Suite (GEPAS) (14,15) have been uninterruptedly running for more than 8 years. Currently, Babelomics have an average of more than 200 experiments analyzed per day, respectively, (http://bioinfo.cipf.es/webstats/babelomics/awstats.babelomics.bioinfo.cipf.es.html), distributed among many different countries (http://bioinfo.cipf.es/toolsusage). Since their last release, a total of 65 280 anonymous users and 4521 registered users have used these tools.
In terms of technology, Babelomics has been reengineered, speeded up and transformed to web services. Babelomics has a new interface that allows the definition of persistent sessions and asynchronous use (a program can be left running and come back later to see the results) through a queue system. Moreover, the complete program can be installed locally and their modules can now be independently invoked as command line programs and can be integrated into analysis pipelines.
STRUCTURE OF THE PROGRAM
The program is organized into different sections that are described below. Two of them are related to data input and data management. The rest of them are different analysis options for data analysis. Novelties with respect to previous versions are indicated at the corresponding sections.
Upload data
This section is new. Upload process has been separated from the tools. Different parsers check the integrity and format of the data. The data accepted are: expression microarrays (one-channel Affymetrix and Agilent, and two-channel Agilent, Genepic and generic), Array-CGH (Agilent), generic data matrices of expression, ArrayCGH and SNPs, lists of identifiers (gene, transcript, protein, SNP, functional terms, ranks), lists of annotations (gene annotation, extended annotations) and some other data such as dendrogram descriptions (in Newick format; (http://evolution.genetics.washington.edu/phylip/newicktree.html), Blast results, protein–protein interaction data and genotype data (in standard PED and MAP formats; http://pngu.mgh.harvard.edu/∼purcell/plink/data.shtml). The program documentation contains details on the formats used.
To ease the process, the data format can be uploaded according to the format, as described above, or according the tool to be used.
Preprocessing
This section allows preprocessing the data loaded in the previous section. Almost all the options (except normalization of Affymetrix and two-color Agilent and genepix arrays) are new. All the array types loaded in the previous section can be normalized by different methods. Limma (16) and affy packages from Bioconductor (17) are implemented.
This section also includes an editor which allows easy addition and/or modification of labels and tags that will be further used as class or category labels for gene selection, prediction, etc.
Other preprocessing facilities for normalized data are available, such as log-transformations, replicate merging, missing value imputation, etc.
A converter of identifiers is available with more than 80 cross-referenced identifiers for genes, proteins, transcripts, microarray probesets, pathways, functional annotations and regulatory regions.
Finally, a facility for obtaining the existing annotations for lists of gene identifiers is available. All the possible annotations used in Babelomics (functional, regulatory, etc.) can be used for this purpose.
Expression
This section corresponds to the GEPAS (14,15) functionality. It includes tests for differential expression [two- or multi-class comparison, survival analysis, correlation to continuous parameters or time/dosage series analysis (18)], methods for class prediction (19) such as SVM (support vector machines), KNN (k-nearest neighbors), Random Forest and Naive Bayes, with different feature selection methods [differential expression, genetic algorithms, principal component analysis (PCA)] and clustering methods for both samples and genes implementing the algorithms UPGMA (unweighted pair group method with arithmetic mean), SOTA (self organizing tree algorithm) (20), _K_-means and SOM (self organizing maps). We have also included biclustering methods (21).
The users of GEPAS will appreciate the novelties here, which are ‘limma’ methods for one-, two- and multi-class comparison, new multiple testing correction methods (Benjamini–Hochberg (22), Benjamini–Yekutieli (23), Bonferroni, Holm (24) and Hochberg (25)) for differential gene expression. The predictor module has novelties such as the addition of random forest (26) and Naive Bayes methods, the use of different algorithms for feature selection (see above), new parameter tuning options and new representations of the results with receiver operating characteristic curves with new metrics [area under the curve, root mean squared error, Matthews correlation coefficient and accuracy]. We have also added biclustering (21) as a new clustering method.
Genomics
This section is completely new. It implements SNP-based genotyping (27). This module can deal with GWAS case–control studies and carries out chi-square, Fisher and linear or logistic model tests. For trios, the program can carry out TDT. Functionality is taken from the PLINK program (28). Again, the results of the test can be analyzed by the functional analysis module (see below) and the novel pathway-based analysis (PBA) strategies can be applied (29). Population stratification can be analyzed by identity-by-state (IBS) (28) and PLINK documentation (http://pngu.mgh.harvard.edu/∼purcell/plink/strat.shtml). This is a simple but potentially powerful approach to population stratification, which can use the whole genome SNP data.
Functional analysis
This module inherits the functionality of the previous version of Babelomics (12,13) although many novelties have been included. Apart from the functional enrichment methods such as the popular FatiGO (30), and gene set analysis methods such as the segmentation test (31) or the logistic regression model (32) (a new addition), other testing strategies have been added. Thus, the Genecodis method (33) that finds concurrent annotations in ranked lists of genes is one of the new methods included. It is also possible to carry our PBA in GWAS experiments by means of the novel module Gesbap (29). Gene modules defined using text-mining derived functional annotations related to medical terms and chemical compounds can also be used for gene-set analysis (GSA) (10). Also another module uses gene expression data already available in databases to define tissue-specific or phenotype-specific gene expression profiles. These can be used to check the similarity of a particular experiment to the standard profiles of healthy or diseased tissues (34). Finally, the possibility of finding significant subnetworks of protein–protein interactions associated to the genomic experiment analyzed is included in an additional module (9) as another novelty.
Regarding the gene modules that can be used in order to produce a functional interpretation of the results, many possibilities are available, including functional definitions [GO (2), GOSlim, KEGG (3), Biocarta (http://www.biocarta.com/), Interpro (4), reactome (5)], regulatory information [Transfac (6), Jaspar (7), ORegAnno (8), miRNA target genes from miRBase (35)], protein–protein interactions (9) and text-mining module definitions (10). Additionally, the user can define their own gene modules by uploading them (see upload section) or by using the annotation tools available in this version of Babelomics (see Blast2GO below). Jaspar, ORegAnno, reactome and protein–protein interactions are new modules in this release.
Different filters can be used to test sub-selection of gene modules, excluding in this way superfluous tests that only will result in a reduction of the statistical power of the method used.
Finally, the popular Blast2GO (11) module can be used to produce annotations of genes of non-model organisms. Such annotations can be stored and further used to analyze genomic experiments.
Utilities
Several utilities are available related to facilitate the annotation of the genes or to produce different visualizations of the data. Thus, the new modules for annotation and identification conversion already described in the preprocessing section can also be found here. Several new utilities to produce graphical representation of the results (histograms and boxplots, cluster representations, PCA viewers and the GO hierarchy viewer) are also available. Supplementary Figure 1 shows some of such graphics.
Technical details
Babelomics is designed as a web application so it can work on any operating system: Windows, GNU/Linux and MacOS. Babelomics has been tested in many browsers including: Firefox 3.x, Safari 4.x, Chrome 2.x, Opera 9.x, IE 7.x. and IE 8.x. The code has almost entirely rewritten in Java (except some routines for normalization of microarrays that are in R), which constituted a speed up of almost 30x with respect to previous versions. All the modules are web services and can be used in command line. A convenient queue system has been implemented. Babelomics is running in a high-end cluster with 10 dedicated Intel XEON Quad-Core CPUs at 2.0 GHz (summing up a total of 40 cores) with a large amount of RAM (total 60 GB).
CONCLUSIONS
Today’s Babelomics is a long-term project that started in 2001 with the publication of the clustering method SOTA (20) for microarray data analysis, followed by the popular FatiGO (30) for functional enrichment analysis, which are now a constituent part of Babelomics. Later, different methods (both functional enrichment and gene set enrichment) along with a number of gene module definitions were assembled as the prototype of the previous Babelomics (12,13) while different methods for gene expression data analysis (differential expression, predictors, clustering) give rise in parallel to the GEPAS (14,15) project. Both packages have become popular in their respective areas, being Babelomics the third most cited web-based tool for functional analysis (Supplementary Table 1) and GEPAS the most cited web tool for microarray data analysis (Supplementary Table 2).
This new version of Babelomics embeds the gene expression data analysis functionality of GEPAS within the functional profiling framework of the previous Babelomics and includes new modules for the analysis of genomic data (genotyping and genomic copy number alterations). Many new methods and new module definitions of different nature (functional, regulatory, phenotypic, etc.) have been included in this version.
The Babelomics project aims to provide the scientific community with an advanced set of methods for the integrated analysis of genomic data within the context of functional profiling analysis without renouncing to a user-friendly and intuitive use. As the Functional Genomics node of the Spanish Institute of Bioinformatics (INB; http://www.inab.org) and being part of the Spanish Network of Cancer (RTICC; http://www.rticcc.org) and the Network of Centres for Research in Rare Diseases (CIBERER, http://www.ciberer.es), we have a direct contact with researchers which provided us much of the feedback necessary to make of Babelomics a useful tool.
Although there are many tools for the functional profiling of high-throughput experiments (Supplementary Tables 1 and Supplementary Data), Babelomics is a widely used tool which offers a combination of features and a degree of integration that makes it unique among other resources available.
FUNDING
Funding for open access charge: Spanish Ministry of Science and Innovation (MICINN) (projects BIO BIO2008-04212 and CEN-2008-1002). Red Tem�tica de Investigaci�n Cooperativa en Cancer (RTICC, partial) (RD06/0020/1019); Instituto de Salud Carlos III (MICINN).
Conflict of interest statement. None declared.
ACKNOWLEDGEMENTS
The CIBER de Enfermedades Raras and the INB are initiatives of the ISCIII.
REFERENCES
1
Formulating and testing hypotheses in functional genomics
,
Artif. Intell. Med.
,
2009
, vol.
45
(pg.
97
-
107
)
2
et al.
Gene ontology: tool for the unification of biology. The Gene Ontology Consortium
,
Nat. Genet.
,
2000
, vol.
25
(pg.
25
-
29
)
3
et al.
KEGG for linking genomes to life and the environment
,
Nucleic Acids Res.
,
2008
, vol.
36
(pg.
D480
-
D484
)
4
et al.
New developments in the InterPro database
,
Nucleic Acids Res.
,
2007
, vol.
35
(pg.
D224
-
D228
)
5
et al.
Reactome: a knowledge base of biologic pathways and processes
,
Genome Biol.
,
2007
, vol.
8
pg.
R39
6
et al.
TRANSFAC and its module TRANSCompel: transcriptional gene regulation in eukaryotes
,
Nucleic Acids Res.
,
2006
, vol.
34
(pg.
D108
-
D110
)
7
JASPAR, the open access database of transcription factor-binding profiles: new content and tools in the 2008 update
,
Nucleic Acids Res.
,
2008
, vol.
36
(pg.
D102
-
D106
)
8
et al.
ORegAnno: an open-access community-driven resource for regulatory annotation
,
Nucleic Acids Res.
,
2008
, vol.
36
(pg.
D107
-
D113
)
9
SNOW, a web-based tool for the statistical analysis of protein-protein interaction networks
,
Nucleic Acids Res.
,
2009
, vol.
37
(pg.
W109
-
W114
)
10
Functional profiling of microarray experiments using text-mining derived bioentities
,
Bioinformatics
,
2007
, vol.
23
(pg.
3098
-
3099
)
11
Blast2GO: a universal tool for annotation, visualization and analysis in functional genomics research
,
Bioinformatics
,
2005
, vol.
21
(pg.
3674
-
3676
)
12
Babelomics: advanced functional profiling of transcriptomics, proteomics and genomics experiments
,
Nucleic Acids Res.
,
2008
, vol.
36
(pg.
W341
-
W346
)
13
BABELOMICS: a suite of web tools for functional annotation and analysis of groups of genes in high-throughput experiments
,
Nucleic Acids Res.
,
2005
, vol.
33
(pg.
W460
-
W464
)
14
GEPAS: a web-based resource for microarray gene expression data analysis
,
Nucleic Acids Res.
,
2003
, vol.
31
(pg.
3461
-
3467
)
15
et al.
Next station in microarray data analysis: GEPAS
,
Nucleic Acids Res.
,
2006
, vol.
34
(pg.
W486
-
W491
)
16
,
Bioinformatics and Computational Biology Solutions using R and Bioconductor
,
2005
New York
Springer
(pg.
397
-
420
)
17
et al.
Bioconductor: open software development for computational biology and bioinformatics
,
Genome Biol.
,
2004
, vol.
5
pg.
R80
18
maSigPro: a method to identify significantly differential expression profiles in time-course microarray experiments
,
Bioinformatics
,
2006
, vol.
22
(pg.
1096
-
1102
)
19
Prophet, a web-based tool for class prediction using microarray data
,
Bioinformatics
,
2007
, vol.
23
(pg.
390
-
391
)
20
A hierarchical unsupervised growing neural network for clustering gene expression patterns
,
Bioinformatics
,
2001
, vol.
17
(pg.
126
-
136
)
21
Biclustering algorithms for biological data analysis: a survey
,
IEEE/ACM Trans Comput. Biol. Bioinform.
,
2004
, vol.
1
(pg.
24
-
45
)
22
Controlling the false discovery rate: a practical and powerful approach to multiple testing
,
J. R. Stat. Soc. Ser. B
,
1995
, vol.
57
(pg.
289
-
300
)
23
The control of false discovery rate in multiple testing under dependency
,
Ann. Stat.
,
2001
, vol.
29
(pg.
1165
-
1188
)
24
A simple sequentially rejective multiple test procedure
,
Scand. J. Stat.
,
1979
, vol.
6
(pg.
65
-
70
)
25
A sharper Bonferroni procedure for multiple tests of significance
,
Biometrika
,
1988
, vol.
75
(pg.
800
-
802
)
26
Random Forests
,
Mach. Learn.
,
2001
, vol.
45
(pg.
5
-
32
)
27
Genome-wide association studies for complex traits: consensus, uncertainty and challenges
,
Nat. Rev. Genet.
,
2008
, vol.
9
(pg.
356
-
369
)
28
et al.
PLINK: a tool set for whole-genome association and population-based linkage analyses
,
Am. J. Hum. Genet.
,
2007
, vol.
81
(pg.
559
-
575
)
29
Gene set-based analysis of polymorphisms: finding pathways or biological processes associated to traits in genome-wide association studies
,
Nucleic Acids Res.
,
2009
, vol.
37
(pg.
W340
-
W344
)
30
FatiGO: a web tool for finding significant associations of Gene Ontology terms with groups of genes
,
Bioinformatics
,
2004
, vol.
20
(pg.
578
-
580
)
31
From genes to functional classes in the study of biological systems
,
BMC Bioinformatics
,
2007
, vol.
8
pg.
114
32
LRpath: a logistic regression approach for identifying enriched biological groups in gene expression data
,
Bioinformatics
,
2008
, vol.
25
(pg.
211
-
217
)
33
GENECODIS: a web-based tool for finding significant concurrent annotations in gene lists
,
Genome Biol.
,
2007
, vol.
8
pg.
R3
34
An oncogenic KRAS2 expression signature identified by cross-species gene-expression analysis
,
Nat. Genet.
,
2005
, vol.
37
(pg.
48
-
55
)
35
miRBase: microRNA sequences, targets and gene nomenclature
,
Nucleic Acids Res.
,
2006
, vol.
34
(pg.
D140
-
D144
)
� The Author(s) 2010. Published by Oxford University Press.
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/2.5), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Supplementary data
I agree to the terms and conditions. You must accept the terms and conditions.
Submit a comment
Name
Affiliations
Comment title
Comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.
Citations
Views
Altmetric
Metrics
Total Views 2,994
2,344 Pageviews
650 PDF Downloads
Since 12/1/2016
Month: | Total Views: |
---|---|
December 2016 | 5 |
January 2017 | 38 |
February 2017 | 11 |
March 2017 | 14 |
April 2017 | 10 |
May 2017 | 22 |
June 2017 | 13 |
July 2017 | 12 |
August 2017 | 23 |
September 2017 | 25 |
October 2017 | 17 |
November 2017 | 13 |
December 2017 | 41 |
January 2018 | 38 |
February 2018 | 20 |
March 2018 | 56 |
April 2018 | 61 |
May 2018 | 55 |
June 2018 | 37 |
July 2018 | 26 |
August 2018 | 30 |
September 2018 | 24 |
October 2018 | 26 |
November 2018 | 35 |
December 2018 | 39 |
January 2019 | 29 |
February 2019 | 26 |
March 2019 | 39 |
April 2019 | 54 |
May 2019 | 38 |
June 2019 | 19 |
July 2019 | 44 |
August 2019 | 48 |
September 2019 | 52 |
October 2019 | 32 |
November 2019 | 37 |
December 2019 | 20 |
January 2020 | 34 |
February 2020 | 21 |
March 2020 | 11 |
April 2020 | 15 |
May 2020 | 16 |
June 2020 | 15 |
July 2020 | 30 |
August 2020 | 31 |
September 2020 | 28 |
October 2020 | 40 |
November 2020 | 26 |
December 2020 | 33 |
January 2021 | 20 |
February 2021 | 43 |
March 2021 | 52 |
April 2021 | 63 |
May 2021 | 59 |
June 2021 | 38 |
July 2021 | 37 |
August 2021 | 32 |
September 2021 | 34 |
October 2021 | 39 |
November 2021 | 18 |
December 2021 | 17 |
January 2022 | 27 |
February 2022 | 28 |
March 2022 | 28 |
April 2022 | 30 |
May 2022 | 16 |
June 2022 | 27 |
July 2022 | 54 |
August 2022 | 52 |
September 2022 | 50 |
October 2022 | 35 |
November 2022 | 33 |
December 2022 | 64 |
January 2023 | 29 |
February 2023 | 28 |
March 2023 | 40 |
April 2023 | 51 |
May 2023 | 25 |
June 2023 | 45 |
July 2023 | 22 |
August 2023 | 21 |
September 2023 | 27 |
October 2023 | 19 |
November 2023 | 15 |
December 2023 | 33 |
January 2024 | 33 |
February 2024 | 38 |
March 2024 | 36 |
April 2024 | 39 |
May 2024 | 16 |
June 2024 | 37 |
July 2024 | 37 |
August 2024 | 23 |
September 2024 | 32 |
October 2024 | 23 |
Citations
254 Web of Science
×
Email alerts
Citing articles via
More from Oxford Academic