Babelomics: an integrative platform for the analysis of transcriptomics, proteomics and genomic data with advanced functional profiling (original) (raw)

Journal Article

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

,

1Bioinformatics Department, Centro de Investigaci�n Pr�ncipe Felipe (CIPF), Autopista del Saler 16, 2CIBER de Enfermedades Raras (CIBERER), Valencia, Spain, 3Knowledge Discovery and Bioinformatics (KDBIO) group, INESC-ID, Lisbon, Portugal, 4Instituto Superior T�cnico, Technical University of Lisbon, Lisbon, Portugal, 5Functional Genomics Node, INB, CIPF, Valencia, Spain and 6National Center for Biotechnology-CSIC, Madrid, Spain

Search for other works by this author on:

... Show more

Received:

21 February 2010

Revision received:

16 April 2010

Cite

Ignacio Medina, Jos� Carbonell, Luis Pulido, Sara C. Madeira, Stefan Goetz, Ana Conesa, Joaqu�n T�rraga, Alberto Pascual-Montano, Ruben Nogales-Cadenas, Javier Santoyo, Francisco Garc�a, Martina Marb�, David Montaner, Joaqu�n Dopazo, Babelomics: an integrative platform for the analysis of transcriptomics, proteomics and genomic data with advanced functional profiling, Nucleic Acids Research, Volume 38, Issue suppl_2, 1 July 2010, Pages W210–W213, https://doi.org/10.1093/nar/gkq388
Close

Navbar Search Filter Mobile Enter search term Search

Abstract

Babelomics is a response to the growing necessity of integrating and analyzing different types of genomic data in an environment that allows an easy functional interpretation of the results. Babelomics includes a complete suite of methods for the analysis of gene expression data that include normalization (covering most commercial platforms), pre-processing, differential gene expression (case-controls, multiclass, survival or continuous values), predictors, clustering; large-scale genotyping assays (case controls and TDTs, and allows population stratification analysis and correction). All these genomic data analysis facilities are integrated and connected to multiple options for the functional interpretation of the experiments. Different methods of functional enrichment or gene set enrichment can be used to understand the functional basis of the experiment analyzed. Many sources of biological information, which include functional (GO, KEGG, Biocarta, Reactome, etc.), regulatory (Transfac, Jaspar, ORegAnno, miRNAs, etc.), text-mining or protein–protein interaction modules can be used for this purpose. Finally a tool for the de novo functional annotation of sequences has been included in the system. This provides support for the functional analysis of non-model species. Mirrors of Babelomics or command line execution of their individual components are now possible. Babelomics is available at http://www.babelomics.org.

INTRODUCTION

High-throughput technologies such as transcriptomics (microarrays) proteomics, large-scale genotyping [genome wide association studies (GWAS)], next generation sequencing, etc., produce huge amounts of data of unfeasible interpretation without the application of automatic procedures for functional profiling (1). The idea behind this new version of Babelomics is to integrate primary (normalization, calls, etc.) and secondary [signatures, predictors, associations, Transmission/disequilibrium tests (TDTs), clustering, etc.] analysis tools within an multiple-purpose platform that allows relating some of these genomic data and/or interpreting them by means of different functional enrichment or gene set methods. Such interpretation is made not only using functional definitions [GO (2), KEGG (3), Biocarta, Interpro (4), reactome (5)] but also regulatory information [Transfac (6), Jaspar (7), ORegAnno (8)] protein–protein interactions (9), text-mining module definitions (10) and the possibility of producing de novo annotations through the Blast2GO system (11).

Babelomics (12,13) as well as Gene Expression Pattern Analysis Suite (GEPAS) (14,15) have been uninterruptedly running for more than 8 years. Currently, Babelomics have an average of more than 200 experiments analyzed per day, respectively, (http://bioinfo.cipf.es/webstats/babelomics/awstats.babelomics.bioinfo.cipf.es.html), distributed among many different countries (http://bioinfo.cipf.es/toolsusage). Since their last release, a total of 65 280 anonymous users and 4521 registered users have used these tools.

In terms of technology, Babelomics has been reengineered, speeded up and transformed to web services. Babelomics has a new interface that allows the definition of persistent sessions and asynchronous use (a program can be left running and come back later to see the results) through a queue system. Moreover, the complete program can be installed locally and their modules can now be independently invoked as command line programs and can be integrated into analysis pipelines.

STRUCTURE OF THE PROGRAM

The program is organized into different sections that are described below. Two of them are related to data input and data management. The rest of them are different analysis options for data analysis. Novelties with respect to previous versions are indicated at the corresponding sections.

Upload data

This section is new. Upload process has been separated from the tools. Different parsers check the integrity and format of the data. The data accepted are: expression microarrays (one-channel Affymetrix and Agilent, and two-channel Agilent, Genepic and generic), Array-CGH (Agilent), generic data matrices of expression, ArrayCGH and SNPs, lists of identifiers (gene, transcript, protein, SNP, functional terms, ranks), lists of annotations (gene annotation, extended annotations) and some other data such as dendrogram descriptions (in Newick format; (http://evolution.genetics.washington.edu/phylip/newicktree.html), Blast results, protein–protein interaction data and genotype data (in standard PED and MAP formats; http://pngu.mgh.harvard.edu/∼purcell/plink/data.shtml). The program documentation contains details on the formats used.

To ease the process, the data format can be uploaded according to the format, as described above, or according the tool to be used.

Preprocessing

This section allows preprocessing the data loaded in the previous section. Almost all the options (except normalization of Affymetrix and two-color Agilent and genepix arrays) are new. All the array types loaded in the previous section can be normalized by different methods. Limma (16) and affy packages from Bioconductor (17) are implemented.

This section also includes an editor which allows easy addition and/or modification of labels and tags that will be further used as class or category labels for gene selection, prediction, etc.

Other preprocessing facilities for normalized data are available, such as log-transformations, replicate merging, missing value imputation, etc.

A converter of identifiers is available with more than 80 cross-referenced identifiers for genes, proteins, transcripts, microarray probesets, pathways, functional annotations and regulatory regions.

Finally, a facility for obtaining the existing annotations for lists of gene identifiers is available. All the possible annotations used in Babelomics (functional, regulatory, etc.) can be used for this purpose.

Expression

This section corresponds to the GEPAS (14,15) functionality. It includes tests for differential expression [two- or multi-class comparison, survival analysis, correlation to continuous parameters or time/dosage series analysis (18)], methods for class prediction (19) such as SVM (support vector machines), KNN (k-nearest neighbors), Random Forest and Naive Bayes, with different feature selection methods [differential expression, genetic algorithms, principal component analysis (PCA)] and clustering methods for both samples and genes implementing the algorithms UPGMA (unweighted pair group method with arithmetic mean), SOTA (self organizing tree algorithm) (20), _K_-means and SOM (self organizing maps). We have also included biclustering methods (21).

The users of GEPAS will appreciate the novelties here, which are ‘limma’ methods for one-, two- and multi-class comparison, new multiple testing correction methods (Benjamini–Hochberg (22), Benjamini–Yekutieli (23), Bonferroni, Holm (24) and Hochberg (25)) for differential gene expression. The predictor module has novelties such as the addition of random forest (26) and Naive Bayes methods, the use of different algorithms for feature selection (see above), new parameter tuning options and new representations of the results with receiver operating characteristic curves with new metrics [area under the curve, root mean squared error, Matthews correlation coefficient and accuracy]. We have also added biclustering (21) as a new clustering method.

Genomics

This section is completely new. It implements SNP-based genotyping (27). This module can deal with GWAS case–control studies and carries out chi-square, Fisher and linear or logistic model tests. For trios, the program can carry out TDT. Functionality is taken from the PLINK program (28). Again, the results of the test can be analyzed by the functional analysis module (see below) and the novel pathway-based analysis (PBA) strategies can be applied (29). Population stratification can be analyzed by identity-by-state (IBS) (28) and PLINK documentation (http://pngu.mgh.harvard.edu/∼purcell/plink/strat.shtml). This is a simple but potentially powerful approach to population stratification, which can use the whole genome SNP data.

Functional analysis

This module inherits the functionality of the previous version of Babelomics (12,13) although many novelties have been included. Apart from the functional enrichment methods such as the popular FatiGO (30), and gene set analysis methods such as the segmentation test (31) or the logistic regression model (32) (a new addition), other testing strategies have been added. Thus, the Genecodis method (33) that finds concurrent annotations in ranked lists of genes is one of the new methods included. It is also possible to carry our PBA in GWAS experiments by means of the novel module Gesbap (29). Gene modules defined using text-mining derived functional annotations related to medical terms and chemical compounds can also be used for gene-set analysis (GSA) (10). Also another module uses gene expression data already available in databases to define tissue-specific or phenotype-specific gene expression profiles. These can be used to check the similarity of a particular experiment to the standard profiles of healthy or diseased tissues (34). Finally, the possibility of finding significant subnetworks of protein–protein interactions associated to the genomic experiment analyzed is included in an additional module (9) as another novelty.

Regarding the gene modules that can be used in order to produce a functional interpretation of the results, many possibilities are available, including functional definitions [GO (2), GOSlim, KEGG (3), Biocarta (http://www.biocarta.com/), Interpro (4), reactome (5)], regulatory information [Transfac (6), Jaspar (7), ORegAnno (8), miRNA target genes from miRBase (35)], protein–protein interactions (9) and text-mining module definitions (10). Additionally, the user can define their own gene modules by uploading them (see upload section) or by using the annotation tools available in this version of Babelomics (see Blast2GO below). Jaspar, ORegAnno, reactome and protein–protein interactions are new modules in this release.

Different filters can be used to test sub-selection of gene modules, excluding in this way superfluous tests that only will result in a reduction of the statistical power of the method used.

Finally, the popular Blast2GO (11) module can be used to produce annotations of genes of non-model organisms. Such annotations can be stored and further used to analyze genomic experiments.

Utilities

Several utilities are available related to facilitate the annotation of the genes or to produce different visualizations of the data. Thus, the new modules for annotation and identification conversion already described in the preprocessing section can also be found here. Several new utilities to produce graphical representation of the results (histograms and boxplots, cluster representations, PCA viewers and the GO hierarchy viewer) are also available. Supplementary Figure 1 shows some of such graphics.

Technical details

Babelomics is designed as a web application so it can work on any operating system: Windows, GNU/Linux and MacOS. Babelomics has been tested in many browsers including: Firefox 3.x, Safari 4.x, Chrome 2.x, Opera 9.x, IE 7.x. and IE 8.x. The code has almost entirely rewritten in Java (except some routines for normalization of microarrays that are in R), which constituted a speed up of almost 30x with respect to previous versions. All the modules are web services and can be used in command line. A convenient queue system has been implemented. Babelomics is running in a high-end cluster with 10 dedicated Intel XEON Quad-Core CPUs at 2.0 GHz (summing up a total of 40 cores) with a large amount of RAM (total 60 GB).

CONCLUSIONS

Today’s Babelomics is a long-term project that started in 2001 with the publication of the clustering method SOTA (20) for microarray data analysis, followed by the popular FatiGO (30) for functional enrichment analysis, which are now a constituent part of Babelomics. Later, different methods (both functional enrichment and gene set enrichment) along with a number of gene module definitions were assembled as the prototype of the previous Babelomics (12,13) while different methods for gene expression data analysis (differential expression, predictors, clustering) give rise in parallel to the GEPAS (14,15) project. Both packages have become popular in their respective areas, being Babelomics the third most cited web-based tool for functional analysis (Supplementary Table 1) and GEPAS the most cited web tool for microarray data analysis (Supplementary Table 2).

This new version of Babelomics embeds the gene expression data analysis functionality of GEPAS within the functional profiling framework of the previous Babelomics and includes new modules for the analysis of genomic data (genotyping and genomic copy number alterations). Many new methods and new module definitions of different nature (functional, regulatory, phenotypic, etc.) have been included in this version.

The Babelomics project aims to provide the scientific community with an advanced set of methods for the integrated analysis of genomic data within the context of functional profiling analysis without renouncing to a user-friendly and intuitive use. As the Functional Genomics node of the Spanish Institute of Bioinformatics (INB; http://www.inab.org) and being part of the Spanish Network of Cancer (RTICC; http://www.rticcc.org) and the Network of Centres for Research in Rare Diseases (CIBERER, http://www.ciberer.es), we have a direct contact with researchers which provided us much of the feedback necessary to make of Babelomics a useful tool.

Although there are many tools for the functional profiling of high-throughput experiments (Supplementary Tables 1 and Supplementary Data), Babelomics is a widely used tool which offers a combination of features and a degree of integration that makes it unique among other resources available.

FUNDING

Funding for open access charge: Spanish Ministry of Science and Innovation (MICINN) (projects BIO BIO2008-04212 and CEN-2008-1002). Red Tem�tica de Investigaci�n Cooperativa en Cancer (RTICC, partial) (RD06/0020/1019); Instituto de Salud Carlos III (MICINN).

Conflict of interest statement. None declared.

ACKNOWLEDGEMENTS

The CIBER de Enfermedades Raras and the INB are initiatives of the ISCIII.

REFERENCES

1

Formulating and testing hypotheses in functional genomics

,

Artif. Intell. Med.

,

2009

, vol.

45

(pg.

97

-

107

)

2

et al.

Gene ontology: tool for the unification of biology. The Gene Ontology Consortium

,

Nat. Genet.

,

2000

, vol.

25

(pg.

25

-

29

)

3

et al.

KEGG for linking genomes to life and the environment

,

Nucleic Acids Res.

,

2008

, vol.

36

(pg.

D480

-

D484

)

4

et al.

New developments in the InterPro database

,

Nucleic Acids Res.

,

2007

, vol.

35

(pg.

D224

-

D228

)

5

et al.

Reactome: a knowledge base of biologic pathways and processes

,

Genome Biol.

,

2007

, vol.

8

pg.

R39

6

et al.

TRANSFAC and its module TRANSCompel: transcriptional gene regulation in eukaryotes

,

Nucleic Acids Res.

,

2006

, vol.

34

(pg.

D108

-

D110

)

7

JASPAR, the open access database of transcription factor-binding profiles: new content and tools in the 2008 update

,

Nucleic Acids Res.

,

2008

, vol.

36

(pg.

D102

-

D106

)

8

et al.

ORegAnno: an open-access community-driven resource for regulatory annotation

,

Nucleic Acids Res.

,

2008

, vol.

36

(pg.

D107

-

D113

)

9

SNOW, a web-based tool for the statistical analysis of protein-protein interaction networks

,

Nucleic Acids Res.

,

2009

, vol.

37

(pg.

W109

-

W114

)

10

Functional profiling of microarray experiments using text-mining derived bioentities

,

Bioinformatics

,

2007

, vol.

23

(pg.

3098

-

3099

)

11

Blast2GO: a universal tool for annotation, visualization and analysis in functional genomics research

,

Bioinformatics

,

2005

, vol.

21

(pg.

3674

-

3676

)

12

Babelomics: advanced functional profiling of transcriptomics, proteomics and genomics experiments

,

Nucleic Acids Res.

,

2008

, vol.

36

(pg.

W341

-

W346

)

13

BABELOMICS: a suite of web tools for functional annotation and analysis of groups of genes in high-throughput experiments

,

Nucleic Acids Res.

,

2005

, vol.

33

(pg.

W460

-

W464

)

14

GEPAS: a web-based resource for microarray gene expression data analysis

,

Nucleic Acids Res.

,

2003

, vol.

31

(pg.

3461

-

3467

)

15

et al.

Next station in microarray data analysis: GEPAS

,

Nucleic Acids Res.

,

2006

, vol.

34

(pg.

W486

-

W491

)

16

,

Bioinformatics and Computational Biology Solutions using R and Bioconductor

,

2005

New York

Springer

(pg.

397

-

420

)

17

et al.

Bioconductor: open software development for computational biology and bioinformatics

,

Genome Biol.

,

2004

, vol.

5

pg.

R80

18

maSigPro: a method to identify significantly differential expression profiles in time-course microarray experiments

,

Bioinformatics

,

2006

, vol.

22

(pg.

1096

-

1102

)

19

Prophet, a web-based tool for class prediction using microarray data

,

Bioinformatics

,

2007

, vol.

23

(pg.

390

-

391

)

20

A hierarchical unsupervised growing neural network for clustering gene expression patterns

,

Bioinformatics

,

2001

, vol.

17

(pg.

126

-

136

)

21

Biclustering algorithms for biological data analysis: a survey

,

IEEE/ACM Trans Comput. Biol. Bioinform.

,

2004

, vol.

1

(pg.

24

-

45

)

22

Controlling the false discovery rate: a practical and powerful approach to multiple testing

,

J. R. Stat. Soc. Ser. B

,

1995

, vol.

57

(pg.

289

-

300

)

23

The control of false discovery rate in multiple testing under dependency

,

Ann. Stat.

,

2001

, vol.

29

(pg.

1165

-

1188

)

24

A simple sequentially rejective multiple test procedure

,

Scand. J. Stat.

,

1979

, vol.

6

(pg.

65

-

70

)

25

A sharper Bonferroni procedure for multiple tests of significance

,

Biometrika

,

1988

, vol.

75

(pg.

800

-

802

)

26

Random Forests

,

Mach. Learn.

,

2001

, vol.

45

(pg.

5

-

32

)

27

Genome-wide association studies for complex traits: consensus, uncertainty and challenges

,

Nat. Rev. Genet.

,

2008

, vol.

9

(pg.

356

-

369

)

28

et al.

PLINK: a tool set for whole-genome association and population-based linkage analyses

,

Am. J. Hum. Genet.

,

2007

, vol.

81

(pg.

559

-

575

)

29

Gene set-based analysis of polymorphisms: finding pathways or biological processes associated to traits in genome-wide association studies

,

Nucleic Acids Res.

,

2009

, vol.

37

(pg.

W340

-

W344

)

30

FatiGO: a web tool for finding significant associations of Gene Ontology terms with groups of genes

,

Bioinformatics

,

2004

, vol.

20

(pg.

578

-

580

)

31

From genes to functional classes in the study of biological systems

,

BMC Bioinformatics

,

2007

, vol.

8

pg.

114

32

LRpath: a logistic regression approach for identifying enriched biological groups in gene expression data

,

Bioinformatics

,

2008

, vol.

25

(pg.

211

-

217

)

33

GENECODIS: a web-based tool for finding significant concurrent annotations in gene lists

,

Genome Biol.

,

2007

, vol.

8

pg.

R3

34

An oncogenic KRAS2 expression signature identified by cross-species gene-expression analysis

,

Nat. Genet.

,

2005

, vol.

37

(pg.

48

-

55

)

35

miRBase: microRNA sequences, targets and gene nomenclature

,

Nucleic Acids Res.

,

2006

, vol.

34

(pg.

D140

-

D144

)

� The Author(s) 2010. Published by Oxford University Press.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/2.5), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Supplementary data

I agree to the terms and conditions. You must accept the terms and conditions.

Submit a comment

Name

Affiliations

Comment title

Comment

You have entered an invalid code

Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.

Citations

Views

Altmetric

Metrics

Total Views 2,994

2,344 Pageviews

650 PDF Downloads

Since 12/1/2016

Month: Total Views:
December 2016 5
January 2017 38
February 2017 11
March 2017 14
April 2017 10
May 2017 22
June 2017 13
July 2017 12
August 2017 23
September 2017 25
October 2017 17
November 2017 13
December 2017 41
January 2018 38
February 2018 20
March 2018 56
April 2018 61
May 2018 55
June 2018 37
July 2018 26
August 2018 30
September 2018 24
October 2018 26
November 2018 35
December 2018 39
January 2019 29
February 2019 26
March 2019 39
April 2019 54
May 2019 38
June 2019 19
July 2019 44
August 2019 48
September 2019 52
October 2019 32
November 2019 37
December 2019 20
January 2020 34
February 2020 21
March 2020 11
April 2020 15
May 2020 16
June 2020 15
July 2020 30
August 2020 31
September 2020 28
October 2020 40
November 2020 26
December 2020 33
January 2021 20
February 2021 43
March 2021 52
April 2021 63
May 2021 59
June 2021 38
July 2021 37
August 2021 32
September 2021 34
October 2021 39
November 2021 18
December 2021 17
January 2022 27
February 2022 28
March 2022 28
April 2022 30
May 2022 16
June 2022 27
July 2022 54
August 2022 52
September 2022 50
October 2022 35
November 2022 33
December 2022 64
January 2023 29
February 2023 28
March 2023 40
April 2023 51
May 2023 25
June 2023 45
July 2023 22
August 2023 21
September 2023 27
October 2023 19
November 2023 15
December 2023 33
January 2024 33
February 2024 38
March 2024 36
April 2024 39
May 2024 16
June 2024 37
July 2024 37
August 2024 23
September 2024 32
October 2024 23

Citations

254 Web of Science

×

Email alerts

Citing articles via

More from Oxford Academic