Repeatability of published microarray gene expression analyses - PubMed (original) (raw)
doi: 10.1038/ng.295. Epub 2008 Jan 28.
David B Allison, Catherine A Ball, Issa Coulibaly, Xiangqin Cui, Aedín C Culhane, Mario Falchi, Cesare Furlanello, Laurence Game, Giuseppe Jurman, Jon Mangion, Tapan Mehta, Michael Nitzberg, Grier P Page, Enrico Petretto, Vera van Noort
Affiliations
- PMID: 19174838
- DOI: 10.1038/ng.295
Repeatability of published microarray gene expression analyses
John P A Ioannidis et al. Nat Genet. 2009 Feb.
Abstract
Given the complexity of microarray-based gene expression studies, guidelines encourage transparent design and public data availability. Several journals require public data deposition and several public databases exist. However, not all data are publicly available, and even when available, it is unknown whether the published results are reproducible by independent scientists. Here we evaluated the replication of data analyses in 18 articles on microarray-based gene expression profiling published in Nature Genetics in 2005-2006. One table or figure from each article was independently evaluated by two teams of analysts. We reproduced two analyses in principle and six partially or with some discrepancies; ten could not be reproduced. The main reason for failure to reproduce was data unavailability, and discrepancies were mostly due to incomplete data annotation or specification of data processing and analysis. Repeatability of published microarray studies is apparently limited. More strict publication rules enforcing public data availability and explicit description of data processing and analysis should be considered.
Comment in
- Mostly, your results matter to others.
[No authors listed] [No authors listed] Nat Genet. 2009 Feb;41(2):135. doi: 10.1038/ng0209-135. Nat Genet. 2009. PMID: 19174831
Similar articles
- Mostly, your results matter to others.
[No authors listed] [No authors listed] Nat Genet. 2009 Feb;41(2):135. doi: 10.1038/ng0209-135. Nat Genet. 2009. PMID: 19174831 - Lack of correct data format and comparability limits future integrative microarray research.
Larsson O, Sandberg R. Larsson O, et al. Nat Biotechnol. 2006 Nov;24(11):1322-3. doi: 10.1038/nbt1106-1322. Nat Biotechnol. 2006. PMID: 17093466 No abstract available. - ArrayExpress service for reviewers/editors of DNA microarray papers.
Brazma A, Parkinson H; ArrayExpress team, EMBL-EBI. Brazma A, et al. Nat Biotechnol. 2006 Nov;24(11):1321-2. doi: 10.1038/nbt1106-1321. Nat Biotechnol. 2006. PMID: 17093465 No abstract available. - Microarray databases: standards and ontologies.
Stoeckert CJ Jr, Causton HC, Ball CA. Stoeckert CJ Jr, et al. Nat Genet. 2002 Dec;32 Suppl:469-73. doi: 10.1038/ng1028. Nat Genet. 2002. PMID: 12454640 Review. - MGED standards: work in progress.
Ball CA, Brazma A. Ball CA, et al. OMICS. 2006 Summer;10(2):138-44. doi: 10.1089/omi.2006.10.138. OMICS. 2006. PMID: 16901218 Review.
Cited by
- Algebraic comparison of partial lists in bioinformatics.
Jurman G, Riccadonna S, Visintainer R, Furlanello C. Jurman G, et al. PLoS One. 2012;7(5):e36540. doi: 10.1371/journal.pone.0036540. Epub 2012 May 17. PLoS One. 2012. PMID: 22615778 Free PMC article. - A data similarity-based strategy for meta-analysis of transcriptional profiles in cancer.
Qiu Q, Lu P, Xiang Y, Shyr Y, Chen X, Lehmann BD, Viox DJ, George AL Jr, Yi Y. Qiu Q, et al. PLoS One. 2013;8(1):e54979. doi: 10.1371/journal.pone.0054979. Epub 2013 Jan 29. PLoS One. 2013. PMID: 23383020 Free PMC article. - DNMT3L inhibits hepatocellular carcinoma progression through DNA methylation of CDO1: insights from big data to basic research.
Yan X, Qi Y, Yao X, Zhou N, Ye X, Chen X. Yan X, et al. J Transl Med. 2024 Feb 2;22(1):128. doi: 10.1186/s12967-024-04939-9. J Transl Med. 2024. PMID: 38308276 Free PMC article. - Visualization methods for differential expression analysis.
Rutter L, Moran Lauter AN, Graham MA, Cook D. Rutter L, et al. BMC Bioinformatics. 2019 Sep 6;20(1):458. doi: 10.1186/s12859-019-2968-1. BMC Bioinformatics. 2019. PMID: 31492109 Free PMC article. - Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition.
Hardwicke TE, Mathur MB, MacDonald K, Nilsonne G, Banks GC, Kidwell MC, Hofelich Mohr A, Clayton E, Yoon EJ, Henry Tessler M, Lenne RL, Altman S, Long B, Frank MC. Hardwicke TE, et al. R Soc Open Sci. 2018 Aug 15;5(8):180448. doi: 10.1098/rsos.180448. eCollection 2018 Aug. R Soc Open Sci. 2018. PMID: 30225032 Free PMC article.
References
- Nat Genet. 2005 Oct;37(10):1047-54 - PubMed
- Nat Methods. 2005 May;2(5):337-44 - PubMed
- Nucleic Acids Res. 2002 Jan 1;30(1):207-10 - PubMed
- Nat Genet. 2006 Nov;38(11):1335-40 - PubMed
- Nat Genet. 2005 May;37(5):501-6 - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources