Our path to better science in less time using open data science tools (original) (raw)

• Baker, M. Over half of psychology studies fail reproducibility test. Nature Newshttp://dx.doi.org/10.1038/nature.2015.18248 (2015).
• Baker, M. & Dolgin, E. Cancer reproducibility project releases first results. Nature Newshttp://dx.doi.org/10.1038/541269a (2017).
• Open Science Collaboration. Estimating the reproducibility of psychological science. Science 349, aac4716 (2015).
  Article Google Scholar
• Baker, M. 1,500 scientists lift the lid on reproducibility. Nature 533, 452–454 (2016).
  Article CAS Google Scholar
• Aschwanden, C. Science isn't broken. FiveThirtyEighthttp://go.nature.com/2qaz0Tz (19 August 2015)
• Buck, S. Solving reproducibility. Science 348, 1403–1403 (2015).
  Article CAS Google Scholar
• Frew, J. & Dozier, J. Environmental informatics. Annu. Rev. Environ. Resources 37, 449–472 (2012).
  Article Google Scholar
• Jones, M. B., Schildhauer, M. P., Reichman, O. J. & Bowers, S. The new bioinformatics: Integrating ecological data from the gene to the biosphere. Annu. Rev. Ecol. Evol. Syst. 37, 519–544 (2006).
  Article Google Scholar
• Michener, W. K. & Jones, M. B. Ecoinformatics: Supporting ecology as a data-intensive science. Trends Ecol. Evol. 27, 85–93 (2012).
  Article Google Scholar
• Check Hayden, E. Mozilla plan seeks to debug scientific code. Nature Newshttp://dx.doi.org/10.1038/501472a (2013).
• Boettiger, C., Chamberlain, S., Hart, E. & Ram, K. Building software, building community: Lessons from the rOpenSci project. J. Open Res. Softw. 3, e8 (2015).
  Article Google Scholar
• Wilson, G. et al. Good enough practices in scientific computing. Preprint at https://arxiv.org/abs/1609.00037 (2016).
• Wilson, G. V. Where's the real bottleneck in scientific computing? Am. Sci. 94, 5–6 (2006).
  Article Google Scholar
• Baker, M. Scientific computing: Code alert. Nature 541, 563–565 (2017).
  Article Google Scholar
• Barone, L., Williams, J. & Micklos, D. Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators. Preprint at bioRxivhttps://doi.org/10.1101/108555 (2017).
• Wolkovich, E. M., Regetz, J. & O’Connor, M. I. Advances in global change research require open science by individual researchers. Global Change Biol. 18, 2102–2110 (2012).
  Article Google Scholar
• Nosek, B. A. et al. Promoting an open research culture. Science 348, 1422–1425 (2015).
  Article CAS Google Scholar
• Reichman, O. J., Jones, M. B. & Schildhauer, M. P. Challenges and opportunities of open data in ecology. Science 331, 703–705 (2011).
  Article CAS Google Scholar
• Shade, A. & Teal, T. K. Computing workflows for biologists: A roadmap. PLoS Biol. 13, e1002303 (2015).
  Article Google Scholar
• Goodman, A. et al. Ten simple rules for the care and feeding of scientific data. PLoS Comput. Biol. 10, e1003542 (2014).
  Article Google Scholar
• Sandve, G. K., Nekrutenko, A., Taylor, J. & Hovig, E. Ten simple rules for reproducible computational research. PLoS Comput. Biol. 9, e1003285 (2013).
  Article Google Scholar
• White, E. P. et al. Nine simple ways to make it easier to (re)use your data. Ideas Ecol. Evol.http://doi.org/10.4033/iee.2013.6b.6.f (2013).
• Kervin, K., Michener, W. & Cook, R. Common errors in ecological data sharing. J. eScience Librarianshiphttp://dx.doi.org/10.7191/jeslib.2013.1024 (2013).
• Lewandowsky, S. & Bishop, D. Research integrity: don't let transparency damage science. Nature Newshttp://dx.doi.org/10.1038/529459a (2016).
• Michener, W. K. Ten simple rules for creating a good data management plan. PLoS Comput. Biol. 11, e1004525 (2015).
  Article Google Scholar
• Mislan, K. A. S., Heer, J. M. & White, E. P. Elevating the status of code in ecology. Trends Ecol. Evol. 31, 4–7 (2016).
  Article CAS Google Scholar
• Kratz, J. & Strasser, C. Data publication consensus and controversies. F1000Researchhttp://dx.doi.org/10.12688/f1000research.3979.3 (2014).
• Munafò, M. R. et al. A manifesto for reproducible science. Nat. Hum. Behav. 1, 0021 (2017).
  Article Google Scholar
• Martinez, C. et al. Reproducibility in Science: A Guide to Enhancing Reproducibility in Scientific Results and Writinghttp://ropensci.github.io/reproducibility-guide/ (2014).
• Tuyl, S. V. & Whitmire, A. L. Water, water, everywhere: defining and assessing data sharing in academia. PLoS ONE 11, e0147942 (2016).
  Article Google Scholar
• Baker, M. Why scientists must share their research code. Nature Newshttp://dx.doi.org/10.1038/nature.2016.20504 (2016).
• Kidwell, M. C. et al. Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency. PLoS Biol. 14, e1002456 (2016).
  Article Google Scholar
• Wickham, H. & Grolemund, G. R for Data Science (O’Reilly, 2016); http://r4ds.had.co.nz/
• Lowndes, J. S. S. et al. Best practices for assessing ocean health in multiple contexts using tailorable frameworks. PeerJ 3, e1503 (2015).
  Article Google Scholar
• Lowndes, J. A biography of the ocean health index. ohi-sciencehttp://ohi-science.org/news/Biography-OHI (13 January 2017).
• Halpern, B. S. et al. An index to assess the health and benefits of the global ocean. Nature 488, 615–620 (2012).
  Article CAS Google Scholar
• Halpern, B. S. et al. Patterns and emerging trends in global ocean health. PLoS ONE 10, e0117863 (2015).
  Article Google Scholar
• Five years of global ocean health index assessments. ohi-sciencehttp://ohi-science.org/ohi-global (2016).
• Goldfuss, C. & Holdren, J. P. The nation's first ocean plans. The White Househttps://obamawhitehouse.archives.gov/blog/2016/12/07/nations-first-ocean-plans (7 December 2016).
• Hampton, S. E. et al. The tao of open science for ecology. Ecosphere 6, art 120 (2015).
  Article Google Scholar
• Mills, B. Introducing mozilla science study groups. Mozillahttps://science.mozilla.org/blog/introducing-mozilla-science-study-groups (22 April 2015).
• R Core Team R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, 2016); https://www.R-project.org/
• RStudio Team RStudio: Integrated Development for R (RStudio, 2016); www.rstudio.com
• Git Team Git Version Control System (Git, 2016); https://git-scm.com/
• GitHub: A Collaborative Online Platform To Build Software (GitHub, 2016); https://github.com
• Wilson, G. V. Software carpentry: getting scientists to write better code by making them more productive. Comput. Sci. Eng. 8, 66–69 (2006).
  Article Google Scholar
• Broman, K. Initial steps toward reproducible research. http://kbroman.org/steps2rr/ (2016).
• McKiernan, E. C. et al. How open science helps researchers succeed. eLife 5, e16800 (2016).
  Article Google Scholar
• Seltenrich, N. Scaling the heights of data science. Breakthroughshttps://nature.berkeley.edu/breakthroughs/opensci-data (2016).
• Wilson, G. et al. Best practices for scientific computing. PLoS Biol. 12, e1001745 (2014).
  Article Google Scholar
• Haddock, S. H. & Dunn, C. W. Practical Computing for Biologists (Sinauer Associates, 2011).
  Google Scholar
• Barnes, N. Publish your computer code: it is good enough. Nature 467, 753 (2010).
  Article CAS Google Scholar
• Frazier, M., Longo, C. & Halpern, B. S. Mapping uncertainty due to missing data in the global ocean health index. PLoS ONE 11, e0160377 (2016).
  Article Google Scholar
• ESRI ArcGIS Platform (2016); http://www.esri.com/software/arcgis
• The QGIS Team QGIS Project (2016); http://www.qgis.org
• The Python Team Python (2016); https://www.python.org/
• Wickham, H. Tidy data. J. Stat. Softw. 59, 1–23 (2014).
  Article Google Scholar
• Wickham, H. Tidyverse Tidyweb (accessed 29 January 2017); http://tidyverse.org/
• Wickham, H. Tidyverse: Easily Install and Load ‘tidyverse’ Packages (2016); https://CRAN.R-project.org/package=tidyverse
• Fischetti, T. How dplyr replaced my most common r idioms. StatsBlogshttp://www.onthelambda.com/2014/02/10/how-dplyr-replaced-my-most-common-r-idioms/ (10 February 2014).
• RStudio Team R Markdown (2016); http://rmarkdown.rstudio.com/
• Allaire, J. J. et al. R Markdown: Dynamic Documents for R (2016); https://CRAN.R-project.org/package=rmarkdown
• Ocean Health Index ohicore Package (Ocean Health Index Team, 2016).
• Wickham, H. R Packages (O’Reilly, 2015); http://r-pkgs.had.co.nz/
• Wickham, H. & Chang, W. Devtools: Tools to Make Developing R Packages Easier (2016); https://CRAN.R-project.org/package=devtools
• Wickham, H., Danenberg, P. & Eugster, M. Roxygen2: In-Source Documentation for R (2015); https://CRAN.R-project.org/package=roxygen2
• Ram, K. Git can facilitate greater reproducibility and increased transparency in science. Source Code Biol. Med. 8, 7 (2013).
  Article Google Scholar
• Blischak, J. D., Davenport, E. R. & Wilson, G. A quick introduction to version control with git and GitHub. PLoS Comput. Biol. 12, e1004668 (2016).
  Article Google Scholar
• Perez-Riverol, Y. et al. Ten simple rules for taking advantage of Git and GitHub. PLoS Comput. Biol. 12, e1004947 (2016).
  Article Google Scholar
• Duhigg, C. What Google learned from its quest to build the perfect team. The New York Times (25 February 2016).
• Perkel, J. Democratic databases: Science on GitHub. Nature 538, 127–128 (2016).
  Article CAS Google Scholar
• Casadevall, A. & Fang, F. C. Reproducible science. Infect. Immun. 78, 4972–4975 (2010).
  Article CAS Google Scholar
• Wilson, G. Software carpentry: lessons learned. F1000Researchhttp://dx.doi.org/10.12688/f1000research.3-62.v2 (2016).
• Hampton, S. E. et al. Big data and the future of ecology. Front. Ecol. Environ. 11, 156–162 (2013).
  Article Google Scholar
• Lohr, S. For big-data scientists, ‘janitor work’ is key hurdle to insights. The New York Times (17 August 2014).
• FitzJohn, R., Pennell, M., Zanne, A. & Cornell, W. Reproducible research is still a challenge. ROpenSci https://ropensci.org//blog/2014/06/09/reproducibility/ (9 June 2014).
• Boland, M. R., Karczewski, K. J. & Tatonetti, N. P. Ten simple rules to enable multi-site collaborations through data sharing. PLoS Comput. Biol. 13, e1005278 (2017).
  Article Google Scholar
• Perkel, J. M. Scientific writing: the online cooperative. Nature 514, 127–128 (2014).
  Article CAS Google Scholar
• How Twitter improved my ecological model. R-bloggershttps://www.r-bloggers.com/how-twitter-improved-my-ecological-model/ (26 February 2015).