Comparison between web-based and paper versions of a self-administered anthropometric questionnaire (original) (raw)
Abstract
Online data collection could advantageously replace paper-and-pencil questionnaires in epidemiological studies by reducing the logistic burden, the cost and the duration of data processing. However, there is a need for studies comparing these new instruments to traditional ones. Our objective was to compare the web-based version of the NutriNet-Santé self-administered anthropometric questionnaire to the paper-based version. The questionnaire included 17 questions divided into subquestions (55 variables in all) dealing with height, weight, hip and waist circumferences, weight history, restrictive diet and weight self-perception. Both versions of the questionnaire were filled out by 147 volunteers (paper version first, N = 76, or web-based version first, N = 71) participating in the SU.VI.MAX (“Supplémentation en VItamines Minéraux et AntioXydants”) cohort (age-range: 49–75 years; men: 46.3%). At the end of the test, subjects filled in a “satisfaction” questionnaire giving their opinions and feelings about each version. Agreement was assessed by intraclass correlation coefficients (ICCs) and kappas. We also quantified the number of errors inherent in the paper version. Agreement between the two versions was high. ICCs ranged from 0.86 to 1.00. Kappas ranged from 0.69 to 1.00 for comparable variables. A total of 82 data entry mistakes (1.5% of total entries), 60 missing values (1.1%), 57 inconsistent values (1.1%) and 3 abnormal values (0.1%) were counted in the paper version (non-existent in the web-based version due to integrated controls). The web-based version was preferred by 92.2% of users. In conclusion, the quality of information provided by the web-based anthropometric questionnaire used in the NutriNet-Santé Study was equal to, or better than, that of the paper version, with substantial logistic and cost advantages.
Access this article
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime Subscribe now
Buy Now
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
Instant access to the full article PDF.
Similar content being viewed by others
Abbreviations
ICC:
Intraclass correlation coefficient
References
- American Institute for Cancer Research/World Cancer Research Fund. Food, nutrition, physical activity and the prevention of cancer: a global perspective. Washington, DC: American Institute for Cancer Research; 2007.
Google Scholar - World Health Organization. Diet, nutrition and the prevention of chronic diseases. Joint WHO/FAO expert consultation. WHO Technical Report Series. Geneva: WHO; 2003.
- World Health Organization. The challenge of obesity in the WHO European Region and the strategies for response. Copenhagen: WHO Regional Office for Europe; 2007.
Google Scholar - Ekman A, Litton JE. New times, new needs; e-epidemiology. Eur J Epidemiol. 2007;22(5):285–92.
Article PubMed Google Scholar - Hardré PL, Crowson HM, Xie K, Ly C. Testing differential effects of computer-based, web-based and paper-based administration of questionnaire research instruments. Br J Educ Technol. 2007;38(1):5–22.
Article Google Scholar - Reips UD. Standards for internet-based experimenting. Exp Psychol. 2002;49(4):243–56.
PubMed Google Scholar - Schatzkin A, Subar AF, Moore S, Park Y, Potischman N, Thompson FE, et al. Observational epidemiologic studies of nutrition and cancer: the next generation (with better observation). Cancer Epidemiol Biomarkers Prev. 2009;18(4):1026–32.
Article PubMed Google Scholar - Hercberg S, Preziosi P, Briancon S, Galan P, Triol I, Malvy D, et al. A primary prevention trial using nutritional doses of antioxidant vitamins and minerals in cardiovascular diseases and cancers in a general population: the SU.VI.MAX study—design, methods, and participant characteristics. SUpplementation en VItamines et Mineraux AntioXydants. Control Clin Trials. 1998;19(4):336–51.
Article CAS PubMed Google Scholar - NutriNet-Santé questionnaires [in French]. Internet: http://media.etude-nutrinet-sante.fr/questionnaires/questionnaires_nutrinet_papier.zip (accessed 15 September 2009).
- Sorensen TI, Stunkard AJ, Teasdale TW, Higgins MW. The accuracy of reports of weight: children’s recall of their parents’ weights 15 years earlier. Int J Obes. 1983;7(2):115–22.
CAS PubMed Google Scholar - Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.
Article CAS PubMed Google Scholar - Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990;43(6):543–9.
Article CAS PubMed Google Scholar - Beasley JM, Davis A, Riley WT. Evaluation of a web-based, pictorial diet history questionnaire. Public Health Nutr. 2009;12(5):651–9.
Article PubMed Google Scholar - Marsden J, Jones RB. Validation of Web-based questionnaires regarding osteoporosis prevention in young British women. Health Bull (Edinb). 2001;59(4):254–62.
CAS Google Scholar - Beidleman BA, Muza SR, Fulco CS, Rock PB, Cymerman A. Validation of a shortened electronic version of the environmental symptoms questionnaire. High Alt Med Biol. 2007;8(3):192–9.
Article PubMed Google Scholar - Klovning A, Sandvik H, Hunskaar S. Web-based survey attracted age-biased sample with more severe illness than paper-based survey. J Clin Epidemiol. 2009;62(10):1068–74.
Article PubMed Google Scholar - Médiamétrie. Internet: http://www.mediametrie.fr/internet/ (accessed 15 September 2009).
- European Interactive Advertising Association. Internet: http://eiaa.net/index.asp (accessed 15 September 2009).
- Ipsos Media. Internet: http://www.ipsos.fr/canalipsos/poll/8273.asp/ (accessed 15 September 2009).
- Internet World Stats © Copyright 2009, Miniwatts Marketing Group. Internet: http://internetworldstats.com/ (accessed 15 September 2009).
- Golvin CS, Schadler T. The state of consumers and technology: benchmark 2008. Cambridge: Forrester Research; 2008.
Google Scholar - Lefever S, Dal M, Matthiasdottir A. Online data collection in academic research: advantages and limitations. Br J Educ Technol. 2007;38(4):574–82.
Article Google Scholar - Bexelius C, Honeth L, Ekman A, Eriksson M, Sandin S, Bagger-Sjoback D, et al. Evaluation of an internet-based hearing test—comparison with established methods for detection of hearing loss. J Med Internet Res. 2008;10(4):e32.
Article PubMed Google Scholar - Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol. 2006;21(2):103–11.
Article PubMed Google Scholar - Kendler KS, Myers J, Potter J, Opalesky J. A web-based study of personality, psychopathology and substance use in twin, other relative and relationship pairs. Twin Res Hum Genet. 2009;12(2):137–41.
Article PubMed Google Scholar - Etter JF, Perneger TV. A comparison of cigarette smokers recruited through the internet or by mail. Int J Epidemiol. 2001;30(3):521–5.
Article CAS PubMed Google Scholar - Joinson A. Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput. 1999;31(3):433–8.
CAS PubMed Google Scholar - Wang YC, Lee CM, Lew-Ting CY, Hsiao CK, Chen DR, Chen WJ. Survey of substance use among high school students in Taipei: web-based questionnaire versus paper-and-pencil questionnaire. J Adolesc Health. 2005;37(4):289–95.
Article PubMed Google Scholar - Vance VA, Woodruff SJ, McCargar LJ, Husted J, Hanning RM. Self-reported dietary energy intake of normal weight, overweight and obese adolescents. Public Health Nutr. 2009;12(2):222–7.
Article PubMed Google Scholar - Rowland ML. Self-reported weight and height. Am J Clin Nutr. 1990;52(6):1125–33.
CAS PubMed Google Scholar - van der Lei J, Sturkenboom M. Of new times, new opportunities, and old problems. Eur J Epidemiol. 2007;22(5):281–3.
Article PubMed Google Scholar - Underbakke G, McBride PE, Spencer E. Web-based resources for medical nutrition education. Am J Clin Nutr. 2006;83(4):951S–5S.
CAS PubMed Google Scholar - Tse MM, Choi KC, Leung RS. E-health for older people: the use of technology in health promotion. Cyberpsychol Behav. 2008;11(4):475–9.
Article PubMed Google Scholar - Brug J, Oenema A, Campbell M. Past, present, and future of computer-tailored nutrition education. Am J Clin Nutr. 2003;77(4 Suppl):1028S–34S.
CAS PubMed Google Scholar - van Wier MF, Ariens GA, Dekkers JC, Hendriksen IJ, Smid T, van Mechelen W. Phone and e-mail counselling are effective for weight management in an overweight working population: a randomized controlled trial. BMC Public Health. 2009;9:6.
Article PubMed Google Scholar
Acknowledgments
We thank the scientists, dieticians, technicians and assistants who helped to carry out the NutriNet-Santé test studies, and all dedicated and conscientious volunteers. We especially thank Soizic Gueho (data manager) for performing statistical analysis and Gwenael Monot (computer scientist), who is coordinating the computer aspects of the NutriNet-Santé Study. We thank Voluntis (a healthcare software company) for developing the NutriNet-Santé web-based interface according to our guidelines. We are grateful to Jerri Bram for English editing of the manuscript. This work was supported by the Ministère de la Santé (DGS, French Ministry of Health); the Institut de Veille Sanitaire (InVS); the Institut National de Prévention et d’Education pour la Santé (INPES); the Fondation pour la Recherche Médicale (FRM); the Institut National de la Santé et de la Recherche Médicale (Inserm); the Institut de Recherche en Santé Publique (IRESP); the Institut National de la Recherche Agronomique (Inra); the Conservatoire National des Arts et Métiers (CNAM); and Paris 13 University.
Author information
Authors and Affiliations
- UREN (Unité de Recherche en Epidémiologie Nutritionnelle), U557 Inserm/U1125 Inra/Cnam/Paris 13, CRNH IdF, SMBH Paris 13, 74 rue Marcel Cachin, 93017, Bobigny, France
Mathilde Touvier, Caroline Méjean, Emmanuelle Kesse-Guyot, Clothilde Pollet, Aurélie Malon & Serge Hercberg - USEN (Unité de Surveillance et d’Epidémiologie Nutritionnelle), Institut de Veille Sanitaire, Université Paris 13, 93017, Bobigny, France
Katia Castetbon & Serge Hercberg - Département de Santé Publique, Hôpital Avicenne, 93017, Bobigny, France
Serge Hercberg
Authors
- Mathilde Touvier
You can also search for this author inPubMed Google Scholar - Caroline Méjean
You can also search for this author inPubMed Google Scholar - Emmanuelle Kesse-Guyot
You can also search for this author inPubMed Google Scholar - Clothilde Pollet
You can also search for this author inPubMed Google Scholar - Aurélie Malon
You can also search for this author inPubMed Google Scholar - Katia Castetbon
You can also search for this author inPubMed Google Scholar - Serge Hercberg
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toMathilde Touvier.
Rights and permissions
About this article
Cite this article
Touvier, M., Méjean, C., Kesse-Guyot, E. et al. Comparison between web-based and paper versions of a self-administered anthropometric questionnaire.Eur J Epidemiol 25, 287–296 (2010). https://doi.org/10.1007/s10654-010-9433-9
- Received: 07 December 2009
- Accepted: 04 February 2010
- Published: 27 February 2010
- Issue Date: May 2010
- DOI: https://doi.org/10.1007/s10654-010-9433-9