Design and evaluation in eHealth: challenges and implications for an interdisciplinary field - PubMed (original) (raw)
Review
Design and evaluation in eHealth: challenges and implications for an interdisciplinary field
Claudia Pagliari. J Med Internet Res. 2007.
Abstract
Much has been written about insufficient user involvement in the design of eHealth applications, the lack of evidence demonstrating impact, and the difficulties these bring for adoption. Part of the problem lies in the differing languages, cultures, motives, and operational constraints of producers and evaluators of eHealth systems and services. This paper reflects on the benefits of and barriers to interdisciplinary collaboration in eHealth, focusing particularly on the relationship between software developers and health services researchers. It argues that the common pattern of silo or parallel working may be ameliorated by developing mutual awareness and respect for each others' methods, epistemologies, and contextual drivers and by recognizing and harnessing potential synergies. Similarities and differences between models and techniques used in both communities are highlighted in order to illustrate the potential for integrated approaches and the strengths of unique paradigms. By sharing information about our research approaches and seeking to actively collaborate in the process of design and evaluation, the aim of achieving technologies that are truly user-informed, fit for context, high quality, and of demonstrated value is more likely to be realized. This may involve embracing new ways of working jointly that are unfamiliar to the stakeholders involved and that challenge disciplinary conventions. It also has policy implications for agencies commissioning research and development in this area.
Conflict of interest statement
None declared.
Figures
Figure 1
The increasing breadth and complexity of eHealth in terms of the stakeholders, technologies, objectives and disciplines involved
Figure 2
Key software lifecycle models: Waterfall [25], Spiral [26], Star [27] model
Figure 3
ISO 13407 standard for human-centered design processes for interactive systems
Figure 4a
Sequential stages in evaluation of complex interventions (after [33]). Similar steps are used in the evaluation of new drugs, from initial preclinical research through to postmarketing surveillance.
Figure 4b
Iterative view of complex intervention evaluation (after [33]). This recognizes that results from individual phases may prompt revisions and repetition.
Figure 5
The Action Research Spiral (after [34])
Figure 6
The “Plan-Do-Study-Act” process improvement cycle of total quality management (after [35])
Figure 7
An idealized framework for evaluating emergent eHealth resources at different stages of development and implementation
Similar articles
- What is eHealth (5): a research agenda for eHealth through stakeholder consultation and policy context review.
Jones R, Rogers R, Roberts J, Callaghan L, Lindsey L, Campbell J, Thorogood M, Wright G, Gaunt N, Hanks C, Williamson GR. Jones R, et al. J Med Internet Res. 2005 Nov 10;7(5):e54. doi: 10.2196/jmir.7.5.e54. J Med Internet Res. 2005. PMID: 16403718 Free PMC article. - Expanding multi-disciplinary approaches to healthcare information technologies: what does information systems offer medical informatics?
Chiasson M, Reddy M, Kaplan B, Davidson E. Chiasson M, et al. Int J Med Inform. 2007 Jun;76 Suppl 1:S89-97. doi: 10.1016/j.ijmedinf.2006.05.010. Int J Med Inform. 2007. PMID: 16769245 - Challenges and opportunities of eHealth research.
Ahern DK. Ahern DK. Am J Prev Med. 2007 May;32(5 Suppl):S75-82. doi: 10.1016/j.amepre.2007.01.016. Am J Prev Med. 2007. PMID: 17466822 Review. - Emerging eHealth Directions in the Philippines.
Fernandez-Marcelo PG, Ho BL, Faustorilla JF Jr, Evangelista AL, Pedrena M, Marcelo A. Fernandez-Marcelo PG, et al. Yearb Med Inform. 2012;7:144-52. Yearb Med Inform. 2012. PMID: 22890357 Review.
Cited by
- Design as a quality improvement strategy: The case for design expertise.
Lamé G, Komashie A, Sinnott C, Bashford T. Lamé G, et al. Future Healthc J. 2024 Feb 29;11(1):100008. doi: 10.1016/j.fhj.2024.100008. eCollection 2024 Mar. Future Healthc J. 2024. PMID: 38646045 Free PMC article. - Identifying app components that promote physical activity: a group concept mapping study.
Braun M, Carlier S, De Backere F, Van De Velde M, De Turck F, Crombez G, De Paepe AL. Braun M, et al. PeerJ. 2024 Mar 29;12:e17100. doi: 10.7717/peerj.17100. eCollection 2024. PeerJ. 2024. PMID: 38563015 Free PMC article. - Technology-Supported Behavior Change-Applying Design Thinking to mHealth Application Development.
Schweitzer R, Schlögl S, Schweitzer M. Schweitzer R, et al. Eur J Investig Health Psychol Educ. 2024 Mar 7;14(3):584-608. doi: 10.3390/ejihpe14030039. Eur J Investig Health Psychol Educ. 2024. PMID: 38534900 Free PMC article. - Action Opportunities to Pursue Responsible Digital Care for People With Intellectual Disabilities: Qualitative Study.
Siebelink NM, van Dam KN, Lukkien DRM, Boon B, Smits M, van der Poel A. Siebelink NM, et al. JMIR Ment Health. 2024 Feb 28;11:e48147. doi: 10.2196/48147. JMIR Ment Health. 2024. PMID: 38416547 Free PMC article. - Development of a digital intervention for psychedelic preparation (DIPP).
McAlpine RG, Sacchet MD, Simonsson O, Khan M, Krajnovic K, Morometescu L, Kamboj SK. McAlpine RG, et al. Sci Rep. 2024 Feb 19;14(1):4072. doi: 10.1038/s41598-024-54642-4. Sci Rep. 2024. PMID: 38374177 Free PMC article.
References
- Pagliari Claudia, Sloan David, Gregor Peter, Sullivan Frank, Detmer Don, Kahan James P, Oortwijn Wija, Macgillivray Steve. What is eHealth (4): a scoping exercise to map the field. J Med Internet Res. 2005;7(1):e9. doi: 10.2196/jmir.7.1.e9. http://www.jmir.org/2005/1/e9/v7e9 - DOI - PMC - PubMed
- McConnell Harry. International efforts in implementing national health information infrastructure and electronic health records. World Hosp Health Serv. 2004;40(1):33–37, 39-40, 50-2. - PubMed
- Department of Health, authors. Delivering 21st Century IT Support for the NHS. National Strategic Programme. London, UK: Department of Health; 2002. [2007 May 11]. <5KF3I4EYY> http://www.medgraphics.cam.ac.uk/Downloads/NHS_0007.PDF.
- Weingart P. Interdisciplinarity: the paradoxical discourse. In: Weingart P, Stehr N, editors. Practising Interdisciplinarity. Toronto, ON: University of Toronto Press; 2000. pp. 25–42.
- Corn Milton, Rudzinski Karen A, Cahn Marjorie A. Bridging the gap in medical informatics and health services research: workshop results and next steps. J Am Med Inform Assoc. 2002 Mar;9(2):140–3. doi: 10.1197/jamia.M0971. http://www.pubmedcentral.nih.gov/articlerender.fcgi?tool=pubmed&pubmedid... - DOI - PMC - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources