A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors (original) (raw)
Related papers
Journal of Medical Internet Research, 2017
Background: Web-based surveys have become a new and popular method for collecting data, but only a few studies have directly compared postal and Web-based surveys among physicians, and none to our knowledge among general practitioners (GPs). Objective: Our aim is to compare two modes of survey delivery (postal and Web-based) in terms of participation rates, response times, and completeness of questionnaires in a study assessing GPs' preventive practices. Methods: This randomized study was conducted in Western Switzerland (Geneva and Vaud) and in France (Alsace and Pays de la Loire) in 2015. A random selection of community-based GPs (1000 GPs in Switzerland and 2400 GPs in France) were randomly allocated to receive a questionnaire about preventive care activities either by post (n=700 in Switzerland, n=400 in France) or by email (n=300 in Switzerland, n=2000 in France). Reminder messages were sent once in the postal group and twice in the Web-based group. Any GPs practicing only complementary and alternative medicine were excluded from the study. Results: Among the 3400 contacted GPs, 764 (22.47%, 95% CI 21.07%-23.87%) returned the questionnaire. Compared to the postal group, the participation rate in the Web-based group was more than four times lower (246/2300, 10.70% vs 518/1100, 47.09%, P<.001), but median response time was much shorter (1 day vs 1-3 weeks, P<.001) and the number of GPs having fully completed the questionnaire was almost twice as high (157/246, 63.8% vs 179/518, 34.6%, P<.001). Conclusions: Web-based surveys offer many advantages such as reduced response time, higher completeness of data, and large cost savings, but our findings suggest that postal surveys can be still considered for GP research. The use of mixed-mode approaches is probably a good strategy to increase GPs' participation in surveys while reducing costs.
GP survey response rate: a miscellany of influencing factors
Family Practice, 2001
Morris CJ, Cantrill JA and Weiss MC. GP survey response rate: a miscellany of influencing factors. Family Practice 2001; 18: 454-456. Background. GP response to surveys is acknowledged to vary widely. The minimization of non-response bias and the generalizability of findings are fundamental research issues.
Response rates in GP surveys - trialling two recruitment strategies
Australian family physician, 2011
This study aimed to examine the efficacy of two strategies for improving general practitioner response to a survey. A secondary aim was to assess GPs' self reported preferred mode of survey administration. This study aimed to examine the efficacy of two strategies for improving general practitioner response to a survey. A secondary aim was to assess GPs' self reported preferred mode of survey administration. Of the 1666 GPs sampled, 52 were ineligible and 500 completed the survey. The response rates obtained in the trial of standard research group letterhead invitations alone (25.8%) versus division of general practice cover letter (32.5%) were not statistically significantly different; nor were the response rates obtained in the trial of a telephone reminder call. When asked about preferred mode of survey administration, 81.1% of respondents nominated mailed survey. The study failed to identify strategies to improve GP participation in the survey. This survey found no basis...
Methodologies for Improving Response Rates in Surveys of Physicians: A Systematic Review
Evaluation & the Health Professions, 2007
Although physician surveys are an important tool in health services and policy research, they are often characterized by low response rates. The authors conducted a systematic review of 66 published reports of efforts to improve response rates to physician surveys. Two general strategies were explored in this literature: incentive and design-based approaches. Even small financial incentives were found to be effective in improving physician response. Token nonmonetary incentives were much less effective. In terms of design strategies, postal and telephone strategies have generally been more successful than have fax or Web-based approaches, with evidence also supporting use of mixed-mode surveys in this population. In addition, use of first-class stamps on return envelopes and questionnaires designed to be brief, personalized, and endorsed by legitimizing professional associations were also more likely to be successful. Researchers should continue to implement design strategies that have been documented to improve the survey response of physicians.
Surveying general practitioners: does a low response rate matter?
The British journal of general practice : the journal of the Royal College of General Practitioners, 1997
Primary care has long been of interest to policy research. Recently, there is evidence to suggest that it is becoming more difficult to encourage GPs (general practitioners) to participate in surveys. As low response rates can introduce bias into survey results, it is important to study the effects of non-response. To assess the validity of a response rate of 44% obtained in a national postal study of GPs surveyed about their work with alcohol-misusing patients by assessing the extent of any non-response bias. A telephone survey of 148 GPs who had not responded to repeated mailings of a postal questionnaire was undertaken. In addition to personal and practice structure characteristics, the GPs were asked three questions taken from the original questionnaire about their work with alcohol-misusing patients. Of the 148 GPs telephoned, 64 responded to the telephone questionnaire in full; all had previously failed to respond to the postal questionnaire. Younger GPs were more likely to re...
2013
Objectives : The purpose of this article is to find out differences between surveys using paper and online questionnaires. The author has deep knowledge in the case of questions concerning opinions in the development of survey based research, e.g. the limits of postal and online questionnaires. Methods : In the physician studies carried out in 1995 (doctors graduated in 1982-1991), 2000 (doctors graduated in 1982-1996), 2005 (doctors graduated in 1982-2001), 2011 (doctors graduated in 1977-2006) and 457 family doctors in 2000, were used paper and online questionnaires. The response rates were 64%, 68%, 64%, 49% and 73%, respectively. Results : The results of the physician studies showed that there were differences between methods. These differences were connected with using paper-based questionnaire and online questionnaire and response rate. The online-based survey gave a lower response rate than the postal survey. The major advantages of online survey were short response time; ver...
Australian Journal of Primary Health, 2014
Surveys of GPs are essential to facilitate future planning and delivery of health services. However, recruitment of GPs into research has been disappointing with response rates declining over recent years. This study identified factors that facilitated or hampered GP recruitment in a recent survey of Australian GPs where a range of strategies were used to improve recruitment following poor initial responses. GP response rates for different stages of the survey were examined and compared with reasons GPs and leaders of university research networks cited for non-participation. Poor initial response rates were improved by including a questionnaire in the mail-out, changing the mail-out source from an unknown research team to locally known network leaders, approaching a group of GPs known to have research and training interests, and offering financial compensation. Response rates increased from below 1% for the first wave to 14.5% in the final wave. Using a known and trusted network of professionals to endorse the survey combined with an explicit compensation payment significantly enhanced GP response rates. To obtain response rates for surveys of GPs that are high enough to sustain external validity requires an approach that persuades GPs and their gatekeepers that it is worth their time to participate.
Enhancing Surveys of Health Care Professionals: A Meta-Analysis of Techniques to Improve Response
Evaluation & the Health Professions, 2013
Surveys involving health care providers are characterized by low and declining response rates (RRs), and researchers have utilized various strategies to increase survey RRs among health professionals. Based on 48 studies with 156 subgroups of within-study conditions, a multilevel meta-regression analysis was conducted to summarize the effects of different strategies employed in surveys of health professionals. An estimated overall survey RR among health professionals was 0.53 with a significant downward trend during the last half century. Downloaded from Of the variables that were examined, mode of data collection, incentives, and number of follow-up attempts were all found to be significantly related to RR. The mail survey mode was more effective in improving RR, compared to the online or web survey mode. Relative to the non-incentive subgroups, subgroups receiving monetary incentives were more likely to respond, while nonmonetary incentive groups were not significantly different from non-incentive groups. When number of follow-ups was considered, the one or two attempts of follow-up were found to be effective in increasing survey RR among health professionals. Having noted challenges associated with surveying health professionals, researchers must make every effort to improve access to their target population by implementing appropriate incentive-and design-based strategies demonstrated to improve participation rates.
Family practice, 2002
Non-response is an important potential source of bias in survey research. With evidence of falling response rates from GPs, it is of increasing importance when undertaking postal questionnaire surveys of GPs to seek to maximize response rates and evaluate the potential for non-response bias. Our aim was to investigate the effectiveness of follow-up procedures when undertaking a postal questionnaire study of GPs, the use of publicly available data in assessing non-response bias and the development of regression models predicting responder behaviour. A postal questionnaire study was carried out of a random sample of 600 GPs in Wales concerning their training and knowledge in palliative care. A cumulative response rate graph permitted optimal timing of follow-up mailings: a final response rate of 67.6% was achieved. Differences were found between responders and non-responders on several parameters and between sample and population on some parameters: some of these may bias the sample d...