INTERVIEWER'S PERSONALITY EFFECT ON ITEM NONRESPONSE: An analysis in a face-to-face survey (original) (raw)
Related papers
Estimation of sensitivity level of personal interview survey questions
Journal of Statistical Planning and Inference, 2002
In this paper, an optional randomized response model is proposed. The estimator of the mean of the stigmatized variable based on the optional randomized response sampling is shown to be more e cient than the usual estimator of the mean based on randomized response technique method. In addition to estimating population mean and variance, it has been shown that the optional randomized response technique is useful in quantifying the sensitivity levels of the questions in the personal interview surveys. An estimator for the sensitivity level of a question is proposed and an empirical study is carried out to show the validity of the proposed estimation technique. We also propose a test for the sensitivity level of the stigmatized variable.
Political Science Research and Methods, 2016
Technology and the decreased cost of survey research have made it possible for researchers to collect data using new and varied modes of interview. These data are often analyzed as if they were generated using similar processes, but the modes of interview may produce differences in response simply due to the presence or absence of an interviewer. In this paper, we explore the differences in item non-response that result from different modes of interview and find that mode makes a difference. The data are from an experiment in which we randomly assigned an adult population to an in-person or self-completed survey after subjects agreed to participate in a short poll. For nearly every topic and format of question, we find less item non-response in the self-complete mode. Furthermore, we find the difference across modes in non-response is exacerbated for respondents with low levels of cognitive abilities. Moving from high to low levels of cognitive ability, an otherwise average responde...
Response Styles and Personality Traits
Journal of Cross-Cultural Psychology, 2014
In two studies, we examined the shared and unique meaning of acquiescent, extreme, midpoint, and socially desirable responding in association with the OPQ32, a forced-choice format personality measure designed to be less affected by these response styles, compared to personality inventories with Likert scales. Country-level response style indexes were derived from six waves of the International Social Survey Programme and from a meta-analysis of a social desirability scale. In the country-level correlational analysis the four response styles formed a general response style factor which was positively associated with (1) dominance (vs. submission) in interpersonal relationships, (2) competitive (vs. modest and democratic) feelings and emotions, and (3) data rational thinking. In a multilevel analysis, age showed a positive and education a negative effect on the individual-level general response style. Negative effects of country-level socioeconomic development and individualism and positive effects of competitiveness and data rational thinking on the individual-level response style were found. We conclude that country-level response styles are systematically associated with country personality measured by the OPQ32, suggesting that they can be viewed as RESPONSE STYLES AND PERSONALITY TRAITS 2 having substantive meaning (i.e., culturally influenced response amplification versus moderation). Implications are discussed.
Assessing Personality Traits Through Response Latencies Using Item Response Theory
Educational and Psychological Measurement, 2011
Recent studies have revealed a relation between the given response and the response latency for personality questionnaire items in the form of an inverted-U effect, which has been interpreted in light of schema-driven behavior. In general, more probable responses are given faster. In the present study, the relationship between the probability of the given response and the response latency was investigated. First, a probabilistic model was introduced describing the relationship between response latencies and a latent trait. Second, the model was applied in an empirical study: Employing items from a personality questionnaire and using data from 170 men, the probability of responses were estimated based on the Rasch model. Assuming log-normally distributed response latencies, a linear regression model was fit to the logarithmized response latencies, including the response probability as a predictor. Findings suggested that the quantities are negatively related. This relation can be use...
Behavior Research Methods, 2020
In self-report surveys, it is common that some individuals do not pay enough attention and effort to give valid responses. Our aim was to investigate the extent to which careless and insufficient effort responding contributes to the biasing of data. We performed analyses of dimensionality, internal structure, and data reliability of four personality scales (extroversion, conscientiousness, stability, and dispositional optimism) in two independent samples. In order to identify careless/insufficient effort (C/IE) respondents, we used a factor mixture model (FMM) designed to detect inconsistencies of response to items with different semantic polarity. The FMM identified between 4.4% and 10% of C/IE cases, depending on the scale and the sample examined. In the complete samples, all the theoretical models obtained an unacceptable fit, forcing the rejection of the starting hypothesis and making additional wording factors necessary. In the clean samples, all the theoretical models fitted satisfactorily, and the wording factors practically disappeared. Trait estimates in the clean samples were between 4.5% and 11.8% more accurate than in the complete samples. These results show that a limited amount of C/IE data can lead to a drastic deterioration in the fit of the theoretical model, produce large amounts of spurious variance, raise serious doubts about the dimensionality and internal structure of the data, and reduce the reliability with which the trait scores of all surveyed are estimated. Identifying and filtering C/IE responses is necessary to ensure the validity of research results.
Dredging the OCEAN.20 : an item response theory analysis of a shortened personality scale
2013
Valid and reliable personality assessments are important tools for personnel selection, so long as they are efficient and free from bias (Mount & Barrick, 1995). Undergraduate students (N = 503) completed the OCEAN.20, a brief 20-item self-report measure of the five factors of personality (O'Keefe, Kelloway, & Francis, 2012). Classical test theory methods had already established the scale's reliability and validity, as replicated in the present study, but item response theory analyses identified nine problematic items. Three items displayed differential item functioning, three items had a truncated range of responses, and three more items had low precision. The potential for bias or insufficient information offered by each item is cause for concern, as it could have serious consequences in determining a job applicant's fate, so it is advised that these items either be removed or revised prior to operational use. Limitations and recommendations for future research are discussed.
International Journal of Public Opinion Research, 2017
Public opinion surveys often use scales marked with terms such as ''strongly agree,'' ''agree,'' ''disagree,'' and ''strongly disagree.'' Two sets of systematic factors may influence answers to such items. First, responses may reflect the substantive concept of interest. It is hoped that if we ask for opinion on a new education proposal, answers will tell us something meaningful about assessments of that policy. Second, answers may reflect a respondent's general approach to survey questions. This article focuses on two such response tendencies: extreme response style (ERS) and acquiescence response style (ARS). The first refers to the extent to which individuals gravitate toward the most extreme response options on a polychotomous scale, and the second denotes a tendency to approve of ideas presented during a survey. Response styles such as these mean that survey data often capture something extraneous to the substantive concept of interest. Scholars have long recognized that response tendencies threaten the validity of inferences derived from survey data (Cronbach, 1946, 1950). Considerable effort has been devoted to identify response sets and understand their correlates. This research note focuses on the latter task by examining links between personality traits and response tendencies. Psychologists measure personality with various trait
Individual response spread in self-report scales: personality correlations and consequences
Personality and Individual Differences, 1998
We consider the phenomenon of individual differences in the use of questionnaire scales and examine some of its consequences. Results from two illustrative studies on farmers and consultant doctors are used to demonstrate that individual standard deviation of response option usage is a consistent trait which is significantly correlated with the personality dimension of conscientiousness. A mathematical model of individual response spread is also devised and it is shown that significant spurious correlations between responses to independent items can arise. This model is extended by estimating individual response thresholds from our two illustrative data sets; numerical simulation using these thresholds confirms the occurrence of spurious correlations. The distribution of correlation coefficients r is also very different from the standard form used for estimating levels of significance. There are widespread consequences of these observations for standard multivariate methods of analysing self-report data.