Psychometric properties of an emotional adjustment measure: An application of the graded response model (original) (raw)
Related papers
Psychometric Properties of an Emotional Adjustment Measure
European Journal of Psychological Assessment, 2007
Item response theory (IRT) provides valuable methods for the analysis of the psychometric properties of a psychological measure. However, IRT has been mainly used for assessing achievements and ability rather than personality factors. This paper presents an application of the IRT to a personality measure. Thus, the psychometric properties of a new emotional adjustment measure that consists of a 28-six graded response items is shown. Classical test theory (CTT) analyses as well as IRT analyses are carried out. Samejima's (1969) graded-response model has been used for estimating item parameters. Results show that the bank of items fulfills model assumptions and fits the data reasonably well, demonstrating the suitability of the IRT models for the description and use of data originating from personality measures. In this sense, the model fulfills the expectations that IRT has undoubted advantages: (1) The invariance of the estimated parameters, (2) the treatment given to the standa...
Frontiers in Psychology, 2018
The present work aims at developing a new version of the short form of the Eysenck Personality Questionnaire-Revised, which includes Psychoticism, Extraversion, Neuroticism, and Lie scales (48 items, 12 per scale). The work consists of two studies. In the first one, an item response theory model was estimated on the responses of 590 individuals to the full-length version of the questionnaire (100 items). The analyses allowed the selection of 48 items well discriminating and distributed along the latent continuum of each trait, and without misfit and differential item functioning. In the second study, the functioning of the new form of the questionnaire was evaluated in a different sample of 300 individuals. Results of the two studies show that reliability of the four scales is better than, or equal to that of the original forms. The new version outperforms the original one in approximating scores of the full-length questionnaire. Moreover, convergent validity coefficients and relations with clinical constructs were consistent with literature.
Psycho-Oncology, 2014
Background: The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Group is currently developing computerized adaptive testing measures for the Quality of Life Questionnaire Core-30 (QLQ-C30) scales. The work presented here describes the development of an EORTC item bank for emotional functioning (EF), which is one of the core domains of the QLQ-C30. Methods: According to the EORTC guidelines on module development, the development of the EF item bank comprised four phases, of which the phases I-III are reported in the present paper. Phase I involved defining the theoretical framework for the EF item bank and a literature search. Phase II included pre-defined item selection steps and a multi-stage expert review process. In phase III, feedback from cancer patients from different countries was obtained. Results: On the basis of literature search in phase I, a list of 1750 items was generated. These were reviewed and further developed in phase II with a focus on relevance, redundancy, clarity, and difficulty. The development and selection steps led to a preliminary list of 41 items. In phase III, patient interviews (N = 41; Austria, Denmark, Italy, and the UK) were conducted with the preliminary item list, resulting in some minor changes to item wording. The final list comprised 38 items. Discussion: The phases I-III of the developmental process have resulted in an EF item list that was well accepted by patients in several countries. The items will be subjected to larger-scale field testing in order to establish their psychometric characteristics and their fit to an item response theory model.
Fitting Item Response Theory Models to Two Personality Inventories: Issues and Insights
Multivariate Behavioral Research, 2001
The present study compared the fit of several IRT models to two personality assessment instruments. Data from 13,059 individuals responding to the US-English version of the Fifth Edition of the Sixteen Personality Factor Questionnaire (16PF) and 1,770 individuals responding to Goldberg's 50 item Big Five Personality measure were analyzed. Various issues pertaining to the fit of the IRT models to personality data were considered. We examined two of the most popular parametric models designed for dichotomously scored items (i.e., the two-and three-parameter logistic models) and a parametric model for polytomous items (Samejima's graded response model). Also examined were Levine's nonparametric maximum likelihood formula scoring models for dichotomous and polytomous data, which were previously found to provide good fits to several cognitive ability tests . The two-and threeparameter logistic models fit some scales reasonably well but not others; the graded response model generally did not fit well. The nonparametric formula scoring models provided the best fit of the models considered. Several implications of these findings for personality measurement and personnel selection were described.
Journal of curriculum and teaching, 2019
Students' emotional intelligence represents an important variable that is connected to students' academic achievement and life success. One main challenge when measuring students' emotional intelligence is to have a valid and reliable measure that captures this emotional construct. The current study aims to investigate the psychometric properties of the Arabic version of Alsmadoni emotional intelligence scale (AEIS-25) using item response theory (IRT) models. The study was applied among 3030 students in grades 7-10 in Oman. Data model fit was examined through evaluating IRT assumptions (i.e. unidimensional assumption and local independence assumption) and goodness of fit (i.e. items fit and persons fit). It was found that item parameters were acceptable and satisfactory, which indicates the appropriateness of AEIS to examine emotional intelligence among adolescents. Findings from exploratory factor analysis for 2924 students and for the remaining 24 items indicated the presence of a 2-factor model since the third factor was loaded by only one item. AEIS was considered as a reliable and potentially valid measure of trait emotional intelligence.
An Item Response Theory Analysis of Response Stability in Personality Measurement
Applied Psychological Measurement, 2001
An item response theory model of response stability is developed, based on the local independence principle. The model predicts response changes under repeated administrations of the same instrument using item and examinee parameter estimates as predictors. Real data were used to assess how the model functioned. Results indicated that the model predictions were approximately fulfilled. Limitations of the model and the empirical study are discussed. Index terms: item response models and personality, local independence principle, personality measurement, test-retest stability.
Journal of Clinical Epidemiology, 2016
Objective: To improve measurement precision the EORTC Quality of Life Group is developing an item bank for computerized adaptive testing (CAT) of emotional functioning (EF). The item bank will be within the conceptual framework of the widely used EORTC QLQ-C30 questionnaire. Study Design and Setting: Based on literature search and evaluations by international samples of experts and cancer patients 38 candidate items were developed. The psychometric properties of the items were evaluated in a large international sample of cancer patients. This included evaluations of dimensionality, IRT model fit, differential item functioning (DIF), and of measurement precision/statistical power. Results: Responses were obtained from 1,023 cancer patients from four countries. The evaluations showed that 24 items could be included in a unidimensional IRT model. DIF did not seem to have any significant impact on the estimation of EF. Evaluations indicated that the CAT measure may reduce sample size requirements by up to 50% compared to the QLQ-C30 EF scale without reducing power. Conclusion: Based on thorough psychometric evaluations we have established an EF item bank of 24 items. This will allow for more precise and flexible measurement of EF, while maintaining backward compatibility with the QLQ-C30 EF scale.
Applied Psychological Measurement, 1983
This paper describes the applicability of item re sponse theory to attitude scale development and pro vides an illustration derived from a study of the pro pensity toward jealousy in romantic relationships. The item analysis model used is identical to the factor analysis model, so factor analytic criteria are used to evaluate the scale. These criteria may be used to de cide whether the scale may be scored as a measure of a single variable and whether a simple sum or a weighted sum of the item responses serves as an opti mal test score. Estimates of the reliability of the scale based on the item response model are also described.