Reliability of the Non-Communicating Adult Pain Checklist (NCAPC), assessed by different groups of health workers (original) (raw)
Related papers
Intraobserver and Interobserver Reliability of Assessments of Impairments and Disabilities
Physical therapy, 1997
Background and Purpose. The purpose of this study was to evaluate the interobsenrer and intraobserver reliability of assessments of impairments and disabilities. Subjects and Methods. One physical therapist's assess ments were examined for intraobserver reliability. Judgments of two pairs of therapists were used to examine interobserver reliabilih. Reliability was assessed by Cohen's kappa. Results. Of the 42 impairments and disabilities assessed by the physical therapist in the intraobserver reliability study, kappa values could be calculated for 33 items. For 31 items (94%), kappa values ranged from .40 to .91, and 2 items (6%) had kappa values of less than .40. To determine interobserver reliabilit)., 37 items were assessed in one practice. Kappa values could be calculated for 34 items, with 30 items (88%) having kappa \slues ranging from .41 to. SO and 4 items (12%) showing "poor" agreement. In the second practice, 47 items were assessed for interobserver reliability. Kappa values could be calculated for 40 items, with 11 items (27.5%) having kappa values ranging from .41 to 34. Poor agreement was shown for the remaining 29 items (72.5%). Conclusion and Discussion. Assessments of impairments and disabilities are potentially reliable. The differences between practices of the interobserver reliability study can be explained by the fact that one of the therapists did not receive training in the use of the assessment form. More generalizable conclusions will require further study with more subjects and therapists. [Hendriks EJM, Brandsma JW, Heerkens YF, et al. Intraobserver and interobserver reliability of assessments of impairments and disabilities.
International Journal of Nursing Knowledge, 2016
The article investigates the interrater reliability of Nursing Outcome Classification (NOC) "Caregiver Performance: Direct Care" in Indonesian language. METHODS: Two raters assessed 31 caregivers of clients with mental disorders using NOC "Caregiver Performance: Direct Care" in January 2016. This NOC was translated into Indonesian and each indicator was operated in accordance with caregivers' need in taking care of clients. Kappa and percent agreement were used for the analysis. FINDINGS: The overall kappa value of NOC "Caregiver Performance: Direct Care" was 0.752, while the percent agreement was 80. CONCLUSIONS: The interrater reliability of NOC "Caregiver Performance: Direct Care" in Indonesian was at the level of substantial reliability. IMPLICATION FOR NURSING PRACTICE: NOC "Caregiver Performance: Direct Care" can be used in the clinical setting.
2004
Background: Difficulty with pain assessment in individuals who cannot self-report their pain poses a significant barrier to effective pain management. However, available assessment tools lack consistent reliability as pain measures in children with cognitive impairment (CI). This study evaluated the validity and reliability of the revised and individualized Face Legs Activity Cry and Consolability (FLACC) behavioral pain assessment tool in children with CI. Methods: Children with CI scheduled for elective surgery were studied. The FLACC was revised to include specific descriptors and parent-identified, unique behaviors for individual children. The child's ability to self-report pain was evaluated. Postoperatively, two nurses scored pain using the revised FLACC scale before and after analgesic administration, and, children self-reported a pain score, if able. Observations were videotaped and later viewed by experienced nurses blinded to analgesic administration. Results: Eighty observations were recorded in 52 children aged 4-19 years. Twenty-one parents added individualized pain behaviors to the revised FLACC. Interrater reliability was supported by excellent intraclass correlation coefficients (ICC, ranging from 0.76 to 0.90) and adequate j statistics (0.44-0.57). Criterion validity was supported by the correlations between FLACC, parent, and child scores (q ¼ 0.65-0.87; P < 0.001). Construct validity was demonstrated by the decrease in FLACC scores following analgesic administration (6.1 ± 2.6 vs 1.9 ± 2.7; P < 0.001). Conclusions: Findings support the reliability and validity of the FLACC as a measure of pain in children with CI.
The Pain Disability Questionnaire: a reliability and validity study
Revista Latino-Americana de Enfermagem, 2012
The goal of this study was to translate and adapt The Pain Disability Questionnaire (PDQ) to Brazilian Portuguese, as well as to assess its psychometric properties and practicability. The following methodological steps were followed: translation, synthesis, back-translation, expert committee assessment and pre-test. The psychometric properties were assessed through the application of a questionnaire to 119 patients with chronic musculoskeletal disorders. The results indicated the reliability of the instrument, with a Cronbach's alpha coefficient of 0.86, and high stability in the test-retest. A moderate correlation was found between the PDQ scores and the numerical pain scale. Negative correlations were found between the Spitzer Quality of Life Index and the functional condition, psychosocial component and total PDQ score. Construct validity demonstrated significant difference in PDQ scores between symptomatic and asymptomatic individuals. The PDQ revealed fast application and easy understanding. The results indicated a successful cultural adaptation and reliable psychometric properties. O objetivo deste estudo foi traduzir e adaptar The Pain Disability Questionnaire (PDQ) para o português do Brasil, avaliar suas propriedades psicométricas e praticabilidade. Os seguintes passos metodológicos foram seguidos: tradução, síntese, retrotradução, avaliação por comitê de especialistas e pré-teste. As propriedades psicométricas foram avaliadas pela aplicação do questionário a 119 pacientes com lesões musculoesqueléticas crônicas. Os resultados indicaram a confiabilidade do instrumento com o coeficiente alfa de Cronbach de 0,86, e alta estabilidade na aplicação do teste-reteste. Uma correlação moderada foi encontrada entre os escores do PDQ e a escala numérica de dor. Correlações negativas foram encontradas entre o Spitzer Quality of Life Index e a condição funcional, componente psicossocial e escore total do PDQ. A validade de construto demonstrou diferença significativa nos escores do PDQ entre indivíduos sintomáticos e assintomáticos. O PDQ mostrou aplicação rápida e fácil entendimento. Os resultados indicaram sucesso na adaptação cultural e propriedades psicométricas confiáveis. El objetivo de este estudio fue traducir y adaptar el Cuestionario The Pain Disability Questionnaire (PDQ) para el portugués de Brasil, evaluando sus propiedades psicométricas y la usabilidad. Fueron seguidos los siguientes pasos metodológicos: traducción, síntesis, retrotraducción, evaluación por un comité de expertos y realización de una prueba piloto.
An interrater reliability study of the Braden scale in two nursing homes
International journal of nursing studies, 2008
Background: Adequate risk assessment is essential in pressure ulcer prevention. Assessment scales were designed to support practitioners in identifying persons at pressure ulcer risk. The Braden scale is one of the most extensively studied risk assessment instruments, although the majority of studies focused on validity rather than reliability. Objectives: The first aim was to measure the interrater reliability of the Braden scale and its individual items. The second aim was to study different statistical approaches regarding interrater reliability estimation. Design and methods: An interrater reliability study was conducted in two German nursing homes. Residents (n = 152) from 8 units were assessed twice. The raters were trained nurses with a work experience ranging from 0.5 to 30 years. Data were analysed using an overall percentage of agreement, weighted and unweighted kappa and the intraclass correlation coefficient. Results: Differences between nurses rating the overall Braden score ranged from 0 up to 9 points. Interrater reliability expressed by the intraclass correlation coefficient ranged from 0.73 (95% CI 0.26-0.91) to 0.95 (95% CI 0.87-0.98). Calculated intraclass correlation coefficients for individual items ranged from 0.06 (95% CI À0.31 to 0.48) to 0.97 (95% CI 0.93-0.99) with the lowest values being measured for the items ''sensory perception'' and ''nutrition''. There was no association between work experience and the level of interrater reliability. With two exceptions, simple kappa-values were always lower than weighted kappa-values and intraclass correlation coefficients. Conclusions: Although the calculated interrater reliability coefficients for the total Braden score were high in some cases, several clinically relevant differences occurred between the nurses. Due to interrater reliability being very low for the items ''sensory perception'' and ''nutrition'', it is doubtful if their assessment contributes to any valid results. The calculation of weighted kappa or intraclass correlation coefficients is the most appropriate interrater reliability estimates.