Reliability and Validity of the Self-Assessment of Occupational Functioning (original) (raw)
Related papers
Reliability and validity of a measure of role functioning among people with psychiatric disabilities
Australian Occupational Therapy Journal, 2011
Scale , an instrument designed to help mental health professionals tailor mental health care to reduce employment restrictions. Methods: Sixty community residents with schizophrenia or schizoaffective disorder were recruited from a register of previous research participants in an existing genetics study of people with schizophrenia. The WSE-38 was administered via telephone interview, repeated two-five days later. Short-cycle test-retest reliability, internal structure, and concurrent validity were assessed. Face validity, utility, consumer and clinician acceptability were examined qualitatively. Findings: Short cycle test-retest reliability for most items and the total score were found to be good to very good. Items with low reliability were removed. Concurrent validity was promising with respect to a range of relevant measures. Face validity, client acceptability, and user utility were adequate. Further scale development and modifications to administration instructions are indicated. Conclusions: These results support further scale development and inform how it can be used for its intended purpose. Sensitivity to real change and predictive validity require ongoing investigation. Keywords:n psychiatricdisabilitiesn psychoticdisordersn schizophrenian severementalillness n supportedemploymentn vocationalrehabilitation
Rehabilitation Counseling Bulletin, 2020
The 12-item World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) has been used to assess functional impairments in various disability populations and has been shown to be applicable to the youth population. The purpose of the study was to evaluate the psychometric properties of the World Health Organization Disability Assessment Schedule II-Youth Version (WHODAS-Y). Results of the study revealed a two-factor solution, including the socio-cognitive index and self-care index. The WHODAS-Y measurement appears to be a reliable and valid measure of function impairment in transition-aged youth with disabilities in a community setting. This assessment tool can be integrated in vocational rehabilitation practices and guide rehabilitation counselors in identifying needs and facilitators related to education and employment-related services, as well as understanding health care needs in youth with disabilities.
Unique issues in assessing work function among individuals with psychiatric disabilities
Journal of occupational rehabilitation, 2001
With the admission of people who experience psychiatric disabilities in the state-federal vocational rehabilitation system and the Social Security disability rolls in the 1960s, assessment of their capacity to work has been a major concern. Given the rising rates of claims for psychiatric disability in both the public and the private sectors, and the disappointing employment outcomes of people with psychiatric disabilities compared to those with other disabilities, there have been numerous initiatives to accurately assess their employment potential. Historically, such assessment within the Social Security Administration has relied upon evaluation of a person's medical impairment, but numerous studies suggest a weak relationship between measures of psychiatric diagnosis or symptoms and work outcome. Efforts have been undertaken to identify valid and reliable methods of assessing the ability of people with psychiatric disabilities to work. The authors review (a) methods of assessi...
A Review of Occupation and Impairment Based Assessments Used in Occupational Therapy
2017
Objective: The objective of this paper was to analyze the psychometrics, efficacy, and usefulness of assessments to measure occupational performance and occupation-based outcomes. Methodology: Eight Doctor of Occupational Therapy Students at Nova Southeastern University, along with their professor, analyzed and appraised 46 commonly used assessments to discover and explore the assessments’ purposes, theory-bases, psychometric properties, and usefulness as outcome measures. Results: We found that many high quality assessments exist and meet the standards for validity and reliability. Although some assessments are client-centered and useful, some still require additional research to strengthen their psychometric properties. Conclusion: Some widely used assessments are better for assessing occupation-based outcomes while others are better for assessing specific client factors. Despite their lack of psychometric information, some of the assessments we analyzed may still be useful in pra...
Reliability of a scale of work-related self-efficacy for people with psychiatric disabilities
International Journal of Rehabilitation Research, 2009
Work-related self-efficacy at a core task level fits with the social cognitive career theory explaining the career development of people with severe mental illness. The aim of this study was to further investigate the psychometric properties of the 'Work-related Self-Efficacy Scale' for use with people with psychiatric disabilities. Sixty individuals with schizophrenia or schizoaffective disorder participated in repeated telephone interviews conducted 2-5 days apart. Short-cycle test-retest reliability and internal structure were assessed. Face validity, consumer and clinician acceptability and utility were examined qualitatively. Short-cycle test-retest reliability was found to be very good at item and total score levels. The internal structure was consistent with previous investigations. Although face validity, acceptability and utility were adequate, use of face-to-face interviews is preferred over telephone interviews. The construct validity evidence supports wider use for research purposes in community mental health service, supported employment and other psychiatric rehabilitation settings.
Construct validity: A unitary concept for occupational therapy assessment and measurement
Hong Kong Journal of Occupational Therapy, 2010
Background: In the traditional view of validity, it is divided it into three sub-types: content, criterionrelated, and construct. Validity has recently been reconceptualized as a unitary factor known as construct validity. Five sources of construct validity evidence have been specified: test content, response processes, internal structure, relationships to other variables, and consequential aspects of construct validity. They function either as general validity criteria or as standards for all assessment and measurement. Purpose: The purpose of the manuscript is to present an overview of the contemporary conceptualization of construct validity and its relevance to occupational therapy practice, education, and research. Key Issues & Implications: Taken together, the five components of construct validity evidence provide a way of addressing the multiple and interrelated validity questions that need to be answered in order to justify occupational therapy test score interpretation and use by practitioners. Given the context of evidence-based practice, professional standards of practice, increasing calls for accountability, and the fact that validity of a test, instrument, or scale is now seen as being a dynamic process, it is important for occupational therapists to be conversant with this contemporary view of construct validity, and the body of validity evidence related to the assessment tools used in clinical practice.
The reliability of an education-related self-efficacy scale for people with psychiatric disabilities
Community Mental Health Journal
We investigated the reliability of the Education-related Self Efficacy Scale (ESS-40), a measure of self-efficacy at a core task level designed for people with psychiatric disabilities. Sixty community residents with schizophrenia or schizoaffective disorder participated. The ESS-40 was administered twice via telephone interview. Short cycle test-retest reliability was very good for the total score and most items. The measure demonstrated signs of a coherent internal structure, adequate face validity, good client acceptability, and promising utility. The reliability evidence supports its use in community mental health services and in psychiatric rehabilitation settings. Sensitivity and predictive validity require further investigation.
Work-ability assessment in young adults with disabilities applying for disability benefits
Disability and Rehabilitation, 2012
To investigate the impact of diagnosis, co-morbidity, secondary conditions (e.g. learning problems, subclinical mental and somatic complaints, addictions, and socio-emotional and behavioral problems) and problems in social context on work ability as assessed by Insurance Physicians (IPs) in young adults applying for a disability benefit. Method: IPs of the Social Security Institute assessed young adults with disabilities (aged 15-27) applying for a disability benefit (n = 1755). Data were analyzed with multilevel ordinal regression techniques. Results: Primary diagnosis, co-morbidity and subclinical mental complaints were associated with IP-assessed work ability. Persons with mental health conditions as primary diagnosis were less likely to reach a higher work ability than persons with somatic diseases. Young adults with two or more comorbid conditions and those with psychiatric or developmental co-morbidity were less likely to reach a higher work ability level than persons without co-morbidity. Young adults with subclinical mental complaints were half as likely to reach a higher IP-assessed work ability than young adults without this condition. Conclusion: Primary diagnosis, type and number of co-morbid conditions and subclinical mental complaints are associated with IP-assessed work ability. Work-ability assessments among adolescents with disabilities applying for disability benefits still focus mainly on medical factors.
2010
Background People with rheumatic or neurologic conditions are commonly referred for occupational therapy because of decreased ability to perform ADL tasks. Upon referral, occupational therapists use a client-centred, occupationfocused approach when evaluating a person's perceived and observed quality of ADL task performance to clarify the nature and extent of the person's problems, plan interventions and determine effectiveness of interventions. Evaluation of the extent of problems and change following intervention require the use of linear measures of ADL. The aim of this doctoral thesis was to develop and validate linear measures of perceived and observed quality of ADL task performance for occupational therapy clinical praxis and research. Methods To develop linear measures of observed quality of ADL task performance based on Rasch measurement methods, clients with ABI (n=70) were evaluated using a 3-category rating scale and the ADL Taxonomy. Similarly, to develop linear measures of perceived quality of ADL task performance women with rheumatic diseases (n=118) reported their ability on a questionnaire and in an interview based on the ADL Taxonomy and a 4category rating scale. To further validate the ADL ability measures of the Assessment of Motor and Process Skills (AMPS) data were collected in two samples. In a sample of women with chronic widespread pain (CWP) or fibromyalgia (FM) (n=50) the ADL ability measures were validated with regard to discrimination, stability and sensitivity to changes. Discrimination was examined by comparing AMPS data from women with CWP/FM to those of healthy women. Stability and sensitivity to change were examined based on repeated AMPS observations pre and post intervention. In addition, sensitivity to change was examined in a sample of clients with ABI (n=36) using a pre-and post-test design. Finally, the validity of the AMPS ADL ability measures in relation to perceived ADL ability was examined in women with rheumatic diseases (n=118) and women with CWP/FM (n=50). Results Based on the results of the four studies in this thesis, we were able to conclude that it was possible to obtain linear measures of observed quality of ADL task performance based on a revised version of the ADL Taxonomy (ADL-O). It was also possible to obtain linear measures of perceived quality of ADL task performance based on revised versions of the ADL Taxonomy using the formats of questionnaires (ADL-Q) and interviews (ADL-I). Moreover, it was possible to establish further evidence of validity of the ADL ability measures of the AMPS. Thus, the AMPS ADL ability measures could discriminate between women with CWP/FM and healthy women. The ADL ability measures of remained stable when no intervention was provided and the ADL motor ability measures were sensitive to change among women with CWP/FM. Moreover, the ADL ability measures were sensitive to change among clients with low ADL ability following ABI. Finally, only low to moderate correlations were found between measures of perceived and observed ADL ability. Conclusions Rasch analyses of revised versions of the ADL Taxonomy suggest that the majority of the ADL tasks and rating scales focused on quality of ADL task performance can be used to obtain linear measures of quality of ADL task performance based on methods of questionnaire, interview or observation. Furthermore, the studies provided evidence of validity of the ADL ability measures of the AMPS in relation to discrimination, stability and sensitivity to change and relation to perceived ADL ability. The results may, therefore, enhance the use of ADL instruments that provide linear measures of perceived and observed quality of ADL task performance in occupational therapy clinical praxis and research.