Improving Assessment Validity for Students With Disabilities in Large-Scale Assessment Programs (original) (raw)
Related papers
Accounting for the Performance of Students With Disabilities on Statewide Assessments
The Journal of Special Education, 2005
The current study investigates school-level factors that affect the performance of students with disabilities on statewide assessments. Data were collected as part of a larger study examining the effects of education policy reform on students with disabilities. Statewide assessment data for students with disabilities from 2 school districts within 1 state were analyzed. Assessment results in reading and math in 3rd, 5th, and 8th grades across 2 school years were analyzed using a series of hierarchical linear regressions. Of the variables considered, only the performance of schools' general education students on the assessments added any predictive value to the regression model after accounting for school demographic indicators.
Journal of School Psychology, 2001
As a result of changes to the Individuals with Disabilities Education Act (IDEA) in 1997, all students with disabilities are expected to participate in state and district assessment systems for accountability. To fulfill this participation mandate, individualized testing accommodations are permitted. This investigation focused on the use and effects of testing accommodations on the scores of students with disabilities on challenging mathematics and science performance assessment tasks. The major objectives of the investigation were to (a) document the testing accommodations educators actually use when assessing students with performance assessment tasks, and (b) examine the effect that accommodations have on test results. Both descriptive and experimental methods were used to analyze data. Individual cases of students with disabilities represent the strength and uniqueness of this research. The predominant research design in this investigation is a between-series design featuring an alternating treatment design element. This data collection and analysis plan guided our work with 100 fourth graders, of whom 41 were students with disabilities. The results of the investigation indicated that slightly more than 75% of the testing accommodation packages that were suggested by students' individual education plan teams had a moderate to large effect on their test scores. It was also found that testing accommodations, to a lesser extent, had a positive effect on the test scores of students without disabilities. For a small percentage of students, the effects of suggested accommodations were not positive. These results are discussed in terms of validity and accountability issues for large-scale assessment programs. This article focuses on the development, use, and effect of testing accommodations on the scores of students with disabilities on mathematics and science performance assessment tasks similar to those found on statewide achievement tests. The major objectives of the investigation were to (a)
Creative Education
Performance-based assessment (PBA) is different from traditional testing methods in that PBA presents real-life problems for students to solve by integrating critical thinking with their content knowledge and skills. Implementing PBA regularly in mathematics classes is associated with improved student achievement and motivation to learn; however, there are concerns about the general lack of psychometric data to support the use of performance assessments. To address such concerns, this study applied item response theory to estimate the difficulty and discrimination indices of items that comprised a newly developed mathematics PBA. Data were collected by administering the PBA to 750 senior high school students in the Western Region of Ghana. The results indicated that the difficulty and discrimination levels of each item were satisfactory, which suggests that well-designed and properly vetted math PBA items would improve classroom assessments as well as high-stakes tests administered on a large scale. Additional recommendations are included at the end of this paper.
Focus on Exceptional Children
One of the most significant challenges facing policy makers in education today is to ensure that state assessments designed to measure student performance across specified grade-level curriculum content standards will allow all students to demonstrate what they have learned. This challenge is made complex by the varied attributes of students with disabilities and the curriculum these students receive. For the diverse population of students with high-incidence disabilities, statewide assessments remain largely undifferentiated based on their needs or capacity. Accommodations, while of value, focus on test-taking behaviors (e.g., use of calculators) and practices (e.g., more time), but do not address curriculum alignment or item design to measure standards-based performance. Thus, the authors suggest the adoption of Computerized Adaptive Testing (CAT) to accommodate students with special needs. In this article, the authors describe how CAT works and cite its advantages. (Contains 2 fi...
Achievement vs Proficiency: Construction of Math Proficiency Assessment Using Item Response Theory
2014
2 Abstract: Assessment is a systematic process that begins with identification of objectives and ends with a judgment concerning the extent to which those objectives have been attained. Achievement assessment means assessment of what has been taught or studied within the modules. Proficiency assessment is an exercise the purpose of which is to evaluate the background of a person in a given branch of knowledge with or without regard to specific academic. There is distinction between proficiency test and achievement test. One measures a student's ability to use something and the other measures a student's knowledge or at least recall. The most important reason to select IRT is that IRT can be gainfully applied: estimating examinee ability, generalizability of test result, various item analyses, test and item scaling, and it provides a way of giving meaningful score interpretations relating students' performance to the underlying skills being measured. Total 2680 students w...
4. THE ACADEMIC PERFORMANCE OF SECONDARY SCHOOL STUDENTS WITH DISABILITIES
There is no question that much is expected from our education system in terms of preparing future citizens, workers, and leaders. To that end, schools are expected to influence students' learning, socialization, and even vocational preparedness. This agenda is perhaps even more keenly applied for students with disabilities than for those in the general population. Indeed, NLTS2's conceptual framework reflects this comprehensive view of educationally relevant inputs and achievements both in and outside of school. Despite the attention paid to a broad definition of outcomes, however, academic performance remains central. Academic instruction is arguably the primary business of education, and it was poor performance that spawned the recent era of reform after the publication of A Nation at Risk two decades ago (U. S. Department of Education, 1983). Further, it is academic performance that is central to the efforts of the No Child Left Behind Act of 2001 to make schools and school districts accountable for assessing and improving student performance annually (Linn, Baker, & Betebenner, 2002). Further, limitations in academic achievement represent the primary implication of disability for most students receiving special education services, and those limitations, if left unaddressed, constrain their ability to pursue postsecondary education and well-paid employment after high school. Although the importance of academic achievement is rarely questioned, reaching unanimity regarding its measurement has been elusive. The measurement of academic performance, particularly for students with disabilities, continues to be a controversial topic among policy-makers, measurement experts, and performance can occur at multiple levels and serves multiple purposes. For example, classroom teachers often conduct formative and summative tests to evaluate student mastery of course content and provide grades for students and parents. State tests are designed primarily to measure progress at the school or school district level. In particular, graduation tests are used to determine whether a student has mastered the minimum content and competencies required to receive a high school diploma. Each of these kinds of assessments engenders significant questions related to test design, types of decisions supported by the results, alternative assessments, and accommodations (Heubert & Hauser, 1999; Minnema, Thurlow, Bielinski, & Scott, 2001). Although this is a time of change in the educational arena, within this evolving accountability environment, it is crucial to understand the progress of all students, including those with disabilities, and the factors that contribute to their positive academic performance. NLTS2 is in a unique position to provide a national perspective on these issues. This chapter presents both descriptive findings and multivariate analyses of multiple measures of academic performance. It also compares results of the multivariate analyses with those achieved in similar analyses as part of the original NLTS.