A Preliminary Analysis of the June 2003 New York State Regents Examination In Physics (original) (raw)
Related papers
Physical Review Special Topics-physics Education Research, 2009
We report the results of an analysis of the Texas Assessment of Knowledge and Skills (TAKS) designed to determine whether the TAKS is a valid indicator of whether students know and can do physics at the level necessary for success in future coursework, STEM careers, and life in a technological society. We categorized science items from the 2003 and 2004 10th and 11th grade TAKS by content area(s) covered, knowledge and skills required to select the correct answer, and overall quality. We also analyzed a 5000 student sample of item-level results from the 2004 11th grade exam, performing full-information factor analysis, calculating classical test indices, and determining each item's response curve using item response theory. Triangulation of our results revealed strengths and weaknesses of the different methods of analysis. The TAKS was found to be only weakly indicative of physics preparation and we make recommendations for increasing the validity of standardized physics testing.
Multiple roles of assessment in upper-division physics course reforms
The University of Colorado at Boulder has been involved in a systematic program of upper-division undergraduate course transformations. The role of assessment has been critical at multiple, interconnected scales: (1) formative evaluation focused on the course itself in the design phase; (2) formative assessment focused on students in the instructional phase and (3) summative assessment to determine student performance and the success of course design. We summarize the role and nature of assessments at each of these levels. At the design scale, investigative measures include observations and surveys of students and student work. In the classroom, assessments to determine and address student difficulties include clicker questions and tutorials. At the summative scale, assessments include faculty interviews and course and tutorial-scale posttests. We discuss examples, affordances, outcomes, and challenges associated with these different layers of assessments at the upper-division level.
Comparative Analysis of Physics Items in 6TH Grade National Evaluation Tests
2020
The aim of the current research is to determine the internal structure of the Physics items present in the 6th grade Romanian National Evaluation Tests. The study also focuses on the efficiency of the Physics item group in the evaluation of logical-scientific thinking competence which represents the construct evaluated by these tests. The analysis of the items includes the 2016–2019 tests. The inclusion of the items at the different levels of the construct scale measured by each test is statistically supported by the Categorical Principal Components Analysis and the "Wright Map" tools. The items calibration is performed within the framework of the Item Response Theory. The results show that the items have content validity and have a high discriminatory power. The small number of Physics items in the National Evaluation Tests, as well as the fact that the internal structure of these items is almost identical in all the tests applied over the four years covered by the analys...
2014 Physics Education Research Conference Proceedings, 2015
This preliminary study explored the relationship among several school-level accountability measures and student physics and chemistry performance in New York City public schools. The NYC Department of Education prepared a three-year Quality Review and annual Progress Report for each high school in the district, assigning grades to assess overall school quality. Both scores were based upon a number of factors about the school including student progress in all subject areas, college and career readiness, attendance, and graduation rates. These scores presented consequential validity in the form of reputation and school desirability for students and their families. Concurrently, the New York State Education Department published annual student performance data on high-stakes Regents examinations in several content areas, including the physical sciences (physics, chemistry). Statistical relationships among these variables were explored to determine whether Quality Review and Progress Report scores and sub-scores were correlated to student performance in the physical sciences. Data showed that physics performance was not related to overall school quality but positively correlated to college and career readiness; chemistry was related to all of these measures. From a policy perspective, such school assessment measures have implications for the value placed upon physics education in urban secondary schools.
Journal of Physics: Conference Series, 2019
The National Examination is for measuring the success rate of student learning at school and mapping the quality of Education in Indonesia. To fulfill the objectives of the National Examination, an instrument is needed to represent the standards set by the Indonesian government. This research is a qualitative study that aims to analyze National Examination Questions in 2017/2018 based on Bloom’s taxonomy and National Examination Questions Standard. Data collected by analyzing the samples National Examination questions in 2017/2018 using operational verbs in Bloom’s taxonomy and grouping topics based the standard. Based on the research, it was found that most question is in the applying cognitive domain (C3), that is, 35 %, when the least question is in the creating cognitive domain (C6), that is, only 2.5%. According to the National Examination Questions Standard, the most topic in the National Examination in 2017/2018 are “Force and Motion” and “Electric, Magnet and Modern Physics”...
2019 Physics Education Research Conference Proceedings, 2020
This study reports the development, validation, and implementation of a practical exam to assess science practices in an introductory physics laboratory. The exam asks students to design and conduct an investigation, perform data analysis, and write an argument. The exam was validated with advanced physics undergraduate students and undergraduate students in introductory physics lecture courses. Face validity has been established by administering the practical in 65 laboratory sections over the course of three semesters. We found that the greatest source of variability in this exam was due to instructor grading issues and discuss the implications of this result for our ongoing assessment efforts.
The use of concept tests and peer instruction in upper-division physics
2010
Many upper-division courses at the University of Colorado now regularly use peer instruction in the form of clicker questions during lectures. Particular attention has been paid to developing and implementing clicker questions in junior-level E&M and Quantum mechanics. These transformed classes largely follow traditional local norms of syllabus and content coverage, but are designed to address broader learning goals (e.g developing math-physics connections) that our faculty expect from physics majors in these courses. Concept-tests are designed to align with these goals, and have altered the dynamic of our classes. Coupled with other course transformations, we find measurable improvement in student performance on targeted conceptual post-tests. Here, we discuss classroom logistics of upper-division clickers, purposes of clicker questions, aspects of student engagement facilitated by concept-tests, and observations of and challenges to sustainability of this activity.
Student performance in first-year physics: does high school matter?
At The University of Sydney, approximately one in four first-year physics students have not studied senior high school physics. Previous studies have concluded that taking a high school physics course has a positive effect on student performance in undergraduate physics. To our knowledge, no study has examined whether students who do not study senior high school physics are negatively affected when integrated into a first-year physics class with students who have studied senior high school physics. An educational context was found in which such a study could be performed. Thus, we investigate the consequences of integrating students with different high school physics backgrounds into the same undergraduate physics stream. The sample consisted of 233 first-year physics students. Of these, 109 had studied senior high school physics, while 124 students had not. We investigated the examination performance of matched groups at senior high school and at university. When both groups were integrated into the same Semester 2 physics stream, known as Environmental and Life Science, there was no statistically significant difference in the Environmental and Life Science raw examination marks for two of the three matched groups (p = 0.421, p = 0.157), and a borderline significant difference for the third matched group (p = 0.049). We conclude that students with no background in senior high school physics are generally not disadvantaged in the Environmental and Life Science physics course, when compared with students who have studied high school physics.