Using TIMSS and PISA results to inform educational policy: a study of Russia and its neighbours (original) (raw)
Related papers
SSRN Electronic Journal, 2000
In this paper, we develop a multi-level comparative approach to analyse Trends in International Mathematics and Science Survey (TIMSS) and Programme of International Student Achievement (PISA) mathematics results for a country, Russia, where the two tests provide contradictory information about students' relative performance. Russian students do relatively well on the TIMSS mathematics test but relatively poorly on the PISA. We compare the performance of Russian students with different levels of family academic resources over the past decade on these tests compared to students with similar family resources in Russia's neighbours and to Russian students studying in Latvian and Estonian Russian-medium schools. These comparisons and interviews with educators in Latvia and Estonia help us understand why students in Russia may perform lower on the PISA and to draw education policy lessons for improving international test performance generally and Russian students' PISA mathematics performance specifically.
In this paper, we try to unravel some of the unintended and intended academic effects associated with post-Soviet educational reforms by focusing on three cases: Estonia, Latvia and Russia. We have chosen this comparison because a unique ‘natural experiment’ in the three countries allows us to compare the changing academic performance on an international test of a largely similar population in the three countries—Russian origin students attending Russian-medium schools—subjected to three variations of post-Soviet reforms. We find that relative to students in Russia, Russian-medium students in the Baltics made significant gains in the Programme for International Student Assessment (PISA) test. In Latvia, these appear to be an unintended effect of somewhat ‘softened’ state language policies, the conditions surrounding minority rights, and the general context of maintaining social cohesion. In Estonia, the (later) relative gains of Russian students appear to an intended effect of locally grown educational (and language) policies and increased, more effective cooperation with Russian medium schools to further improve PISA performance in a relatively high scoring, PISA-focused country.
A comparison of PISA and TIMSS 2003 achievement results in mathematics
This study compares the Programme for International Student Assessment (PISA) 2003 Mathematics results with the Trends in International Mathematics and Science Study (TIMSS) 2003 Grade 8 mathematics results, using country mean scores for 22 participants of both studies. It is found that Western countries generally performed better in PISA than in TIMSS, and Eastern European and Asian countries generally performed better in TIMSS than in PISA. Furthermore, two factors, content balance and years of schooling, can account for 93% of the variation between the differential performance of countries in PISA and TIMSS. Consequently, the rankings of countries in the two studies can be reconciled to a reasonable degree of accuracy.
Comparing the PISA 2012 achievements of Turkey and Israel in Mathematics and science has been an intriguing challenge. Israel was one of the first 12 countries taking part in the first International Mathematics assessment: The TIMSS 1963/4; it had the best achievements both in grade 4 and 8 (ibid). Turkey started participating in International evaluations only in 1999. Since the 1963/4 first international examinations, the Israeli situation has changed substantially by the 80ies, and not in any desirable direction. Turkey, on the other hand, has demonstrated a gradual, constant improvement in the PISA achievements – both in mathematics and science. In this study a brief comparison between these two countries will be presented regarding the achievement in the first decade of the 21st century. This article consists of three main parts: Why comparing Israel and Turkey?, Achievements comparisons between Israel and Turkey, and Why are the Israeli PISA 2012 results actually lower than reported.
Social Forces, 2019
S ociologists have argued that high-stakes tests open the door to high levels of educational inequality at transition points: in a high-stakes testing regime, parents and students are able to focus all energy and resources on test preparation, thus enhancing pre-existing inequalities in academic performance. But arguments about a special role for high-stakes tests are often prosecuted without explicit comparisons to other types of tests and assessments, usually because information on other tests is not available. In this article, we analyze a unique dataset on a contemporary cohort of Russian students, for whom we have PISA and TIMSS scores, low-stakes test scores, and high-stakes test scores. We compare the role each test plays in mediating socioeconomic background inequalities at the important transitions in the Russian educational system: the transition to upper secondary education and the transition to university. We find evidence in favor of a special role for the high-stakes test at the transition to university, but we also find evidence that gives cause to question the standard assumption that high-stakes tests should be a primary focus for those concerned about inequality of educational opportunity.
Voprosy obrazovaniya / Educational Studies Moscow
Dynamics of academic performance of Russian school students depending on cultural capital and the size of community is analyzed using PISA and TIMSS data. In order to reveal tendencies in TIMSS and PISA scores dynamics ten educational experts were interviewed. The last 15 years have witnessed a slight improvement in performance of Russian school students and a drop in social and territorial inequality. These changes do not affect all subject areas and result from educational attainment improvements in small populated localities and social groups of low cultural capital. Meanwhile, no growth has been observed in the scores of students with higher levels of cultural capital. The interviews shed light on possible changes in the education system associated with the dynamics of school students' educational attainment.
Assessment in Education: Principles, Policy & Practice, 2016
Is it possible to compare the results in assessments of mathematics across countries with different curricula, traditions and age of starting school? As part of the iPIPS project, a Russian version of the iPIPS baseline assessment was developed and trial data were available from about 300 Russian children at the start and end of their first year at school. These were matched with parallel data from representative samples of equal numbers of children from England and Scotland. The equating of the scales was explored using Rasch measurement. A unified scale was easiest to create for England and Scotland at the start and end of their first year at school when children only differ by a half a year in age, and live in adjacent countries with a common language. Although fewer items showed invariance across the three countries, it was possible to link iPIPS scores in mathematics from the start and end of the first year at school across Scotland, England and Russia. The findings of this study suggest that, despite the apparent difficulties, meaningful comparisons of mathematics attainment and development can be made. These will allow for substantive interpretations with policy implications.