Performance-Based Evaluation of CMIP5 and CMIP6 Global Climate Models and Their Multi-Model Ensembles to Simulate and Project Seasonal and Annual Climate Variables in the Chungcheong Region of South Korea (original) (raw)
Related papers
Performance evaluation and ranking of CMIP6 global climate models over Vietnam
Journal of Water and Climate Change
This study comprehensively assesses the performance of 29 Coupled Model Intercomparison Project Phase 6 (CMIP6) Global Climate Models (GCMs) and their ensemble mean (ENS_MEAN) over Vietnam. The spatiotemporal variability of near-surface temperature and precipitation is thoroughly evaluated for the 30-year historical period of 1985–2014. Results show that the models can reasonably reproduce the observational annual cycles and spatial distribution of temperature and precipitation, though their performances vary across the seven climatic sub-regions of Vietnam. Due to their coarse resolutions, the models produce warm biases over certain highland and mountainous areas, and many of them cannot reproduce the rainy season shift from summer in most sub-regions toward the end of the year in Central Vietnam. Finally, these results are summarized, and a performance score is assigned to each model, inferring a ranking. The top three models are EC-Earth3-Veg, EC-Earth3, and HadGEM3-GC31-MM. Alth...
Projected extreme climate indices in the java island using cmip5 models
IOP Conference Series: Earth and Environmental Science, 2019
Climate change has brought great environmental impacts that cause economic disruption as it causes extreme climate phenomena such as floods and droughts. The projection of precipitation and temperature is crucial to develop the adaptation and mitigation options, as well as to improve the operational strategies in various sectors. This study used Coupled Model Intercomparison Project Phase 5 (CMIP5) that consists of 29 GCMs to make the projection of precipitation and temperature (2011–2100), along with daily observational data from 16 stations over the Java island for 20 years (1986–2005) to evaluate the models. Spatial and temporal correlation method was used to evaluate the climate models and 5 GCMs with the best performance were selected to project the precipitation and temperature. A bias correction method called Simple Quantile Mapping (SQM) was used to adjust the climate models to better represent the observational data. Representative Concentration Pathway (RCP)4.5 dan RCP8.5 ...
A Projection of Extreme Precipitation Based on a Selection of CMIP5 GCMs over North Korea
Sustainability, 2019
The numerous choices between climate change scenarios makes decision-making difficult for the assessment of climate change impacts. Previous studies have used climate models to compare performance in terms of simulating observed climates or preserving model variability among scenarios. In this study, the Katsavounidis-Kuo-Zhang algorithm was applied to select representative climate change scenarios (RCCS) that preserve the variability among all climate change scenarios (CCS). The performance of multi-model ensemble of RCCS was evaluated for reference and future climates. It was found that RCCS was well suited for observations and multi model ensemble of all CCS. Using the RCCS under RCP (Representative Concentration Pathway) 8.5, the future extreme precipitation was projected. As a result, the magnitude and frequency of extreme precipitation increased towards the farther future. Especially, extreme precipitation (daily maximum precipitation of 20-year return-period) during 2070-2099...
KSCE Journal of Civil Engineering, 2020
Although many studies have sought to characterize future meteorological droughts, a few efforts have been done for quantifying the uncertainty, inter-model variability, arises from global circulation models (GCM) ensemble. A clear understanding of the uncertainty in multiple GCMs should be preceded before future meteorological droughts are projected. Therefore, this study evaluates the uncertainty in future meteorological drought characteristics that are induced by GCM ensemble using the custom measure "the degree of GCM spreading". Future meteorological drought indices, the standardized precipitation index (SPI) and standardized precipitation evapotranspiration index (SPEI), were computed to five different time scales: 3, 6, 9, 12 and 24 months using statistically downscaled 28 GCMs under Representative Concentration Pathway (RCP) 4.5 and 8.5 at 60 weather stations in South Korea. The frequency, duration, and severity of drought events were estimated for three different future periods; F1 (2010 − 2039), F2 (2040 − 2069), and F3 (2070 − 2099). It was found that the uncertainty increases as the time scale lengthens regardless of a choice of drought indices or RCP scenarios. It also turned out that the SPI exhibits larger uncertainty rather than the SPEI, because temperature data exhibit a relatively much smaller variability comparing to precipitation data. Moreover, there was a shift of regions having larger values of the increasing rate between F1 and F2, which is shift from the northwestern to southern region of South Korea.
Advances in Meteorology
Climate change may accelerate the water cycle at a global scale, resulting in more frequent extreme climate events. This study analyzed changes in extreme precipitation events employing climate projections statistically downscaled at a station-space scale in South Korea. Among the CMIP5 climate projections, based on spatial resolution, this study selected 26 climate projections that provide daily precipitation under the representative concentration pathway (RCP) 4.5. The results show that a 20-year return period of precipitation event during a reference period (1980∼2005) corresponds to a 16.6 yr for 2011 to 2040, 14.1 yr for 2041 to 2070, and 12.8 yr for 2071 to 2100, indicating more frequent extreme maximum daily precipitation may occur in the future. In addition, we found that the probability density functions of the future periods are located out of the 10% confidence interval of the PDF for the reference period. The result indicates that the design standard under the reference ...
Scientific reports, 2024
Selecting the best region-specific climate models is a precursor information for quantifying the climate change impact studies on hydraulic/hydrological projects and extreme heat events. A crucial step in lowering GCMs simulation-related uncertainty is identifying skilled GCMs based on their ranking. This research performed a critical assessment of 30 general circulation models (GCMs) from CMIP6 (IPCC's sixth assessment report) for maximum and minimum temperature over Indian subcontinent. The daily temperature data from 1965 to 2014 were considered to quantify maximum and minimum temperatures using a gridded spatial resolution of 1°. The Nash-Sutcliffe efficiency (NSE), correlation coefficient (CC), Perkins skill score (PSS), normalized root mean square error (NRMSE), and absolute normalized mean bias error (ANMBE) were employed as performance indicators for two different scenarios, S1 and S2. The entropy approach was used to allocate weights to each performance indicator for relative ranking. Individual ranking at each grid was achieved using a multicriteria decision-making technique, VIKOR. The combined ranking was accomplished by integrating group decision-making, average ranking perspective, and cumulative percentage coverage of India. The outcome reveals that for S1 and S2, NRMSE and NSE are the most significant indicators, respectively whereas CC is the least significant indicator in both cases. This study identifies ensemble of KIOST-ESM, MRI-ESM2-0, MIROC6, NESM3, and CanESM5 for maximum temperature and E3SM-1-0, NESM3, CanESM5, GFDL-CM4, INM-CM5-0, and CMCC-ESM2 for minimum temperature. Temperature and precipitation are the most widely used climatic parameter that unveils the impact of climate change over a region. Alteration in local water availability for irrigation purposes, occurrences of extreme events like droughts and floods, change in temperature patterns and severe heat wave occurrences are some of the common climate change impacts on society 1 . To tackle the above problems and have better infrastructure planning for the future, it is important to predict the impacts of climate change in terms of temperature and/ or precipitation. Global Climate Models (GCMs) are used for projecting future climatic data that can be used for hydro-climatological studies. Several studies worldwide consider climatic variables like maximum and minimum temperature, precipitation, surface mean temperature, and sea surface temperature for simulating GCMs in combination with the observed data 2-11 . The factors like complex topography of a region, monsoon dynamics with its onset, strength, and duration are influenced by the atmosphere, land, and ocean's complex interaction . The natural climate variabilities like El Nino-Southern Oscillation (ENSO) and Indian Ocean Dipole (IOD) often biases GCMs' maximum and minimum temperatures in different seasons . The correlation between surface temperature and precipitation involving 17 CMIP5 GCMs, observed that models performed better in the cold season than in the warm season, and better over the land than over the oceans of the Indian subcontinent 16 . Low-frequency air eddies may alter global and regional climate over decadal periods . There are various other uncertainties associated with the GCM simulations such as inappropriate parameterization of aerosols, initial and boundary conditions, greenhouse gas emission, systematic model errors, and socio-economic factors making it challenging to use at local and regional scales. The additional uncertainties like
For sustainable management of water resources, adaptive decisions should be determined considering future climate change. Since decision makers have difficulty in formulating a decision when they should consider a large number of climate change scenarios, selecting a subset of Global Circulation Models (GCM) outputs for climate change impact studies is required. In this study, the Katsavounidis-Kuo-Zhang (KKZ) algorithm was used for representative climate change scenarios selection and a comprehensive analysis has been done through a national-level case study of South Korea. The KKZ algorithm was applied to select a subset of GCMs for each subbasin in South Korea. To evaluate impacts of spatial aggregation level of climate data sets on preserving inter-model variability of hydrologic variables, three different scales (national level, river region level, subbasin level) were tested. It was found that only five GCMs selected by KKZ algorithm can explain almost of whole inter-model variability driven by all the 27 GCMs under Representative Concentration Pathways (RCP) 4.5 and 8.5. Furthermore, a single set of representative GCMs selected for national level was able to explain inter-model variability on almost the whole subbasins. In case of low flow variable, however, use of finer scale of climate data sets was recommended.
Atmospheric Research, 2021
The objective of this research was to assess the difference in historical simulations and future projections of rainfall and temperature of CMIP5 (RCP4.5 and 8.5) and CMIP6 (SSP2-4.5 and 5-8.5) models over Southeast Asia (SEA). Monthly historical rainfall and temperature estimations of 13 global climate models common to both CMIPs were evaluated to assess their capability to reproduce the spatial distribution and seasonality of European Reanalysis (ERA) rainfall and temperature. Models were used to determine uncertainty with spatiotemporal variability of rainfall and temperature projections. The CMIP6 GCMs did not appear to perform better than the older CMIP5 in SEA unlike other parts of the globe, except for rainfall. The CMIP6 models showed Kling-Gupta Efficiency (KGE) values in the range of-0.48-0.6, 0.21-0.85 and 0.66-0.91 in simulating historical rainfall, maximum temperature and minimum temperature compared to 0.13-0.46, 0.3-0.86 and 0.42-0.92 for CMIP5. The improvement in CMIP6 models in SEA was in the low uncertainty in ensemble simulation. The projections of CMIP5 and CMIP6 showed a relatively smaller increase in temperature with the CMIP6 ensemble when compared to CMIP5 models, while rainfall appeared to decrease. The geographical distribution of the changes indicated a greater increase in temperature in the cooler region than in the warmer region. In contrast, there was increase in rainfall in the wetter region and a smaller improvement in the drier region. This indicates increased homogeneity in temperature spatial variability, but more heterogeneity in rainfall, in the SEA region under climate warming scenarios.
Journal of Geophysical Research, 2011
1] Complexity and resolution of global climate models are steadily increasing, yet the uncertainty of their projections remains large, particularly for precipitation. Given the impacts precipitation changes have on ecosystems, there is a need to reduce projection uncertainty by assessing the performance of climate models. A common way of evaluating models is to consider global maps of errors against observations for a range of variables. However, depending on the purpose, feature-based metrics defined on a regional scale and for one variable may be more suitable to identify the most accurate models. We compare three different ways of ranking the CMIP3 climate models: errors in a broad range of climate variables, errors in global field of precipitation, and regional features of modeled precipitation in areas where pronounced future changes are expected. The same analysis is performed for temperature to identify potential differences between variables. The multimodel mean is found to outperform all single models in the global field-based rankings but performs only averagely for the feature-based ranking. Selecting the best models for each metric reduces the absolute spread in projections. If anomalies are considered, the model spread is reduced in a few regions, while the uncertainty can be increased in others. We also demonstrate that the common attribution of a lack of model agreement in precipitation projections to different model physics may be misleading. Agreement is similarly poor within different ensemble members of the same model, indicating that the lack of robust trends can be attributed partly to a low signal-to-noise ratio. Citation: Schaller, N., I. Mahlstein, J. Cermak, and R. Knutti (2011), Analyzing precipitation projections: A comparison of different approaches to climate model evaluation,
Comparison of indicators to evaluate the performance of climate models
International Journal of Climatology, 2024
The evaluation of climate models is a crucial step in climate studies. It consists of quantifying the resemblance of model outputs to reference data to identify models with superior capacity to replicate specific climate variables. Clearly, the choice of the evaluation indicator significantly impacts the results, underscoring the importance of selecting an indicator that properly captures the characteristics of a “good model”. This study examines the behaviour of six indicators, considering spatial correlation, distribution mean, variance and shape. Monthly data for precipitation, temperature and teleconnection patterns in Central America were utilized in the analysis. A new multicomponent measure was selected based on these criteria to assess the performance of 32 CMIP6 models in reproducing the annual seasonal cycle of these variables. The top six models were determined using multicriteria methods. It was found that even the best model reproduces one derived climatic variable poorly in this region. The proposed measure and selection method can contribute to enhancing the accuracy of climatological research based on climate models.