Bahrul Hayat - Academia.edu (original) (raw)

Papers by Bahrul Hayat

Zenodo (CERN European Organization for Nuclear Research), Jun 27, 2023

Journal of curriculum and teaching, May 16, 2024

Cronbach's alpha is a reliability coefficient commonly reported in second language (L2) and Engli... more Cronbach's alpha is a reliability coefficient commonly reported in second language (L2) and English language teaching (ELT) studies. The alpha coefficient provides information on the internal consistency of a measuring instrument. The reported alpha coefficients are obtained from, and apply only to, the research sample. However, the estimation of the alpha coefficient for the population has not received the attention of L2 and ELT researchers. This study aims to provide an overview of the alpha coefficient estimation procedure of a measuring instrument for a population with the reliability generalization method, commonly known as alpha coefficient meta-analysis. An example alpha coefficient meta-analysis study-using empirical data of the 29-item English Language Teaching Reflection Inventory (ELTRI) from 27 independent study samples-was conducted to provide an overview of the procedure for applying the method and the information that needs to be reported from the results of the analysis. The results of the study using a random-effect model show that the population alpha of ELTRI was 0.872, indicating excellent reliability; this is followed by application of a mixed-effect model that shows that article type and means of teaching experience significantly impacted ELTRI reliability. Implications for future research are discussed.

Indonesian Journal of Educational Assessment, Feb 13, 2019

Banyak penelitian eksperimental telah dilakukan hingga beberapa tahun terakhir untuk melihat peng... more Banyak penelitian eksperimental telah dilakukan hingga beberapa tahun terakhir untuk melihat pengaruh pendekatan penguasaan pembelajaran terhadap perilaku kognitif dan karakteristik afektif siswa. Pertanyaannya adalah berapa banyak bukti yang ada dalam hasil penelitian yang ada memberikan kesimpulan ilmiah dengan menggabungkan hasil eksperimen yang ada. Dengan memperlakukan eksperimen penguasaan pembelajaran yang berbeda sebagai replikasi penelitian, hasil eksperimen dapat dikombinasikan menggunakan teknik meta-analisis. Makalah ini menunjukkan bagaimana sintesis penelitian kuantitatif dapat secara efektif digunakan untuk menggabungkan bukti statistik penelitian yang dilakukan secara terpisah dan independen. Pengaruh penguasaan pembelajaran pada karakteristik afektif siswa dipilih untuk sintesis penelitian ini. Pendekatan pembelajaran penguasaan yang akan diselidiki dalam sintesis penelitian ini adalah Bloom tipe strategi pembelajaran penguasaan. Dengan menggunakan 26 perbandingan independen, hasil penelitian menunjukkan bahwa: a) ukuran efek penguasaan pembelajaran pada karakteristik karakteristik siswa yang heterogen di berbagai studi, b) sumber studi, baik dari disertasi atau artikel jurnal, tidak menjelaskan variabilitas antara ukuran efek, c) program penguasaan pembelajaran menggunakan kriteria penguasaan ≥ 75% tampaknya memiliki dampak afektif positif pada siswa, sedangkan yang menggunakan <75 % kriteria penguasaan tidak berdampak pada karakteristik afektif siswa, d) ukuran efek rata-rata menunjukkan tren menurun ketika tingkat pendidikan meningkat, e) ukuran efek rata-rata sangat positif untuk kelas matematika dan efek positif rendah untuk sains dan sosial studi, dan f) durasi perlakuan pendek memiliki ukuran efek positif yang jauh lebih besar daripada durasi pengobatan jangka panjang. Kata kunci: penguasaan pembelajaran, ukuran efek afektif, sintesis penelitian, meta analisis statistik Abstract. Many experimental researches have been conducted until recent years to see the effect of mastery learning approach on students' cognitive behavior and affective characteristics. But the question is how much evidence is there in the existing research results provides scientific conclusions by combining existing experimental results. By treating different experiments of mastery learning as research replications, the experimental results can be combined using a meta-analysis technique. This paper shows how a quantitative research synthesis can effectively be used to combine statistical evidences of researches conducted separately and independently. The effect of mastery learning on affective characteristics of students was selected for this research synthesis. The mastery learning approach to be investigated in this research synthesis is Bloom type of mastery learning strategy.Using 26 independent comparisons, the results of study show that: a) the effect sizes of mastery learning on affective chharacteristics of students are heterogeneous across studies, b) the source of study, either from dissertation or journal article, does not explain the variability among the effect sizes, c) mastery learning programs using a ≥ 75% mastery criterion seem to have positive affective impact on the students, while those using < 75 % mastery criterion have no impact on the affective characteristics of students, d) the mean effect size shows a decreasing trend as the level of education increases, e) the mean effect size is highly positive for mathematics class and low positive effect for science and social studies, and f) short treatment duration has a much larger positive effect size than the long term treatment duration.

Jurnal Pengukuran Psikologi dan Pendidikan Indonesia, May 1, 2021

This article introduces the Klasika software developed to run item and test analysis using the Cl... more This article introduces the Klasika software developed to run item and test analysis using the Classical Test Theory approach. Classical Test Theory is one of the specialized competencies and skills that undergraduate students of psychology must possess. Classical Test Theory becomes a mandatory course for all schools or departments of psychology in Indonesia. This article also provides a theoretical foundation of Classical Test Theory's essential concepts and statistical methods, specifically related to items and test statistics. The item analysis and test reliability procedures using Klasika, starting from the data preparation untill data interpretation, are explained with an empirical illustration. Finally, the analysis results using Klasika are compared with the results from Quest software to test the accuracy of the estimation results.

Millah : jurnal studi agama, Aug 16, 2012

This pe^er discusses the participation ofwomen education in the perspective ofhuman rights. The r... more This pe^er discusses the participation ofwomen education in the perspective ofhuman rights. The research isfield study with a sample distributionfrom elementaiy School to college with the scope of research on aspects ofilliteracy, formal education, and non-formal education. The research showed that the cause ofgender disparity in education is closely related to reli^ous, social, economic, cultural, and geogr<p}hycalfactors. Although from legal aspect and educationalpolicy, men and women are ffven equal access, hut the various constraints restrict women's struggle to obtain equality ofeducational opportunities. bdA J (J 51^1 5j^9JLiI,l ftds IJLa J .^JuaUtll JII4 Sj-iL^IjJl J 3 CSMiJbJI Jjiy iJlLJIj tJliaJl (jo SjLmXI jJ J .tibJ jLftaliYlj •SjLmJ,! liUj

The instrument of noble character is arranged to get a valid and reliable instrument that can mea... more The instrument of noble character is arranged to get a valid and reliable instrument that can measure the noble character of students in Islamic Senior High School. The research method uses a survey, with the number of testing respondents as many as 597 students, using a Likert scale model. Instrument testing begins with a theoretical validity test by 4 experts and 20 panel members by examining the instrument items. Experts analyzes qualitatively, after the instrument is corrected as suggested by expert advice. Then it is examined by a panel that analyzes quantitatively using the Aiken index of 69 items, 17 indicators and 4 dimensions. The results of the analysis show that all items are valid. The next step is empirical validity test, where analysis of measurement model uses Confirmatory Analysis Factor (CFA) with Lisrel 8.80 Full Version program. The test results show 62 items valid, with criteria of SLF value ≥ 0.30 and t-value ≥ 1.96, and calculating reliability with construct Reliability (CR), the calculated results are reliable with CR> 0.70. From the observation of the model compatibility test towards the noble character instrument, it can be concluded that there is a match between the theoretical and empirical models.

Revista CES Psicología, 2021

The purpose of this study was to validate and evaluate the factor structure of the instrument for... more The purpose of this study was to validate and evaluate the factor structure of the instrument for measuring attitudes towards the environment using factor analysis and multidimensional polytomous Rasch model. Participants in this study were 595 Indonesian university students (293 male and 302 female) with an age range of 18-24 (mean age = 21.01, SD = 1.65). The 22-items of Environmental Attitudes Measure were administered using online survey systems. This study generates a three-dimensional factor structure of environmental attitudes in the Indonesian college samples and supports the original scale's theoretical basis. The results of the multidimensional analysis of the polytomous Rasch model show that the psychometric characteristics of this instrument are excellent and have high separation reliability, both for items and person. The findings of this study can be used in future research to examine the interrelationship of environmental attitudes with other variables in the Indonesian sample. Limitations of this study are also discussed.

Advances in social science, education and humanities research, 2021

Anomalous behaviour such as rapid guessing in item response can affect test validity and the util... more Anomalous behaviour such as rapid guessing in item response can affect test validity and the utility of decisions made with test scores, making it critical to identify this anomalous behaviour. The author proposes a new nonparametric method for setting a response-time threshold for flagging rapid guessing behaviour of item responses. Using data from the computer base national exam of Junior High School in Indonesia, the author analysis and compares the effectiveness of the new and existing method for detecting rapid guessing behaviour based on response time. Based on ROC curve analysis, the author concludes a new method for setting a response-time threshold is more effective than existing methods.

Cogent Education, Apr 5, 2022

World Journal of English Language, Jun 14, 2023

This study aimed to evaluate the psychometric properties of the INAP-L instrument by applying the... more This study aimed to evaluate the psychometric properties of the INAP-L instrument by applying the Rasch model. The psychometric evaluation includes item calibration and differential item functioning (DIF) assessment. Participants in this study were 6153 high school students (2326 boys and 3827 girls) aged 14-19 years (mean age = 15.76, SD = 0.78) from 280 schools spread across 34 provinces in Indonesia. The results of the Rasch model analysis show that the assumptions of unidimensionality and local independence are met. The internal consistency analysis of the INAP-L instrument (PSR = 0.80; Ordinal α = 0.81) and item-person targeting showed quite good results. At the item level, it was discovered that four of the forty items did not fit the Rasch model. Meanwhile, the gender-based DIF analysis revealed that all items were free from gender DIF and that two out of forty items showed DIF based on school type. It can be concluded that the INAP-L instrument has good psychometric properties. Furthermore, multilevel analysis was performed to determine the effect of clustering in the data, and it was discovered that INAP-L has a multilevel data structure with ICC = 0.185 and a design effect > 2.00. This means that future research on the relationship among variables on the INAP-L score must consider a multilevel approach. Even though the developer has already published an interim report on INAP-L, the findings of this study can be used as a reference in improving the instrument before conducting INAP-L in the future.

Jurnal Pengukuran Psikologi dan Pendidikan Indonesia, May 19, 2022

Measuring continuous learning (CL) competency is beneficial to achieving success for individuals ... more Measuring continuous learning (CL) competency is beneficial to achieving success for individuals and organizations. For this reason, the availability of a brief but valid instrument is crucial. This study aims to develop a valid instrument to measure the CL using a situational judgment test (SJT). The instrument was developed and validated using respondents of 502 employees at the supervisory level in the electrical industry (with age M=30.13, SD=6.17). For content validity, we first held focus group discussions with supervisors and managers to identify and develop some essential characteristics of the CL. Subject matter experts were involved in writing and reviewing the items. A confirmatory factor analysis was conducted to test the construct validity, and it was found that 12 of 13 items fitted a unidimensional model. All the factor loadings were statistically significant (p<.05). A further test for parallel assumption was done to check the tau-equivalence. This test is vital because raw scores are mostly used in daily practice rather than scaled scores. The results showed that 12 items met the tau equivalent requirement. For further research, scoring for multiple-choice SJTs using the nominal response model (NRM) could be considered since there was a tendency for some of the questions to elicit ambiguous choices.

International Journal of Education, Nov 1, 2010

This article focused on results of assessment of PISA on level of literacy of youngsters in a num... more This article focused on results of assessment of PISA on level of literacy of youngsters in a number of countries including Indonesia. Key findings comprised reading literacy, mathematics literacy, and science literacy of Indonesian youngsters and those of other countries are described. Several factors assumed to have impacts on the results of assessment covered impacts of gender, engagement on learning, family background, and school characteristics. There are several constraints faced by Indonesia that make the assessment result unsatisfying, namely, input and process of education. Constraints of education input cover 1) insufficient availability of educators and educational staff; 2) unavailable learning facilities or inefficient use of the facilities; and 3) inadequate education costs. Constraints of education process comprise 1) too much structured and heavily loaded content, and 2) teacher oriented instructional method. The constraints of education process cause instructional process ineffective. There are seven solutions that need to be organized to cope with the constraints. They are 1) the development of better curriculum, learning method, and assessment system, 2) the capacity of educators' profession, 3) the improvement of facilities and learning materials, 4) a life skill education, 5) the development of a superior school on basic education, 6) the improvement of quality and relevance of education, 7) the use of ICT for schooling and learning system.

Revista CES psicología, May 28, 2020

Research and Evaluation in Education, Dec 31, 2020

This is an open access article under the CC-BY-SA license.

Indonesian Journal of Educational Review, Jul 1, 2020

Smartphone addiction is a phenomenon that is developing very fast due to easy accessibility and u... more Smartphone addiction is a phenomenon that is developing very fast due to easy accessibility and unique internet-based applications. This study aims to determine the effect of psychological factors (selfcontrol, loneliness, and sensation seeking) on smartphone addiction amongst Islamic school (madrasah) students. This study used a quantitative approach with a sample of 327 students of Islamic School (Madrasah) taken with a non-probability sampling technique. Measuring instruments used in this study were Smartphone Addiction Scale (SAS), 24 Attitudinal Items, UCLA Loneliness Scale, and Sensation Seeking Scale V. Data analysis techniques used multiple regression analysis techniques. The results of the study indicated a significant influence of self-control, loneliness, and sensation seeking on smartphone addiction. Based on the results of hypothesis testing, there are four significant variables, namely self-control, intimate others, social others, and boredom susceptibility. Other variables such as affiliation, belonging, thrill, adventure, and experience seeking are not significant to smartphone addiction.