Development, Reliability, and Validity of Open-ended Test to Measure Student’s Digital Literacy Skill (original) (raw)
Related papers
Assessing Students’ Digital Literacy Skill in Senior High School Yogyakarta
JPI (Jurnal Pendidikan Indonesia)
This study aimed at investigating students’ digital literacy skill of students Grade X and XI in Senior High School in Yogyakarta. There were three steps of this research. First, we constructed the item format and aspect of digital literacy skill. Second, the administration of this research to 193 students of science class in Yogyakarta which were selected randomly. The last, analysis data of students’ digital literacy skill based on educational level. For the profile of students’ digital we used descriptive and quantitative statistics (frequency and percent). To determine the significant difference of the students’ level we also used independent sample t-test. Result of this study showed that the students’ digital literacy skill of all students was very low level. In addition, there was significant difference of students’ digital literacy skill based on educational level. The conclusion was students’ digital literacy skill in Yogyakarta was very low and there must an effort to forc...
Examination of Digital Literacy Skills of Undergraduate Students According to Various Variables
Advanced Education
The purpose of this research was aimed to determine the digital literacy skills of undergraduate students studying in different departments of the university according to the variables of gender, type of faculty, and daily internet use. In order to achieve this goal, 388 undergraduate students studying at the Faculty of Education, Faculty of Health Sciences, and Faculty of Economics and Administrative Sciences at İzmir Democracy University were determined as participants. The “Personal Information Form” prepared by the researchers and the “Digital Literacy Scale (DLS)” developed by Bayrakcı & Narmanlıoğlu (2021) and consisting of six sub-dimensions were used as data collection tools. According to the findings of the research, it was determined that the digital literacy levels of the students were moderate. When examined according to the gender variable, a significant difference was found between female and male students in the sub-dimensions of digital literacy levels. When examined...
DergiPark (Istanbul University), 2023
This research goal to develop a multiple-choice closed-ended test to assessing and evaluate students' digital literacy skills. The sample in this study were students at MTsN 1 Blitar City who were selected using a purposive sampling technique. The test was also validated by experts, namely 2 Doctors of Physics and Science from Yogyakarta State University. The test instrument was developed based on five aspects of digital literacy skills: information, communication, content creation, security and problem-solving. Data have been analyzed descriptively and inferentially using the Rasch version and the assist of Quest software. The results showed that eight multiple-choice closed-ended test instruments were declared valid based on expert validation with an Aiken V value of 1.00. The reliability result is 0.97 with a very high category, and the INFIT MNSQ standard deviation value is 0.86-1.16, so seven items are by the Rasch model. Thus, the seven items in the multiple-choice closed-ended test instrument can be used to assessing and evaluate students' digital literacy skills in learning science.
The level of digital literacy ability of elementary school students
World Journal on Educational Technology: Current Issues
Digital literacy skills are mandatory for students to master so that they can process information wisely. The purpose of this research is to determine the level of digital literacy of elementary school students. The research method used in this research is quantitative. The sample of this research is 86 elementary students in Laweyan Sub-district, Surakarta, Indonesia. The data collection technique used is a test that validated by an expert. The data analysis used in this research is descriptive statistical analysis. The result of this study shows that the students’ level of ability in digital literacy is good with the fulfillment of five indicators, namely the use of technology reaches 79.75% or students can analyze the functions of hardware and software in technology, the management of information on digital media reaches 70% or the students can search for valid data sources, social networking reaches 82.25% or students can design and participate in digital technology, online safe...
Examination of Digital Literacy Levels of University Students
Dinamika Ilmu
In this study, it was aimed to determine the digital literacy levels of university students. The study also aimed to examine the differentiation status of university students in terms of various variables of digital literacy levels. In addition, in the study, the digital literacy levels of university students were determined by gender, type of education (normal/secondary education), higher education level (associate / undergraduate/graduate), higher education program they are enrolled in, grade point average, class, average monthly income, social network with the most time spent. It is also aimed to examine the differentiation status in terms of the variables of average internet usage time during the day, the preferred tool for internet use, and the educational status of the parents. In this study, the survey model, which is one of the quantitative patterns, was used. The population of the study consisted of a total of 17,006 students, 11,500 undergraduate and 5,506 associate degree...
International Journal of Emerging Technology and Advanced Engineering, 2021
In the development of digital technology, schools must equip students with digital literacy skills to develop thinking both critically and creatively and make teaching and learning relevant to the students. There are various measuring instruments that have been developed to assess digital literacy for various target groups. However, quality and valid instruments are still limited and lacking. It is important to apply a valid measuring instrument for digital literacy based on its results in the case of overlapping and ambiguous constructions in the name of digital literacy. Thus, to assess the content validity of the questionnaire that had been generated to evaluate digital literacy of the school teachers is the main focus. The validity of the content was used as a criterion to confirm that the questionnaire was of high quality. The instrument's content validity was assessed according to the feedbacks of six professional in the field. The item content validity index and scale content validity index were implemented for content validity. Three (3) constructs namely; technical, cognitive, and social-emotional contain 6 items each were identified. The results of content validity index (I-CVI) showed between 0.97 to 1 and the scale content validity index (S-CVI/Ave) for the technical, cognitive, and social-emotional dimension of digital literacy was 1.00, 0.97, and 0.97 respectively. The questionnaire was identified with acceptable content validity. Further research able to guarantee that the questionnaire is checked for reliability as well as the other types of validity, including as face validity, construct validity, and criterion validity, in order to improve the assessment instrument's usefulness.
Constructing Digital Literacy Instrument and its Effect on College Students' Learning Outcomes
International Journal of Instruction, 2022
This research aims to develop and test the effectiveness of digital literacy instruments on students' learning outcomes. This study is a mixed method that combines survey and pre-experimental research. The survey research was conducted through a quantitative approach using a questionnaire as the research instrument with assessed numerical items. The survey respondents consisted of 318 students from various universities in Indonesia who were taken through cluster random sampling technique. The implementation of the instrument was carried out through a pre-experimental design to 103 students to test the instrument's effectiveness. The confirmatory factor analysis result shows that the model forms three factors, which are factor 1 (communicating digital content), factor 2 (exploring digital content), and factor 3 (creating and using digital content). The result of the goodness of fit model shows that the instrument has met all the criteria with a value of X 2 /df = 1.642 (<3.00), RMSEA = .079 (≤ .08), GFI = .900 (≥ .90), AGFI = .825 (≥ .90), TLI = .939 (≥ .90), and CFI = .951 (≥ .90). Empirically the instrument has good discrimination power so that it can measure students' digital literacy skills at different academic ability levels (Sig. <.05). In addition, the instrument has been effectively used to measure and predict student learning outcomes (R square = .255, Sig. < .05). The instruments' result is relevant to current conditions and can further explore students' digital literacy skills.
Development and Validation of Digital Literacy Scale (DLS) and its Implication for Higher Education
International Journal of Distance Education and E-Learning
The study aimes to develop and validate Digital Literacy Scale (DLS) based on Chen’s (2015) theoretical framework which includes nine dimensions: communication, collaboration, critical thinking, creativity, citizenship, character, curation, copyright, and connectedness. A question pool consisting of 62 items based on the nine dimensions of digital literacy was generated on a 5-point Likert-type scale. Content validity of the question pool was sought from experts in terms of clarity of items, language understanding, and relevance. SPSS and AMOS were used for statistical analysis. Using a sample of 349 university students, Exploratory Factor Analysis was employed for reliability analysis, construct validation, and factor structure of the scale. EFA confirms the nine dimensions; however, some items were deleted during this process. Finally, Confirmatory Factor Analysis was employed to check the reliability and validity of the factor structure by using a second sample (n=442). CFA showe...
Digital Literacy: A Survey Level Digital Literacy Competence among University Students in Jakarta
International Journal of English Literature and Social Sciences, 2019
Digital Literacy Competence is not yet mastered by the people of Indonesia. Understanding of reading material and the ability to produce positive reading has not been successfully implemented. The purpose of the study was to analyze the influence of parental roles on digital literac y competencies of the students of the Faculty of Communication Sciences, Universitas Mercu Buana. The concept of Interpersonal Communication by DeVito (2013) was used in this study. The role of the family can be classified into four, namely: (1) modeling; (2) mentoring; (3) organizing, and (4) teaching. Through survey methods and data analysis techniques with correlation and impact testing, the results of the study show that the role of parents has an influence on digital literacy competencies. The role o f parents as models, mentors, organizers and instructors in educating and raising their children is highly recognized by their children. Meanwhile, the role of parents has not had a maximum effect on improving student literacy digital competencies.
JETL (Journal of Education, Teaching and Learning)
Students’ competence to utilize digital technology to access information as learning sources has become a necessity as experienced during the covid-19 pandemic. Students should have the digital literacy competence to support the students’ learning processes. This research was conducted to reveal the digital competence levels covering internet searching, hypertextual navigation, content evaluation, and knowledge assembly based on activities made by the students of Junior High Schools in Singkawang. The samples were selected using a proportional random sampling technique and 75 respondents were selected representing the students of Junior High Schools in Singkawang. The collected data were then processed using a descriptive statistical analysis with a quantitative approach. The statistical test was conducted using mini-step Program with Rasch modeling to measure the students’ digital literacy competence levels at Junior High Schools in Singkawang. The research results showed that the ...