SUMI evaluation of the EducaNext educational portal (original) (raw)

A case study of usability testing: the SUMI evaluation approach of the EducaNext portal

WSEAS Transactions on Information Science and …, 2008

The new challenge for designers and Human-computer interaction (HCI) researchers is to develop software tools and applications for effective e-learning. Software usability is one aspect of Human-computer interaction that can benefit from knowledge of the user and their tasks. However, in practice not much attention is given to this issue during testing. Evaluators often do not have the knowledge, instruments and/or time available to handle usability. One set of methods for determining whether an application enables users to achieve their predetermined goals effectively and efficiently is usability evaluation with end users. The paper presents the results of empirical study of usability evaluation which was based on SUMI (Software Usability Measurement Inventory) questionnaires. The software application tested was a multilingual educational portal EducaNext.

Towards the evaluation of usability in educative websites

International Journal of Technology Enhanced Learning, 2010

This article presents a methodological approach of evaluation of the usability in educational environments ME-UsitE, an analysis of the necessity to implement a tool of evaluation and measurement of the usability to support the methodology, that contributes to the detection of problems and failures of usability from the perspective of the user of educative websites in a real work environment. Taking into account that the websites are designed and implemented for a domain and audience in particular, it is important to consider factors like these for the implementation of a tool that allows not only to carry out the evaluation process but also to support the analysis of the gathered data. Thus, the obtained results may allow us to establish policies for the improvement of the usability of the site, when providing a score that determines whether the level of usability offered covers the requirements for the proposed audience and the profile of the participant user in the evaluation.

Developing a Usability Evaluation Method for e-Learning Applications: Beyond Functional Usability

International Journal of Human-computer Interaction, 2009

In this article, the development of a questionnaire-based usability evaluation method for e-learning applications is described. The method extends the current practice by focusing not only on cognitive but also affective considerations that may influence e-learning usability. The method was developed according to an established methodology in HCI research and relied upon a conceptual framework that combines Web and instructional

THE DEVELOPMENT OF A USABILITY INSTRUMENT FOR E-LEARNING IN EDUCATIONAL SETTINGS

Determining the usability of fully online courses will help faculty and designers improve the design of online courses and it is expected, students’ overall experience. Few studies assess usability focused on e-learning. While research has been conducted on usability, it usually do not address pedagogical elements that are necessary for designing highly effective fully online courses. The E-learning Usability Evaluation Questionnaire created by Zaharias [29] is the closest instrument found to measure usability, including pedagogical elements and students’ motivation to learn. However, it was created for corporate settings. The purpose of this article is to present a brief review of literature, the research problem, methodology, and limitations of a proposed study designed to revise and test the adapted version of the E-learning Usability Evaluation Questionnaire [29] to educational settings using a Delphi study.

On the Usability Evaluation of E-Learning Applications

2005

Despite the advances of the electronic technologies in e-learning, a consolidated evaluation methodology for e-learning applications does not yet exist. The goal of e-learning is to offer the users the possibility to become skillful and acquire knowledge on a new domain. The evaluation of educational software must consider its pedagogic effectiveness as well as its usability. The design of its interface should take into account the way students learn and also provide good usability so that student's interactions with the software are as natural and intuitive as possible. In this paper, we present the results obtained from a first phase of observation and analysis of the interactions of people with e-learning applications. The aim is to provide a methodology for evaluating such applications.

Higher Education e-Learning Usability Analysis Using System Usability Scale

2020

The COVID-19 pandemic encourages almost every institution to optimize the use of information and communication technology to maintain consistency and competitive advantage. One of the efforts made by Higher education is developing and optimizing online-based learning (e-learning) models. E-learning plays an important role in the success of achieving learning objectives at Telkom Institute of Technology Purwokerto (ITTP), which is conducted between lecturers and students. The problem faced in optimizing e-learning system at ITTP is related to usability. The purpose of this study is to evaluate the usability level of the ITTP e-learning system using the System Usability Scale (SUS) method. Based on the testing of questionnaire instruments using SPSS software, it was obtained the result that the questionnaire used for the study was valid, and the reliability rate was 0.758. Based on the results of system tests to 100 respondents or users, it is known that the SUS score is 55.3. The val...

An approach to usability evaluation of e-learning applications

2006

Abstract Despite recent advances of electronic technologies in e-learning, a consolidated evaluation methodology for e-learning applications is not available. The evaluation of educational software must consider its usability and more in general its accessibility, as well as its didactic effectiveness. This work is a first step towards the definition of a methodology for evaluating e-learning applications. Specific usability attributes capturing the peculiar features of these applications are identified.

A Usability Evaluation Approach in E-Learning Environments: He Case of Ibm Lotus Quickr

2012

It is widely accepted that learning environments can enhance the management of learning and contribute to the knowledge transfer [1]. Nowadays learning environments are used in schools, colleges, universities and lifelong learning platforms are independent from the subject area. Such environments compose of various features and services which allow users to collaborate, share knowledge, exchange information, data, experiences and generally to support formal and informal knowledge. According to Human Computer Interaction (HCI) aspects, a usable learning environment is more effective and efficient in terms of learning management and knowledge transfer. Therefore, usability evaluation of learning environments is an important procedure in order to ensure the three main aspects of usability; effectiveness, efficiency and subjective satisfaction [2]. Mainly, in the case of a distance learning university several innovative learning environments are used. This study presents an evaluation p...

Experience with usability evaluation of e-learning systems

Universal Access in the Information Society, 2008

Progress in the field of e-learning has been slow, with related problems mainly associated with the poor design of e-learning systems. Moreover, because of a depreciated importance of usability, usability studies are not very frequent. This paper reports the experience with the usability assessment of intelligent learning and teaching systems which are based on TEx-Sys model and are intended to enhance the process of knowledge acquisition in daily classroom settings. The applied scenario-based usability evaluation, as a combination of behaviour and opinion based measurements, enabled to quantify usability in terms of users' (teachers' and students') performance and satisfaction. According to the achieved results, the main directions for interface redesign are offered. The acquired experience indicates that useful usability assessments with a significant identification of interface limitations can be performed quite easily and quickly. On the other hand, it raised a series of questions which, in order to be clarified, require further comprehensive research, the more so if the employment of universal design within e-learning context is considered.

Examining the Usability of an Educational Platform Designed for Human Computer Interaction

Hacettepe University Journal of Education, 2022

In this study, the purpose was to examine the usability level of a digital educational platform designed and developed within the scope of Human Computer Interaction (HCI). In the study, a weak experimental design, one of the quantitative research methods, was used. First of all, the learners' expectations regarding a digital educational platform within the scope of HCI were revealed. Next, the experimental group was asked to use the digital educational platform developed, and the control group was asked to use the digital educational platform currently used by the institution for one semester. The usability levels were compared by applying the System Usability Scale to both groups. In addition, a usability test was performed to compare both digital platforms. A total of 363 university students studying at Van Yüzüncü Yıl University in the 2021/2022 Academic Year Fall and Spring semesters participated in the study. As the data collection tools, the Distance Education System Evaluation Questionnaire in Terms of Human Computer Interaction (HCIEQ), System Usability Scale (SUS) and HCI-Usability Observation Form (HCIOF) were used. The data were entered into SPSS 21 program, and descriptive statistics such as mean, standard deviation, percentage and frequency, independent samples t-test and One-Way ANOVA were performed. Results of the analysis revealed that the digital educational platform developed within the scope of HCI was found by the learners to be more usable.