Usability Evaluation of Hospital Information System According to Heuristic Evaluation (original) (raw)
Related papers
Aim : Considering positive effects of hospital information system (HIS) in patients' treatment and organization performance, it is necessary to evaluate the quality of services provided by these systems. Hence, this research was aimed to evaluate HIS usability after training evaluators based on heuristic method in Isfahan hospitals. Methods: This research is a practical, descriptive, and cross-sectional study, which was conducted in Isfahan educational hospitals in 2014. In this research, four evaluators assessed four HIS (Kosar, Rayavaran Tose, Pooya Samaneh Diva, Sayan) independently. Data collection tools were researcher-made check lists based on 10 Nielsen's components, which validity of the checklist was verified by faculty members, as well as medical informatics and hospital information technology specialists. Checklist not required to reliability but because of the proliferation evaluators of reliability with group training of evaluators that are involved in the process was provided. Then data were analyzed using SPSS version 20 software (IBM Company, USA). Result: The results indicated that the total of detected problems in Kosar System, Rayavaran Tose System, Pooya Samaneh Diva System, and Sayan System were %31, %34, %24, and %24, respectively. The highest number of problems with %58 was related to users' freedom and dominating the system, and the lowest number with %16 was related to the component of match between the system and the real world. Conclusion: Despite the widespread use in the country, the design of many existing health systems has usability problems, which can affect the quality of users' interaction with the system and, therefore, caring outcome. Observing available standards and regulations in designing information system user interface like mentioned components in this research can lead to problem reduction.
Acta Informatica Medica, 2018
Introduction: Usability is one of the quality criteria for information systems and its weakness is one of the main barriers to the adoption of these systems. The purpose of this study was to evaluate the usability of admission and medical records module of three widely used hospital information systems (HISs). Methods: In this descriptive study the usability of admission and medical records module of three HISs (HIS1, HIS2, and HIS3) was evaluated using heuristic evaluation method. For each HIS, three expert users of the same system assessed the user interface independently, completed a usability evaluation checklist, and rated severity of each identified problem. The checklist was based on Nielsen's heuristics. For each HIS, three heuristics that have the highest and lowest problem rates and greatest severity of problems were categorized into three separate groups. The results were analyzed using descriptive statistics. Results: Although HIS1 and HIS2 were used in more hospitals than HIS3, the results showed that the usability problem rates of them were significantly higher than HIS3. The heuristics of "help and documentation", "flexibility and efficiency of use", and "visibility of system status" in the three HISs were categorized into the "highest rate of problems", "lowest rate of problems", and "highest severity of problems" groups, respectively. The heuristics of "diagnose and recover from errors", "error prevention", and "help and documentation" in HIS1 and HIS2 were categorized into the "highest rate of problems" group. Conclusions: The results of this study and previous studies show that the most common usability problems with HISs are related to heuristics of "help and documentation", "error prevention", and "help users recognize, diagnose and recover from errors." Also, the large number of hospitals using one HIS does not demonstrate its high usability to others.
A combination of two methods for evaluating the usability of a hospital information system
BMC Medical Informatics and Decision Making, 2020
Background None of the evaluation methods can identify all the usability problems of information systems. So far, no study has sufficiently investigated the potential of a combination of these methods to identify usability problems. The present study aimed at examining the potential for combining two commonly utilized user-based and expert-based methods to evaluate the usability of a hospital information system. Methods Think aloud (TA) and Heuristic evaluation (HE) methods were used to identify the usability problems of two subsystems of the Social Security Electronic System in Iran. To this end, the problems were categorized into five groups based on ISO-Nielsen usability attributes. The Chi-square test was applied to compare the intended methods based on the total number of problems and the number of problems within each group, followed by utilizing the Mann-Whitney U test to compare the mean severity scores of these methods. Results The evaluation by combining these methods yiel...
User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation
Applied clinical informatics, 2016
While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Three trained usability evaluators independently evaluated the system using Nielsen's 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to "Consistency and standards" heuristic (25%) and the lowest related to "Flexibilit...
Acta informatica medica : AIM : journal of the Society for Medical Informatics of Bosnia & Herzegovina : casopis Drustva za medicinsku informatiku BiH, 2016
Radiology information system (RIS) in order to reduce workload and improve the quality of services must be well-designed. Heuristic evaluation is one of the methods that understand usability problems with the least time, cost and resources. The aim of present study is to evaluate the usability of RISs in hospitals. This is a cross-sectional descriptive study (2015) that uses heuristic evaluation method to evaluate the usability of RIS used in 3 hospitals of Tabriz city. The data are collected using a standard checklist based on 13 principles of Nielsen Heuristic evaluation method. Usability of RISs was investigated based on the number of components observed from Nielsen principles and problems of usability based on the number of non-observed components as well as non-existent or unrecognizable components. by evaluation of RISs in each of the hospitals 1, 2 and 3, total numbers of observed components were obtained as 173, 202 and 196, respectively. It was concluded that the usability...
Open Access Macedonian Journal of Medical Sciences
BACKGROUND: Admission, discharge and, transfer (ADT) process is one of the most important hospital workflows. ADT system is a part of a hospital information system (HIS). AIM: The objective of this study was to evaluate the usability of the ADT system. METHODS: The study performed at Mashhad University of Medical Sciences (MUMS) hospitals. Data collection instrument was a validated checklist of Pierotti heuristic evaluation. To determine the severity of usability problems, a hybrid of Nielson and Tampere unit for computer-human interaction (TAUCHI) severity scaling algorithm was used. Usability problems were divided into five categories (major, severe, minor, cosmetic, and technical). Six experts evaluated the ADT system independently. According to TAUCHI severity scale, if a feature has not yet been implemented in the ADT system, evaluators considered it a technical usability problem. Therefore, usability problems due to non-design feature in the ADT system were identified. Finally...
2021
Aim: This study aimed to assess the usability of HISs from users' viewpoints based on ISO 9241-10 standard. Methods: This study was a descriptive and cross-sectional study that was conducted in 2019. It was filled out by 227 end-users, including 165 clinical and 59 administrative staff of Imam Khomeini, Mostafa Khomeini, and Taleghani hospitals selected randomly. Data were collected using the standard Iso-Metric 9241-10 questionnaire. The content validity and reliability of the questionnaire were assessed by experts' opinions and test-retest method, respectively. Finally, the findings were analyzed using descriptive statistics (mean value, standard deviation, and frequency) through SPSS-23 software packages. Results: Based on the results, 56% of HISs users in the surveyed hospitals were somewhat satisfied, with the total average of all scores being equal to 2.8 from 5. The results suggested that the highest scores were found for the criterion of "controllability," ...
Journal of biomedical …, 2010
The user has requested enhancement of the downloaded file. All in-text references underlined in blue are added to the original document and are linked to publications on ResearchGate, letting you access and read them immediately. This article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and education use, including for instruction at the authors institution and sharing with colleagues.
Usability Evaluation of Public Sector Hospital Websites of Pakistan
2018
The hospital website should be easy to use and understandable by patients and general public. A hospital website equipped with usability standards can reduce gap between patients themselves and improve user satisfaction level significantly. As more people are turning towards Internet for seeking health information, therefore, health-care websites containing relevant and useful health contents is need of the day. The current study is a part of research which aims to understand and highlight usability issues and propose design rules for developers to produce hospital websites of Pakistan in accordance with usability standards. Four public sector hospitals operational in Pakistan were evaluated with the objective to identify usability issues. These issues have been used to form design rules. Twenty-six participants took part in the study to perform user tasks. Data collected was through questionnaire and direct observation techniques. Average scores calculated against each website and ...