A Tangible Interface for Augmented Reality Visualisation in 4D Echocardíography lmaging of the Left Ventricle of the Heart (original) (raw)
Related papers
Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2022
This paper presents a design approach to creating a learning experience for cardiac anatomy by providing an interactive visualisation environment that uses Head Mounted Display (HMD)-based Augmented Reality (AR). Computed tomography imaging techniques were used to obtain accurate model geometry that was optimised in a 3D modelling software package, followed by photo-realistic texture mapping using 3D painting software. This method simplifies the process of modelling complex, organic geometry. Animation, rendering techniques, and AR capability were added using the Unity game engine. The system's design and development maximises immersion, supports natural gesture interaction within a real-world learning setting, and represents complex learning content. Hand input was used with a surgical-dissection metaphor to show cross-section rendering in AR in an intuitive manner. Lessons learned from the modelling process are discussed as well as directions for future research.
Augmented Reality for the Study of Human Heart Anatomy
Augmented reality is increasingly applied in medical education mainly because educators can share knowledge through virtual objects. This research describes the development of a web application, which enhances users' medical knowledge with regards to the anatomy of the human heart by means of augmented reality. Evaluation is conducted in two different facets. In the first one, the authors of this paper evaluate the feasibility of a three-dimensional human heart module using one investigator under the supervision of an expert. In the second, evaluation aims at identifying usability issues by means of the cognitive walkthrough method. Three medical students (naive users) are called upon three target tasks in the web application. Task completion is appreciated in the light of the standard set of cognitive walkthrough questions. Augmented reality content miss hits are revealed by means of the first evaluation in an effort to enhance the educational utility of the three-dimensional human heart. Cognitive walkthrough provides further improvement points, which may further enhance usability in the next software release. The current piece of work constitutes the pre-pilot evaluation. Standardized methodologies are utilized in an effort to improve the application before its wider piloting to proper student populations. Such evaluations are considered important in experiential learning methods aiding online education of anatomy courses.
Augmented Reality in Cardiology
The Anatolian Journal of Cardiology, 2019
The augmented reality (AR) is an emerging technology that facilitates the comprehension of many situations that are difficult to understand otherwise. It is based on the superimposition of a virtual image on the real-world images. It is used as an assisting tool in areas of education, emergency, diagnosis, surgery and percutaneous interventions in cardiology, although all these areas are in their infancy period of using. In this review, the use of AR in cardiology is summarized with special reference to some studies. Augmented reality (AR) can be defined as "An enhanced version of reality where live direct or indirect views of physical realworld environments are augmented with superimposed computer-generated images over a user's view of the real-world, thus enhancing one's current perception of reality "(1). The AR is one component of the spectrum of extended reality, which includes virtual reality (VR), merged reality, mixed reality and AR. It differs from VR that, nothing in VR is real, while in AR, some virtual objects are implemented in real world environment. Merged and mixed realities are usually regarded as one and named as mixed reality, which are between VR and AR. "Augmented reality" has been firstly introduced as a term in 1990 by Caudell (2). He has used this technology in aviation industry to ensure adequate training experience. In AR, the user interacts with the virtual object, which is synchronously in conjunction with user's physical real environment. Therefore, users can see more than they can see without AR. The AR technology enables people to interact with 3D objects more easily, and therefore, decreases the cognitive load and enhances spatial skills (3). The AR technology also enables users to see some explanation about the situation at the same time and at the same perspective with the real world. (Fig. 1). There are four categories of AR (1): (1) Marker-based AR; (2) Markerless AR; (3) Projection-based AR; (4) Superimpositionbased AR. In marker-based AR, the AR is activated by a marker such as QR code, therefore needs a visual marker like camera. In markerless AR, frequently a GPS embedded in a device such as smartphone is used. The game of Pokemon-Go is an example of this type of AR. Projection-based AR send light to real world and enables interaction between the image and real world. Hologram
C-Heart: Augmented Reality of 3D Heart Anatomy
This research paper is to enable the researchers to create a unique Augmented Reality (AR) internal organ in 3D and mobile e-learning application. This mobile e-learning application will include multimedia elements such as audio, video, graphics, and text. In the other words, the AR mobile application has a trailer, realistic sound effect and 3D interactive model. From adults to children, they are active users using mobile or smartphone as a tool for communication, work, recordings, and entertainment. From that perspectives, the advantages of smartphone will be benefits for educational field, specifically in medical field as many obstacles are experienced by the students in remembering the human body organs structure. ADDIE design methodology; a standard waterfall development model is being used in this research and the data collection is done through interviews with the doctors from Banjarbaru City Hospital, Banjarbaru, Indonesia. As the result, the mobile e-learning application of Augmented Reality is developed and can be implemented to medical e-learning system, especially in Indonesia in order to upgrade the education system. Therefore, the application can facilitate the way of learning and teaching in this modern generation, especially in medical field.
Visualization Cardiac Human Anatomy using Augmented Reality Mobile Application
Augmented Reality (AR) is currently widely researched and rapidly evolving. This technology supplements the real world with composite 3D virtual objects that are integrated into the real world. This technology is very interesting and interactive. Augmented reality and Smartphone used as well as the interactive media and rarely used as a medium for the introduction of the human bodies. The aim of Cardiac Learning Detection (CLD) assists students in the medical field in understanding the concepts of learning materials presented interactively by the system, especially cardiac anatomy human bodies and is able to provide more information than delivered through conventional teaching methods. For this reason, in this research were made augmented reality on visual technique as a medium to introduce the cardiac anatomy human.
EKGAR: Augmented Reality Support for Learning of Electrocardiography (ECG) Analysis
Electrocardiography analysis is an essential part of the medical education, but also one of the most difficult disciplines to learn and master. We introduce an innovative augmented reality concept that enables medical students to combine medical theory on ECG analysis with interactive 3D representations of the human heart. Based on modern learning theories the EKGAR system aims at creating optimal flow-state scenarios in which medical students are completely immersed in playful learning experiences. Using visual markers and a ceiling mounted camera, we track the user's interaction with a 3D heart. A real-time visualization of this interaction is either projected on a wall or displayed in a HMD. Utilizing visual markers, the students can make selective slicing in the 3D heart in order to examine its insides and its arteries. Design issues, technical implementation and preliminary user evaluations, as well as the prospects of further development of techniques are discussed.
Augmented reality for closed intracardiac interventions
… for Medical Imaging …, 2006
Many intracardiac procedures can currently be performed on the heart only after it has been arrested, and the patient has been placed on cardio-pulmonary bypass. We have developed a new method for operating on multiple targets inside the beating heart, and describe a procedure for accessing them under virtual-reality (VR)-assisted image guidance that combines real-time ultrasound with a virtual model of tools, and the surgical environment acquired from pre-operative images. This paper presents preliminary results aimed at assessing the operator's ability to accurately position and staple an artificial valve to a "valve orifice" within a cardiac phantom, when guidance is performed via ultrasound alone, and with US augmented by the VR environment.
An augmented reality-supported mobile application for diagnosis of heart diseases
Nowadays, it is important to design and develop effective applications for improving solution experiences in the fields associated with studies of biomedical and health informatics. Along with rapid developments in computer and electronics technologies , that has become more important in especially twenty-first century. Moving from that, main objective of this study is to deal with the problem of heart sound analysis and disease diagnosis by using a mobile application that can perform the mentioned tasks by having also support from both virtual reality-and augmented reality-oriented components. Thanks to the using features and functions provided over the application, it is possible to analyze signals instantly and have rapid feedback over the interface supported with virtual or mixed reality objects as combining both real and virtual worlds in a common ground. The paper briefly focuses on technical background and essentials of the developed mobile system and then evaluates its performance in the context of different perspectives.
Integration of mobile augmented reality (MAR) applications into biology laboratory: Anatomic structure of the heart, 2020
The purpose of the current study is to design and develop a sample Mobile Augmented Reality (MAR) application addressing the anatomic structure of the heart in a way suitable for laboratory learning for pre-service science teachers to achieve learning by constructing information in biology instruction. The implementation of the MAR design activity was conducted with the participation of 30 pre-service teachers taking the biology laboratory course. The implementation process of the activity consists of four stages. The first stage includes the introduction of the MAR application program and marker; the second stage includes the use of the MAR application in a laboratory environment; the third stage includes the operation of dissection and the last stage includes the association of the MAR application with the operation of dissection and general evaluation. Then, semi-structured interviews were conducted by involving pre-service teachers and the data obtained from these interviews revealed that integration of heart dissection with MAR application helped the pre-service teachers to better understand the anatomic structure of the heart and the related concepts. Thus, a sample activity demonstrating how MAR, which is an instructional method with strong potential for reification and visualisation, can be integrated into the teaching of concepts in laboratory settings was developed.
Augmented Reality as a New and Innovative Learning Platform for the Medical Area
Mixed Reality [Working Title]
This research paper shows an Augmented Reality (AR) project applied to medicine. The project is crystallized through a system, based on this new technology that serves as an innovative and innovative learning platform, which, in turn, helps in both teaching and learning abstract concepts in medicine, which requires of visual and manipulable objects difficult to obtain, due to the large space they occupy in magnetic media or because of how difficult it is to get their models in physical form. The proposed system strengthens the anatomical identification process in the area of medicine, specifically in the physiological activity of the human heart. In addition, this system allows interaction with the students, through which certain body parts of the human heart are identified, and, consequently, facilitates their learning with an iterative operation. Finally, the system is focused, so that the student uses his/her sense of sight, hearing, and kinesthetic, which, together, will allow a better assimilation of knowledge.