Haptic User Interfaces and Practice-based Learning for Minimally Invasive Surgical Training (original) (raw)
Related papers
Haptic User Interface and Practice-based Learning for Minimally Invasive Surgerical Training
arXiv: Human-Computer Interaction, 2011
Recent advances in haptic hardware and software technology have generated interest in novel, multimodal interfaces based on the sense of touch. Such interfaces have the potential to revolutionize the way we think about human-computer interaction and open new possibilities for simulation and training in a variety of fields. In this paper we review several frameworks, APIs and toolkits for haptic user interface development. We explore these software components focusing on minimally invasive surgical simulation systems. In the area of medical diagnosis, there is a strong need to determine mechanical properties of biological tissue for both histological and pathological considerations. Therefore we focus on the development of affordable visuo-haptic simulators to improve practice-based education in this area. We envision such systems, designed for the next generations of learners that enhance their knowledge in connection with real-life situations while they train in mandatory safety conditions.
A survey of visuo-haptic simulation in surgical training
Surgeons must accomplish complex technical and intellectual tasks that can generate unexpected and serious challenges with little or no room for error. In the last decade, computer simulations have played an increasing role in surgical training, pre-operative planning, and biomedical research. Specifically, visuo-haptic simulations have been the focus of research to develop advanced e-Learning systems facilitating surgical training. Visuo-haptic simulations combine the tactile sense with visual information and provide realistic training scenarios, to gain, improve, and assess resident and expert surgeons' skills and knowledge. Choosing the suitable haptic hardware, API or framework for developing a visuo-haptic e-Learning system is an important decision that is based on several factors. We present a survey of the most popular hardware and software components for haptic based laparoscopic surgical training system development. We also discuss the assessment and integration of such systems as e-Learning components in hospitals.
Haptics in minimally invasive surgical simulation and training
IEEE Computer Graphics and Applications, 2004
M inimally invasive surgery has revolutionized many surgical procedures over the last few decades. MIS is performed using a small video camera, a video display, and a few customized surgical tools. In procedures such as gall bladder removal (laparoscopic cholesystectomy), surgeons insert a camera and long slender tools into the abdomen through small skin incisions to explore the internal cavity and manipulate organs from outside the body as they view their actions on a video display. Because the development of minimally invasive techniques has reduced the sense of touch compared to open surgery, surgeons must rely more on the feeling of net forces resulting from tool-tissue interactions and need more training to successfully operate on patients. Although tissue color and texture convey important anatomical information visually, touch is still critical in identifying otherwise obscure tissue planes, blood vessels, and abnormal tissues, and gauging optimal forces to be applied for tissue manipulation. Much of the art of MIS and training for a particular procedure depend on the education and refinement of the trainee's haptic sensorimotor system.
IEEE Computer Graphics and Applications, 2004
M inimally invasive surgery has revolutionized many surgical procedures over the last few decades. MIS is performed using a small video camera, a video display, and a few customized surgical tools. In procedures such as gall bladder removal (laparoscopic cholesystectomy), surgeons insert a camera and long slender tools into the abdomen through small skin incisions to explore the internal cavity and manipulate organs from outside the body as they view their actions on a video display. Because the development of minimally invasive techniques has reduced the sense of touch compared to open surgery, surgeons must rely more on the feeling of net forces resulting from tool-tissue interactions and need more training to successfully operate on patients. Although tissue color and texture convey important anatomical information visually, touch is still critical in identifying otherwise obscure tissue planes, blood vessels, and abnormal tissues, and gauging optimal forces to be applied for tissue manipulation. Much of the art of MIS and training for a particular procedure depend on the education and refinement of the trainee's haptic sensorimotor system.
Towards Open-Source, Low-Cost Haptics for Surgery Simulation
Studies in health technology and informatics, 2014
In minimally invasive surgery (MIS), virtual reality (VR) training systems have become a promising education tool. However, the adoption of these systems in research and clinical settings is still limited by the high costs of dedicated haptics hardware for MIS. In this paper, we present ongoing research towards an open-source, low-cost haptic interface for MIS simulation. We demonstrate the basic mechanical design of the device, the sensor setup as well as its software integration.
A Review of Simulators with Haptic Devices for Medical Training
Journal of Medical Systems, 2016
Medical procedures often involve the use of the tactile sense to manipulate organs or tissues by using special tools. Doctors require extensive preparation in order to perform them successfully; for example, research shows that a minimum of 750 operations are needed to acquire sufficient experience to perform medical procedures correctly. Haptic devices have become an important training alternative and they have been considered to improve medical training because they let users interact with virtual environments by adding the sense of touch to the simulation. Previous articles in the field state that haptic devices enhance the learning of surgeons compared to current training environments used in medical schools (corpses, animals, or synthetic skin and organs). Consequently, virtual environments use haptic devices to improve realism. The goal of this paper is to provide a state of the art review of recent medical simulators that use haptic devices. In particular we focus on stitching, palpation, dental procedures, This article is part of the Topical Collection on Education & Training
Medical Simulation and Training:“Haptic” Liver
Tactile perception plays an important role in medical simulation and training, specifically in surgery. The surgeon must feel organic tissue hardness, evaluate anatomical structures, measure tissue properties, and apply appropriate force control actions for safe tissue manipulation. Development of novel cost effective haptic-based simulators and their introduction in the minimally invasive surgery learning cycle can absorb the learning curve for residents. Receiving pre-training in a core set of surgical skills can reduce skill acquisition time and risks. We present the development of a cost-effective visuo-haptic simulator for the liver tissue, designed to improve practice-based education in minimally invasive surgery. Such systems can positively affect the next generations of learners by enhancing their knowledge in connection with real-life situations while they train in mandatory safe conditions.
The use of haptics in medical applications
2004
Explains the need for haptics (feeling of touch) in medical simulation systems. Describes a variety of laparoscopic training systems and other surgical simulators. Highlights the Reachin Technologies AB Application Programming Interface (API) which is a software tool that significantly speeds up the development of surgical simulators.
A Framework for the Design of a Novel Haptic-Based Medical Training Simulator
IEEE Transactions on Information Technology in Biomedicine, 2008
This paper presents a framework for the design of a haptic-based medical ultrasound training simulator. The proposed simulator is composed of a PHANToM haptic device and a modular software package that allows for visual feedback and kinesthetic interactions between an operator and multimodality image databases. The system provides real-time ultrasound images in the same fashion as a typical ultrasound machine, enhanced with corresponding augmented computerized tomographic (CT) and/or MRI images. The proposed training system allows trainees to develop radiology techniques and knowledge of the patient's anatomy with minimum practice on live patients, or in places or at times when radiology devices or patients with rare cases may not be available. Low-level details of the software structure that can be migrated to other similar medical simulators are described. A preliminary human factors study, conducted on the prototype of the developed simulator, demonstrates the potential usage of the system for clinical training.