A multi-trainee architecture for haptic hands-on training (original) (raw)
Related papers
Collaborative Hands-on Training on Haptic Simulators
Proceedings of the 2019 3rd International Conference on Virtual and Augmented Reality Simulations
Medical trainees are required to acquire sufficient skills before touching a real patient. Nowadays, haptic simulators provide an effective solution but they do not facilitate an active supervision by a trainer who should show the right gestures in terms of motions and forces to apply, in the simulated environment. Dual user training systems aim at this purpose. Even though they permit a cooperative training, they generally dot not enable efficient demonstration/evaluation modes where the user who observes the person performing a manipulation is also able to feel the interaction forces, not only the motion. In [1], we introduced the Energy Shared Control (ESC) architecture aiming at providing the latter function. It is modeled with the Port Hamiltonian framework and it embeds a Time Domain Passivity Controller, to compose a one degree-of-freedom (dof) dualuser haptic system for hands-on training. In this paper, we extend it to three dof with three identical haptic devices. Experiments bring information about its performance.
Towards a Dual-User Haptic Training System User Feedback Setup
Lecture Notes in Computer Science, 2020
This paper introduces preliminary works on building an experimental end-user evaluation for dual-user haptic systems for hands-on training. Such systems bring together the advantages of haptic computerbased training systems and those of supervised training where an expert trainer actively helps in the learning process. The first results mainly permitted to highlight several technical and organizational issues to overcome in a close future. The objective of this project is to test other architectures such as those listed in the state-of-the-art section, to provide comparative conclusions about the pros and cons of each one.
A Framework for the Design of a Novel Haptic-Based Medical Training Simulator
IEEE Transactions on Information Technology in Biomedicine, 2008
This paper presents a framework for the design of a haptic-based medical ultrasound training simulator. The proposed simulator is composed of a PHANToM haptic device and a modular software package that allows for visual feedback and kinesthetic interactions between an operator and multimodality image databases. The system provides real-time ultrasound images in the same fashion as a typical ultrasound machine, enhanced with corresponding augmented computerized tomographic (CT) and/or MRI images. The proposed training system allows trainees to develop radiology techniques and knowledge of the patient's anatomy with minimum practice on live patients, or in places or at times when radiology devices or patients with rare cases may not be available. Low-level details of the software structure that can be migrated to other similar medical simulators are described. A preliminary human factors study, conducted on the prototype of the developed simulator, demonstrates the potential usage of the system for clinical training.
The role of haptics in medical training simulators: a survey of the state of the art
Haptics, IEEE Transactions on, 2011
This review paper discusses the role of haptics within virtual medical training applications, particularly, where it can be used to aid a practitioner to learn and practice a task. The review summarizes aspects to be considered in the deployment of haptics technologies in medical training. First, both force/torque and tactile feedback hardware solutions that are currently produced commercially and in academia are reviewed, followed by the available haptics-related software and then an in-depth analysis of medical training simulations that include haptic feedback. The review is summarized with scrutiny of emerging technologies and discusses future directions in the field.
An Energy-Based Approach for n-d.o.f. Passive Dual-User Haptic Training Systems
Robotica, 2019
SUMMARYThis paper introduces a dual-user training system whose design is based on an energetic approach. This kind of system is useful for supervised hands-on training where a trainer interacts with a trainee through two haptic devices, in order to practice on a manual task performed on a virtual or teleoperated robot (e.g., for an Minimally Invasive Surgery (MIS) task in a surgical context). This paper details the proof of stability of an Energy Shared Control (ESC) architecture we previously introduced for one degree of freedom (d.o.f.) devices. An extension to multiple degrees of freedom is proposed, along with an enhanced version of the Adaptive Authority Adjustment function. Experiments are carried out with 3 d.o.f. haptic devices in free motion as well as in contact contexts in order to show the relevance of this architecture.
2018
This paper introduces the development of exercises to be embedded in a lightweight laparoscopic haptic simulator to help surgeons starting their training to Minimal Invasive Surgery (MIS) gestures. These exercises were created by observing professionals in operation rooms and by isolating key gestures, which have been combined to create desired trajectories with a slow learning curve. These exercises combine memory, new gestures, new environments and new visual feedback so that the trainees’ cognitive load remains low. This favors an effective training. Hence, the simulator displays a simple 3D virtual environment in order to focus on the gestures and trajectories, performed on an haptic device by means of real MIS tool handles. Its ludic dimension, which make it a Serious Game, should help users to make progress in their first gesture training in order to continue on more evolved medical simulators. This paper introduces the software architecture analysis and the methods used for c...
Simulation and Training with Haptic Feedback - A Review
Recent advances in haptic technology have broadened the applicability spectrum of haptic devices and the potential of prototype development for commerce. This article provides a review of the available haptic technologies and associated hardware/software characteristics. We compare haptic devices from the hardware perspective. We present the main features of existing haptic APIs as well as the trend in haptic applications development. We examine several case studies to demonstrate the effectiveness of haptic devices.
Shared Control in Haptic Systems for Performance Enhancement and Training
Journal of Dynamic Systems Measurement and Control-transactions of The Asme, 2006
This paper presents a shared-control interaction paradigm for haptic interface systems, with experimental data from two user studies. Shared control, evolved from its initial telerobotics applications, is adapted as a form of haptic assistance in that the haptic device contributes to execution of a dynamic manual target-hitting task via force commands from an automatic controller. Compared to haptic virtual environments, which merely display the physics of the virtual system, or to passive methods of haptic assistance for performance enhancement based on virtual fixtures, the shared-control approach offers a method for actively demonstrating desired motions during virtual environment interactions. The paper presents a thorough review of the literature related to haptic assistance. In addition, two experiments were conducted to independently verify the efficacy of the shared-control approach for performance enhancement and improved training effectiveness of the task. In the first experiment, shared control is found to be as effective as virtual fixtures for performance enhancement, with both methods resulting in significantly better performance in terms of time between target hits for the manual target-hitting task than sessions where subjects feel only the forces arising from the mass-spring-damper system dynamics. Since shared control is more general than virtual fixtures, this approach may be extremely beneficial for performance enhancement in virtual environments. In terms of training enhancement, shared control and virtual fixtures were no better than practice in an unassisted mode. For manual control tasks, such as the one described in this paper, shared control is beneficial for performance enhancement, but may not be viable for enhancing training effectiveness.
Bimanual Haptic Simulator for Medical Training: System Architecture and Performance Measurement
In this paper we present a simulator for two-handed haptic interaction. As an application example, we chose a medical scenario that requires simultaneous interaction with a hand and a needle on a simulated patient. The system combines bimanual haptic interaction with a physics-based soft tissue simulation. To our knowledge the combination of finite element methods for the simulation of deformable objects with haptic rendering is seldom addressed, especially with two haptic devices in a non-trivial scenario. Challenges are to find a balance between real-time constraints and high computational demands for fidelity in simulation and to synchronize data between system components. The system has been successfully implemented and tested on two different hardware platforms: one mobile on a laptop and another stationary on a semi-immersive VR system. These two platforms have been chosen to demonstrate scaleability in terms of fidelity and costs. To compare performance and estimate latency, we measured timings of update loops and logged event-based timings of several components in the software.
An energy based approach for passive dual-user haptic training systems
2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016
This paper introduces a new controller for dualuser training systems, designed by way of an energy based approach. Dual-user training systems are useful for supervised hands-on training when a trainer shows the right gestures to a trainee and where the forces to apply on the tools are difficult to dose. An energy shared control (ESC) based architecture is proposed, based on an intrinsically passive authority sharing mechanism which is enhanced to provide a full force feedback to both users. As this enhancement may violate the natural passivity of the system, a passivity controller is introduced. A task based comparative study with two other dual-user schemes (Complementary Linear Combination (CLC) and Masters Correspondence with Environment Transfer (MECT) from [1] is conducted, which reveals analogous performances. Real-time experiments demonstrate good tracking performances.