Augmented vocational tools using real time audiovisual feedback for psychomotor skill training (original) (raw)
Related papers
Motion-Tracking Machines and Sensors: Advancing Education Technology
Graduate medical education is predominantly based on a time-based apprenticeship model, with implied acquisition of proficiency after a pre-set amount of clinical exposure. While motion metrics have been used previously to measure skill performance indicators, these assessments have largely been performed on a summative scale to describe the performance of complete tasks or procedures. By segmenting performances of interest and assessing the essential elements individually, a more comprehensive understanding of the aspects in need of improvement for a learner can be obtained. The purpose of this review is to discuss technologies applicable to motion tracking, their benefits and limitations, approaches to data processing, and potential applications based on recent improvements in this technology. Objective analysis of motion metrics may improve educational standards of learning and efficiency by both standardizing the feedback process for trainees and reducing the volume of instructors required to facilitate practice sessions. With rigorous validation and standardization, motion metric assessment may also prove useful to demonstrate competency in technical procedures as part of a comprehensive certification process.
Motion Adaptive Orientation Adjustment of a Virtual Teacher to Support Physical Task Learning
Journal of Information Processing, 2012
Watching a real teacher in a real environment from a good distance and with a clear viewing angle has a significant effect on learning physical tasks. This applies to physical-task learning in a mixed-reality environment as well. Observing and imitating body motion is important for learning some physical tasks, including spatial collaborative work. When people learn a task with physical objects, they want to try and practice the task with the actual objects. They also want to keep the referential behavior model close to them at all times. Showing the virtual teacher by using mixed-reality technology can create such an environment, and thus has been researched in this study. It is known that a virtual teacher-model's position and orientation influence (a) the number of errors, and (b) the accomplishment time in physical-task learning using mixed-reality environments. This paper proposes an automatic adjustment method governing the virtual teacher's horizontal rotation angle, so that the learner can easily observe important body motions. The method divides the whole task motion into fixed duration segments, and seeks the most important moving part of the body in each segment, and then rotates the virtual teacher to show the most important part to the learner accordingly. To evaluate the method, a generic physical-task learning experiment was conducted. The method was revealed to be effective for motions that gradually reposition the most important moving part, such as in some manufacturing and cooking tasks. This study is therefore considered likely to enhance the transference of physical-task skills.
Motion Tracking Applied in Assembly for Worker Training in different Locations
Procedia CIRP, 2016
In cooperation between a German and a Vietnamese manufacturing laboratory, activities of training for assembly are performed by support of motion tracking at similar workplaces. The assembly of bicycle e-hubs is trained with Vietnamese students to check the transfer of assembly process knowledge between distant countries. The experimental setup consists of the remote "teach-in" of assembly instructions, motion tracking on workplaces and the evaluation of student's performance. The applicability of motion tracking vs. traditional paper based instructions for initial learning is investigated.
Design and Evaluation of a Haptic Simulator for Vocational Skill Training and Assessment
—While mainstream haptics has been focusing on training elite skills, the haptic simulator described in this paper addresses a problem with a phenomenal social impact that addresses teaching of vocational skills to the growing unskilled and impoverished populations in India. This is an unconventional attempt at designing a multi-tool haptic trainer that could potentially replace traditional training tools and materials in the primary stages of vocational skill training. After an exhaustive analysis of all the tools used in the various vocational trades of the construction industry, we categorized and sorted the tools based on their properties and functions. Using this information, we designed Amrita Progressive Training Assistance using Haptic simulation (APTAH), a cost effective haptic simulator that can train the use of over nineteen hand-held and powered tools used in several vocations. The simulator provides audio, visual and haptic cues that can help the novice master the use of the tools in the absence of a human trainer. This paper also discusses the preliminary trials conducted to study training effectiveness of the haptic simulator proposed.
2012
Abstract: The students interact directly in virtual laboratory with a simulator or remote equipment, and it is desirable that the experience will be similar to a real lab. There are many ways by which a student could attain this experience -through real experimental activities or through computer human interactions. These computer based multimedia environment and cohesive with hardware. These environments offer students a means to explore, experience, express themselves, and train psychomotoric. In a Digital Electronics virtual environment, the students can posit hypotheses about a engineering concept, conduct as many experiments as they want. In this paper the virtual laboratory design based on macromedia flash (software) and hand movement detection (hardware). Have implemented a virtual lab for the user especially vocational students (SMK), making practices more interesting and interactive through user interaction with computer using a periferal with hand movement detection that p...
Learning support system reproducing finger movements in practicing nursing techniques
Nursing informatics ... : proceedings of the ... International Congress on Nursing Informatics, 2012
Heretofore, "skill proficiency" in nursing techniques has only been developed through experience. To pass that technical proficiency down to later generations, this study is intended to build a learning support system using virtual reality by reproducing finger movements used in practicing nursing techniques. For practicing blood drawing techniques, we earlier developed a prototype system that uses a finger motion capture system to acquire finger position data when a syringe is grasped. It uses the acquired data to reproduce the process of the techniques three-dimensionally. This paper outlines the prototype system and reports its effectiveness for learning after examining results of a demonstration experiment for nursing students.
VR-Based Job Training System Using Tangible Interactions
Sensors
Virtual training systems are in an increasing demand because of real-world training, which requires a high cost or accompanying risk, and can be conducted safely through virtual environments. For virtual training to be effective for users, it is important to provide realistic training situations; however, virtual reality (VR) content using VR controllers for experiential learning differ significantly from real content in terms of tangible interactions. In this paper, we propose a method for enhancing the presence and immersion during virtual training by applying various sensors to tangible virtual training as a way to track the movement of real tools used during training and virtualizing the entire body of the actual user for transfer to a virtual environment. The proposed training system connects virtual and real-world spaces through an actual object (e.g., an automobile) to provide the feeling of actual touch during virtual training. Furthermore, the system measures the posture of...
Real time system for gesture tracking in psycho-motorial rehabilitation
In the context of the research activities of the Signal and Images Lab of ISTI-CNR, a system is under development for real-time gesture tracking, to be used in active well-being self-assessment activities and in particular applied to medical coaching and music-therapy. The system uses a video camera, a FireWire digitalization board, and a computer running own developed software. During the test sessions a person freely moves his body inside a specifically designed room. The developed algorithms can extrapolate features from the human figure, such us spatial position, arms and legs angles etc. Through the developed system the operator can link these features to sounds synthesized in real time, following a predefined schema. The system latency is very low thanks to the use of Mac OS X native libraries (CoreImage, CoreAudio). The resulting augmented interaction with the environment could help to improve the contact with reality in young subjects affected by autism spectrum disorders (A...
USER CENTERED DESIGN APPLIED TO THE IMPROVEMENT OF FINE MOTOR SKILLS
IMECE2018-88407, 2018
This paper reports the development of a method to improve practical skills. The developed method arises from the observations made to the second-year students of Medicine degree at the National Autonomous University of Mexico (UNAM) in order to improve the learning of practical skills used in the “Introduction to Surgery” course. However, the results obtained can be extrapolated to any profession that requires the usage of manual tools or fine and precise movements of hands. In the case of engineering, the proposed method can be applied to basic courses in electronics, technical drawing, manufacturing engineering, among others. As well as it can be used for specialized training in tasks such as welding, conventional machining, handling of hazardous materials or any other manual activity that requires precision. As a result, a methodology is presented to improve the learning of fine motor skills in a person, this allows developing of his/her professional activities in a fast and accurate way.
ATELIER – ASSISTIVE TECHNOLOGIES FOR LEARNING, INTEGRATION AND REHABILITATION
A special needs individual is a broad term used to describe a person with a behavioural or emotional disorder, physical disability or learning disability. Many individuals with special needs are limited in verbal communication, or in many cases non-verbal, making communication and learning a challenging task. Additionally, new forms of communication based on technology aren´t designed for them, making them increasingly isolated in social and educational terms. In spite of this, and fortunately, new forms of interaction do exist and they enable these particular users to access knowledge and provide them with the ability to interact with others, undertaking otherwise impossible. In this project the technology used will not be an end in itself but only a way to " drop " the mouse/keyboard paradigm making use of affordable devices available in the market that could be adopted by people with special needs that are unable to apply the traditional forms of interaction, thus assisting people in their education, integration and rehabilitation activities.