Audio-Haptic Map: An Orientation and Mobility Aid for Individuals with Blindness (original) (raw)
Related papers
Auditory and Haptic Spatial Cognitive Representation in the Case of the Visually Impaired People
Navigating in an unknown environment is a difficult task for the visually impaired people, as they are required to rely primarily on the haptic or auditory cues, in compensation for the lack of sight. However, their orientation and mobility skills are well developed, although the process of building a solid spatial cognitive map of the environment can be rather long and sinuous. The main inquiry that emerges from this matter is whether they are able to virtually learn the architecture of an environment by adapting to the specific auditory and haptic cues that define the setting and to transfer their knowledge into real-world, physical contexts. As the spatial audio technology is capable to render individual sounds at desired locations and to design complex auditory scenarios though binaural sound synthesis, the purpose of virtual auditory environments has extended from localization tests to investigating higher-level cognitive abilities. This paper aims to investigate and discuss the most relevant studies and experiments concerning the ability of visually impaired people to adapt to novel environments, to successfully navigate them virtually by using auditory or haptic cues and to construct a mental representation of the surrounding space. The motivation underlying our research is twofold: firstly, it is aimed to contribute to documenting the way in which the visually impaired people spatially perceive the environment and secondly, to provide insights for the development of a virtual reality navigational device based on auditory or haptic (vibrotactile and kinesthetic) events. Taking into account the findings of our research on the ability of blind individuals to carry out effective cognitive tasks and spatial mental representations, we will also discuss future perspectives for the development of an assistive VR system that would facilitate navigation, orientation and overall spatial awareness.
Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind
International Journal of Human-computer Studies / International Journal of Man-machine Studies, 2008
Mental mapping of spaces is essential for the development of efficient orientation and mobility skills. Most of the information required for this mental mapping is gathered through the visual channel. People who are blind lack this information, and in consequence, they are required to use compensatory sensorial channels and alternative exploration methods. In this study, people who are blind use a virtual environment (VE) that provides haptic and audio feedback to explore an unknown space. The cognitive mapping of the space based on the VE and the subject's ability to apply this map to accomplish tasks in the real space are examined. Results show clearly that a robust and comprehensive map is constructed, contributing to successful performance in real space tasks. r
The R&D or application idea The implementation of multisensory environments on the field of map construction for individuals with visual impairments can be of great significance, particularly in the field of construction of Orientation and Mobility (O&M) aids. Information technology offers the possibility to convert the spatial information in audio, tactile or audio-tactile form. In the present article, the term audio-tactile map describes the tactile map that can be read with the use of an audio-touchpad device (e.g. IVEO or T3) exclusively. The research presented is part of a wider research conducted in the frames of the ATMAPS project. The ATMAPS project titled "Specification of symbols used on Audio-Tactile Maps for individuals with blindness" (Project No. 543316-LLP-1-2013-1-GR-KA3-KA3MP) is a project financed under the Lifelong Learning Programme (LLP). The aim of this project is the specification of symbols used in audio-tactile maps for individuals with blindness. The purpose of the research presented in this article is to investigate the user requirements of young adults with blindness regarding the information to be included/ mapped into two different types of audio-tactile maps: a) audio-tactile mobility maps of the indoors/inner space of buildings, and b) audio-tactile maps of campus (school, college or university campuses). The result of this research would be the definition of the most important information that should be included in each one of the two different types of audio-tactile maps. The state of the art Orientation and mobility in unfamiliar environment is a difficult task for individuals with visual impairments. Maps constitute an important orientation and mobility aid for individuals with visual impairments and contribute to the handling of their daily problems including autonomy, independence and quality of life (Espinosa, Ungar, Ochaita, Blades & Spencer, 1998; Jacobson, 1998). Conventional maps developed for sighted individuals are not accessible for individuals with visual impairments because they contain visual information only (Papadopoulos & Karanikolas, 2009). Therefore, individuals with visual impairments often use tactile maps to discover new environments in advance (Papadopoulos & Karanikolas, 2009) as they find it more helpful for cognitive mapping than direct experience (Caddeo, Fornara, Nenci & Piroddi, 2006). Espinosa & Ochaita (1998) showed that spatial knowledge was better when individuals with visual impairments learned specific routes with the use of tactile maps for cartographic representation than with direct experience or verbal description. The use of tactile maps provides the option to individuals with visual impairments to maintain a stable reference point (Thinus-Blanc & Gaunet, 1997) that enables allocentric coding which leads to better spatial performance and knowledge during spatial learning (Papadopoulos & Koustriava, 2011; Papadopoulos, Koustriava & Kartasidou, 2012). In case of audio-tactile maps, information can be represented by tactile graphics, audio symbols, tactile symbols, audio-tactile symbols (combined e.g. a tactile symbol that when a user touches it, he can hear additional information) and Braille labels. That allows a vast amount of information to be presented in auditory modality. Individuals with visual impairments use touch as the basic
Development of Navigation Skills through Audio Haptic Videogaming in Learners who are Blind
This study presents the development of a video game with audio and haptic interfaces that allows for the stimulation of orientation and mobility skills in people who are blind through the use of virtual environments. We evaluate the usability and the impact of the use of an audio and haptic-based videogame on the development of orientation and mobility skills in school-age learners who are blind. The results show that the interfaces used in the videogame are usable and appropriately designed, and that the haptic interface is as effective as the audio interface for orientation and mobility purposes.
A University Indoors Audio-Tactile Mobility Aid for Individuals with Blindness
K. Miesenberger et al. (Eds.): ICCHP 2014, Part II, LNCS 8548, 2014
This article presents the development of an Audio-Tactile aid in order to facilitate and enhance the spatial knowledge as well as the independent and safe movement of individuals with blindness in the University of Macedonia indoors. Moreover the developed aid provides information that helps blind individuals to obtain a cognitive image of the university indoors, plan routes they wish to track and easily identify specific locations and services. The implementation procedure of the Audio-Tactile navigation system included the following steps: 1) development of digital maps that include specific spatial information for people with blindness, 2) production of tactile maps 3) research on the readability of the tactile maps by blind individuals and development of revised tactile maps, 4) development of Audio-Tactile maps and their connection with touchpad devices, and 5) a study to derive the most appropriate locations where 10 touchpads will be installed in the university indoors.
Specification of Symbols used in Audio-tactile maps for individuals with Blindness
The R&D or application idea Teaching individuals with visual impairments (IVIs) utilizing touch and/or hearing aids, multisensory environments focused on tactile and acoustic cues, audio and tactile access to scientific content, are challenging areas for end users, teachers of individuals with blindness, psychologists, rehabilitation specialists, orientation and mobility trainers as well as designers of orientation and mobility aids. The development of Orientation and Mobility (O&M) aids and particularly the depiction of multisensory environments in the field of map construction for IVIs can be of great significance. Information technology offers the possibility to convert spatial information in audio, tactile or audio-tactile form. Therefore the benefits of tactile graphics can be combined with audio information with the use of special devices. Audio-touchpad devices are touch-sensitive pads that offer individuals with visual impairments access to the benefits of tactile maps and verbal aids simultaneously while they explore tactile graphics with their fingers. Audio-Tactile maps (AT-maps) can present a large amount of spatial information. Bibliographically, the definition of audio-tactile maps refers to a series of audio-tactile aids (for a review see Brock, 2013). In the present article, the term audio-tactile map describes the tactile map that can be read with the use of an audio-touchpad device (e.g. IVEO or T3) exclusively. Ιn the case of AT-maps, in addition to tactile symbols and braille labels, audio and audio-tactile symbols are used as well (e.g. a tactile symbol that when a user touches it, he/she can hear additional information like names and/or descriptions in audio format, etc). That means that a considerable piece of information is presented in auditory modality (e.g. street names, soundscape of locations, route descriptions, obstacles, building numbers etc.). Therefore, what needs to be carefully examined is the basic query of which information should be presented in haptic mode or with braille labels and which information should be delivered via an audio or audio-haptic mode. In practice this means that a reasoned process of defining the appropriate symbols for audio-tactile aids/ maps should be implemented. The fundamental aim of the project presented in this article is the specification of symbols to be used in AT-maps for IVIs. The ATMAPS project titled "Specification of symbols used on Audio-Tactile Maps for individuals with blindness" is a project financed under the Lifelong Learning Programme (LLP). The state of the art For individuals with visual impairments (IVIs), the sense of touch is considered as a basic modality for acquiring and selecting spatial information (Papadopoulos, 2005). The importance of the tactile aids as tools that provide spatial information is widely acknowledged (Espinosa & Ochaita, 1998; Papadopoulos & Karanikolas, 2009; Papadopoulos, Livieratos, & Boutoura, 2001). Tactile maps are often used by IVIs in order to discover to a certain degree new environments in advance (Papadopoulos & Karanikolas 2009). Tactile maps are very useful in education and training of IVIs since they can be used as tools for the identification of location, wayfinding, estimation of distance and formation of cognitive maps (Papadopoulos & Karanikolas, 2009). The contribution of tactile maps in formatting new cognitive maps or in reforming the existing ones is very important. Tactile maps can also be an extremely effective tool for representing spatial information for the orientation and mobility (O&M) of IVIs (Lawrence & Lobben, 2011).
Using Tactile Maps to Improve the Practical Spatial Knowledge of Adults who are Blind
Journal of Visual Impairment & Blindness, 1998
This study evaluated the effects of three instructional methods-direct experience, cartographic representation, and verbal description-on the spatial knowledge of 30 adults who are blind. During four sessions, the participants learned a large, complex route in Madrid that included eight landmarks. In the first session, the experimenter guided the participants along the route, and in the subsequent sessions, the participants guided the experimenter. The results showed that the participants' practical spatial knowledge was better when they learned the route with a tactile map than in either of the two other conditions.
Audio haptic videogaming for developing wayfinding skills in learners who are blind
Proceedings of the 19th international conference on Intelligent User Interfaces, 2014
Interactive digital technologies are currently being developed as a novel tool for education and skill development. Audiopolis is an audio and haptic based videogame designed for developing orientation and mobility (O&M) skills in people who are blind. We have evaluated the cognitive impact of videogame play on O&M skills by assessing performance on a series of behavioral tasks carried out in both indoor and outdoor virtual spaces. Our results demonstrate that the use of Audiopolis had a positive impact on the development and use of O&M skills in school-aged learners who are blind. The impact of audio and haptic information on learning is also discussed.
Audiotactile Maps as a Facilitating Element in Spatial Orientation and Mobility
SOCIETY. INTEGRATION. EDUCATION. Proceedings of the International Scientific Conference, 2020
Tactile graphics represent an important means to overcome or alleviate the information deficit resulting from the loss of visual perception. The research framework of the paper is focused on a primary probe into the field of application of tactile graphics in the spatial orientation of people with visual impairment in the sense of development of spatial imagination and improvement of independent movement through the use of audiotactile maps. The chosen topic is viewed from the perspective of professionals working with people with visual impairment as well as the clients with visual impairment themselves. Partial results of the study are presented, focusing on the overall attitude of people with visual impairment to tactile graphics and their application potential, which adds to the overall picture of contemporary reality in the field of tactile graphics, with an emphasis on usability in spatial orientation and independent movement. The research has shown the considerable potential o...