Multimodal tools and interfaces for the intercommunication between visually impaired and "deaf and mute" people (original) (raw)
The present paper presents the framework and the results of Project 2: "Multimodal tools and interfaces for the intercommunication between visually impaired and "deaf and mute" people", which has been developed during the eNTERFACE-2006 summer workshop in the context of the SIMILAR NoE. The developed system aims to provide alternative tools and interfaces to blind and deaf-and-mute persons so as to enable their intercommunication as well as their interaction with the computer. All the involved technologies are integrated into a treasure hunting game application that is jointly played by the blind and deaf-and-mute user. The reason for choosing to integrate the multimodal interfaces into a game application is that it serves both as an entertainment and as a pleasant education tool to its users. The proposed application integrates haptics, audio, visual output as well as computer vision, sign language analysis and synthesis, speech recognition and synthesis, in order to provide an interactive environment where the blind and deaf and mute users can collaborate in order to play the treasure hunting game.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.