JU-HWAN LEE | Korean German Institute of Technology (original) (raw)

Papers by JU-HWAN LEE

the 18th International Congress on …, Jan 1, 2004

As is commonly said, music is 'language of emotions'. It is because sound is a plentiful modality... more As is commonly said, music is 'language of emotions'. It is because sound is a plentiful modality to communicate the human sensibility information. However, most researches of auditory displays were focused on improving efficiency on user's performance data such as performance time and accuracy. Recently, many of researchers in auditory displays acknowledge that individual preference and sensible satisfaction may be a more important factor than the performance data. On these grounds, in the present study, we systematically examined the attributes of sound on the sensibility dimensions constructed in our study of the sound sensibility dimensions ('Pleasure', 'Complexity', and 'Activity') and analyzed the meanings. As a result, sound sensibility dimensions depended on each sound attributes, and some sound attributes interact with one another. Consequently, the results of the present study will provide the useful possibilities of applying the affective influence in the field of auditory displays needing the development and communication of the sensibility information according to the sound attributes.

HCI International 2011Posters' Extended Abstracts, Jan 1, 2011

The present study has explored the expansibility of using everyday objects for game interface to ... more The present study has explored the expansibility of using everyday objects for game interface to provide additional multisensory stimuli. The perceived expansibility of game interfaces was investigated by measuring user various responses such as the degree of presence, immersion, and enjoyment. Offering actual sensations assumed in the virtual environment of game could enhance user experience by effectively accessing their emotions. Participants were provided with one of four output modes: basic condition, room light stimulation, chair vibration stimulation, & both light and vibration. Consequently, tactile stimulation has resulted in higher presence and immersion than visual did. The result also suggests that a gamer could experience the expanded interfaces with additional multisensory output, bringing more enjoyment. These tendencies are especially recognized for high immersive tendency group. These findings can be applied to various fields of game interface design.

Haptic and Audio Interaction Design, Jan 1, 2009

Many IT devices -such as mobile phones and PDAs -have recently started to incorporate easy-to-use... more Many IT devices -such as mobile phones and PDAs -have recently started to incorporate easy-to-use touch screens. There is an associated need for more effective user interfaces for touch screen devices that have a small screen area. One attempt to make such devices more effective and/or easy to use has come through the introduction of multimodal feedback from two or more sensory modalities. Multimodal feedback might provide even larger benefits to older adults who are often unfamiliar with recent developments in electronic devices, and may be suffering from the age-related degeneration of both cognitive and motor processes. Therefore, the beneficial effects associated with the use of multimodal feedback might be expected to be larger for older adults in perceptually and/or cognitively demanding situations. In the present study, we examined the potential benefits associated with the provision of multimodal feedback via a touch screen on older adults' performance in a demanding dualtask situation. We compared unimodal (visual) feedback with various combinations of multimodal (bimodal and trimodal) feedback. We also investigated the subjective difficulty of the task as a function of the type of feedback provided in order to evaluate qualitative usability issues. Overall, the results demonstrate that the presentation of multimodal feedback with auditory signals via a touch screen device results in enhanced performance and subjective benefits for older adults.

Advances in haptics, Jan 1, 2010

… of the 2003 International Conference on …, Jan 1, 2003

This study presents an overview of work on the effects of auditory displays on the navigation of ... more This study presents an overview of work on the effects of auditory displays on the navigation of hypertext and the results of 2 new experiments. In the present study, auditory information was pertinently mapped with the depth dimension of structural hierarchy in the hypertext. The general finding of the experiments is that auditory displays have the possibility of the redundant effect facilitating the performance on target search tasks, especially difficult target search situations in website navigation. These findings will be discussed and related to the theoretical framework of multimodality effect in the information processing theories.

Haptics: Perception, Devices and Scenarios, Jan 1, 2008

Over the last few years, a growing number of IT devices have started to incorporate touch-screen ... more Over the last few years, a growing number of IT devices have started to incorporate touch-screen technology in order to create more effective multimodal user interfaces. The use of such technology has opened up the possibility of presenting different kinds of tactile feedback (i.e., active vs. passive) to users. Here, we report 2 experiments designed to investigate the spatiotemporal constraints on the multisensory interaction between vision and touch as they relate to a user's active vs. passive interaction with a touch screen device. Our results demonstrate that when touch is active, tactile perception is less influenced by irrelevant visual stimulation than when passively touching the screen. Our results also show that vision has to lead touch by approximately 40ms in order for optimal simultaneity to be perceived, no matter whether touch is active or passive. These findings provide constraints for the future design of enhanced multimodal interfaces.

Journal on Multimodal User Interfaces, Jan 1, 2008

Proceedings of the 22nd British HCI Group Annual …, Jan 1, 2008

The last few years have seen the release of an increasing number of new IT-related devices into t... more The last few years have seen the release of an increasing number of new IT-related devices into the marketplace that have started to utilize tactile feedback. These include those devices incorporating a touch screen that make multimodal feedback incorporating the delivery of two or more sensory modalities possible. The commonly-held view is that the use of such multimodal (or multisensory) feedback, involving the presentation of information to two or more sensory modalities ought, if anything, to improve the usability, performance, and satisfaction of the interface. In particular, an especially beneficial effect of multimodal feedback might be expected in those situations that are highly perceptually and/or cognitively demanding, such as driving a car or monitoring a complex system. In the present study, we examined the potential beneficial effect of the multimodal feedback provided by a touch screen on participants' performance in a perceptually demanding dual-task situation. We compared unimodal (visual) feedback with various kinds of multimodal (bimodal and trimodal) feedback. In addition, we also investigated the consequences of varying the intensity and number of multimodal feedback signals that were presented on driver performance (Experiment 2). Overall, the results of the two experiments reported here show that the presentation of multimodal feedback results in enhanced performance and more pronounced benefits as the intensity of the feedback signals presented to the different modalities is increased.