Arto Hippula - Academia.edu (original) (raw)

Papers by Arto Hippula

Research paper thumbnail of Haptic Mediation through Artificial Intelligence: Magnetorheological Fluid as Vibrotactile Signal Mediator

Research paper thumbnail of Haptic Mediation through Artificial Intelligence: Magnetorheological Fluid as Vibrotactile Signal Mediator

2022 Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS (DTIP), Jul 11, 2022

Research paper thumbnail of Ultrasound Feedback for Mid-air Gesture Interaction in Vibrating Environment

AHFE International

Mid-air ultrasound skin stimulation is a known technology used to provide haptic feedback for tou... more Mid-air ultrasound skin stimulation is a known technology used to provide haptic feedback for touchless communication. Even though some in-car interaction already takes place with mid-air gestures, the utilization of this type of feedback is still uncommon. In this study we evaluated how environmental vibration affects the recognition of ultrasound haptic feedback exposed to the driver’s hand. Four skin stimulation shapes of two durations were projected onto the driver’s palm while driving a simulator within a laboratory setting and in a test vehicle on a closed track. Results show that road vibration had a very little effect on driver’s ability to recognize the shape of the stimulation, but, some shapes may require additional training to be recognized consistently. Our findings also suggest that ultrasound haptic output can remain an efficient feedback source even in noisy vibration environments, (i.e., on the road) as compared to conventional vibrotactile feedback, thus drivers ca...

Research paper thumbnail of Creating Tactile Interaction Surfaces for the Origo Steering Wheel Concept using CWI and EHWs

Intelligent Human Systems Integration (IHSI 2022) Integrating People and Intelligent Systems

As the automotive industry transitions to electric and autonomous vehicles (SAE 2-3) more and mor... more As the automotive industry transitions to electric and autonomous vehicles (SAE 2-3) more and more information needs to be reviewed by the driver in real-time. Conventional information presentation techniques are not ideal for reviewing this type of information as it lacks multimodal and cross modal presentation. Haptics, one of the key interaction modalities, is often over-looked as it is considered non-functional in a vibration heavy environment, such as a moving vehicle. However, modern techniques of generating, mediating, and delivering tactile feedback have greatly improved in the last five years. Localizing techniques such as Constructive Wave Interference (CWI) and mediation technique of Embedded Haptic Waveguides (EHWs) can be combined to create reliable and consistent tactile output in even the most challenging environments. In this research authors utilize these techniques to create tactile feedback zones on the steering wheel, which can be used to relay haptic signals to ...

Research paper thumbnail of Usability testing of haptic and auditory interfaces for visually impaired children

Research paper thumbnail of Experiences on haptic interfaces for visually impaired young children

Proceedings of the 6th international conference on Multimodal interfaces - ICMI '04, 2004

... General Terms Design, Experimentation, Human Factors. Keywords Visually impairedchildren, bli... more ... General Terms Design, Experimentation, Human Factors. Keywords Visually impairedchildren, blind children, Phantom, haptic feedback, learning, haptic environment 1. INTRODUCTION People with disabilities have problems with computers. ...

Research paper thumbnail of Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback

IEEE Transactions on Haptics, 2009

Three novel interaction methods were designed for reading six-dot Braille characters from the tou... more Three novel interaction methods were designed for reading six-dot Braille characters from the touchscreen of a mobile device. A prototype device with a piezoelectric actuator embedded under the touchscreen was used to create tactile feedback. The three interaction methods, scan, sweep, and rhythm, enabled users to read Braille characters one at a time either by exploring the characters dot by dot or by sensing a rhythmic pattern presented on the screen. The methods were tested with five blind Braille readers as a proof of concept. The results of the first experiment showed that all three methods can be used to convey information as the participants could accurately (91-97 percent) recognize individual characters. In the second experiment, the presentation rate of the most efficient and preferred method, the rhythm, was varied. A mean recognition accuracy of 70 percent was found when the speed of presenting a single character was nearly doubled from the first experiment. The results showed that temporal tactile feedback and Braille coding can be used to transmit single-character information while further studies are still needed to evaluate the presentation of serial information, i.e., multiple Braille characters. Index Terms-Assistive technologies for persons with disabilities, haptic I/O, input devices and strategies, interaction styles.

Research paper thumbnail of ESD-riskien tunnistaminen ja hallinta erilaisissa työkohteissa

Research paper thumbnail of Developing Intelligent Multimodal IVI Systems to Reduce Driver Distraction

As research into autonomous vehicles gets mainstream, automobile manufacturers are trying to rein... more As research into autonomous vehicles gets mainstream, automobile manufacturers are trying to reinvent the ways we operate and interact with our vehicles. This is now more evident in the central instrument clusters than ever before. While some manufacturers are focusing on adding touchscreens to replace most in-vehicular infotainment (IVI) controls, others are trying to make the IVIS smarter and multimodal. Unfortunately, the lack of reliable tactile feedback for touchscreen interaction in IVI systems can be a major issue. Although this may not be a critical flaw in mobile device interaction, it can be a dangerous limitation for in-car systems where visual distraction can be fatal. For this reason, our research* is focused on exploring and developing new methods of providing tactile actuation using both vibrotactile and pneumatic feedback techniques.

Research paper thumbnail of Testing Usability of Multimodal with Visually Impaired Children

Research paper thumbnail of Actuation Plate for Multi-Layered in-Vehicle Control Panel

High-fidelity localized feedback has the potential of providing new and unique levels of interact... more High-fidelity localized feedback has the potential of providing new and unique levels of interaction with a given device. Achieving this in a cost-effective reproducible manner has been a challenge in modern technology. Past experiments have shown that by using the principles of constructive wave interference introduced by time offsets it is possible to achieve a position of increased vibration displacement at any given location. As new interface form factors increasingly incorporate curved surfaces, we now show that these same techniques can successfully be applied and mechanically coupled with a universal actuation plate.

Research paper thumbnail of MICOLE D 14: Final User Requiremants and Design Recommendations

SwePub titelinformation: MICOLE D 14: Final User Requiremants and Design Recommendations [Elektro... more SwePub titelinformation: MICOLE D 14: Final User Requiremants and Design Recommendations [Elektronisk resurs].

Research paper thumbnail of Haptic Actuation Plate for Multi-Layered In-Vehicle Control Panel

High-fidelity localized feedback has the potential of providing new and unique levels of interact... more High-fidelity localized feedback has the potential of providing new and unique levels of interaction with a given device. Achieving this in a cost-effective reproducible manner has been a challenge in modern technology. Past experiments have shown that by using the principles of constructive wave interference introduced by time offsets it is possible to achieve a position of increased vibration displacement at any given location. As new interface form factors increasingly incorporate curved surfaces, we now show that these same techniques can successfully be applied and mechanically coupled with a universal actuation plate.

Research paper thumbnail of Future user interfaces are developed today

A good user interface is a necessity for producing successful products in the future. Rapidly cha... more A good user interface is a necessity for producing successful products in the future. Rapidly changing user expectations and technologies challenge companies to compete with innovative solutions. The future-oriented companies are decidedly ahead of the field. However, making use of methods of advanced research and procedures appears to be difficult for companies. VTT Automation has taken up the challenge to combine methods of research into future developments with methods of advanced product and user-interface development so that they supplement good industrial product development practices. The result is a toolbox of practical methods applicable in different fields of industrial development.

Research paper thumbnail of Origo Steering Wheel: Improving Tactile Feedback for Steering Wheel IVIS Interaction using Embedded Haptic Wave Guides and Constructive Wave Interference

13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Automotive industry is evolving through "Electrification", "Autonomous Driving Systems", and "Rid... more Automotive industry is evolving through "Electrification", "Autonomous Driving Systems", and "Ride Sharing", and all three vectors of change are taking place in the same timeframe. One of the key challenges during this transition will be to present critical information collected through additional onboard systems, to the driver and passengers, enhancing multimodal in-vehicle interaction. In this research authors suggest creating embedded tactile-feedback zones on the steering wheel itself, which can be used to relay haptic signals to the driver with little to no visual demand. Using "Haptic Mediation" techniques such as 3D-printed Embedded Haptic Waveguides (EHWs) and Constructive Wave Interference (CWI), the authors were able to provide reliable tactile feedback in normal driving environments. Signal analysis shows that EHWs and CWI can reduce haptic signal distortion and attenuation in noisy environments and during user testing, this technique yielded better driving performance and required lower cognitive load while completing common IVIS tasks. CCS CONCEPTS • Human-centered computing; • Human Computer Interaction (HCI); • Interactive Systems and Tools;

Research paper thumbnail of Testing Usability of Multimodal Applications with Visually Impaired Children

IEEE Multimedia, 2006

Testing multimodal applications with visually impaired children requires specific testing methods... more Testing multimodal applications with visually impaired children requires specific testing methods and procedures. In this article, we used a SensAble Phantom device to produce haptic feedback together with stereo sound and visual feedback. We also experimented with low-cost haptic devices, such as force-feedback game controllers and tactile-feedback devices. Here we discuss how to conduct usability testing for multimodal applications with

Research paper thumbnail of Experiences on haptic interfaces for visually impaired young children

Proceedings of the 6th international conference on Multimodal interfaces - ICMI '04, 2004

Visually impaired children do not have equal opportunities to learn and play compared to sighted ... more Visually impaired children do not have equal opportunities to learn and play compared to sighted children. Computers have a great potential to correct this problem. In this paper we present a series of studies where multimodal applications were designed for a group of eleven visually impaired children aged from 3.5 to 7.5 years. We also present our testing procedure specially adapted for visually impaired young children. During the two-year project it became clear that with careful designing of the tasks and proper use of haptic and auditory features usable computing environments can be created for visually impaired children.

Research paper thumbnail of Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback

IEEE Transactions on Haptics, 2009

Three novel interaction methods were designed for reading six-dot Braille characters from the tou... more Three novel interaction methods were designed for reading six-dot Braille characters from the touchscreen of a mobile device. A prototype device with a piezoelectric actuator embedded under the touchscreen was used to create tactile feedback. The three interaction methods, scan, sweep, and rhythm, enabled users to read Braille characters one at a time either by exploring the characters dot by dot or by sensing a rhythmic pattern presented on the screen. The methods were tested with five blind Braille readers as a proof of concept. The results of the first experiment showed that all three methods can be used to convey information as the participants could accurately (91-97 percent) recognize individual characters. In the second experiment, the presentation rate of the most efficient and preferred method, the rhythm, was varied. A mean recognition accuracy of 70 percent was found when the speed of presenting a single character was nearly doubled from the first experiment. The results showed that temporal tactile feedback and Braille coding can be used to transmit single-character information while further studies are still needed to evaluate the presentation of serial information, i.e., multiple Braille characters.

Research paper thumbnail of Haptic Mediation through Artificial Intelligence: Magnetorheological Fluid as Vibrotactile Signal Mediator

Research paper thumbnail of Haptic Mediation through Artificial Intelligence: Magnetorheological Fluid as Vibrotactile Signal Mediator

2022 Symposium on Design, Test, Integration and Packaging of MEMS/MOEMS (DTIP), Jul 11, 2022

Research paper thumbnail of Ultrasound Feedback for Mid-air Gesture Interaction in Vibrating Environment

AHFE International

Mid-air ultrasound skin stimulation is a known technology used to provide haptic feedback for tou... more Mid-air ultrasound skin stimulation is a known technology used to provide haptic feedback for touchless communication. Even though some in-car interaction already takes place with mid-air gestures, the utilization of this type of feedback is still uncommon. In this study we evaluated how environmental vibration affects the recognition of ultrasound haptic feedback exposed to the driver’s hand. Four skin stimulation shapes of two durations were projected onto the driver’s palm while driving a simulator within a laboratory setting and in a test vehicle on a closed track. Results show that road vibration had a very little effect on driver’s ability to recognize the shape of the stimulation, but, some shapes may require additional training to be recognized consistently. Our findings also suggest that ultrasound haptic output can remain an efficient feedback source even in noisy vibration environments, (i.e., on the road) as compared to conventional vibrotactile feedback, thus drivers ca...

Research paper thumbnail of Creating Tactile Interaction Surfaces for the Origo Steering Wheel Concept using CWI and EHWs

Intelligent Human Systems Integration (IHSI 2022) Integrating People and Intelligent Systems

As the automotive industry transitions to electric and autonomous vehicles (SAE 2-3) more and mor... more As the automotive industry transitions to electric and autonomous vehicles (SAE 2-3) more and more information needs to be reviewed by the driver in real-time. Conventional information presentation techniques are not ideal for reviewing this type of information as it lacks multimodal and cross modal presentation. Haptics, one of the key interaction modalities, is often over-looked as it is considered non-functional in a vibration heavy environment, such as a moving vehicle. However, modern techniques of generating, mediating, and delivering tactile feedback have greatly improved in the last five years. Localizing techniques such as Constructive Wave Interference (CWI) and mediation technique of Embedded Haptic Waveguides (EHWs) can be combined to create reliable and consistent tactile output in even the most challenging environments. In this research authors utilize these techniques to create tactile feedback zones on the steering wheel, which can be used to relay haptic signals to ...

Research paper thumbnail of Usability testing of haptic and auditory interfaces for visually impaired children

Research paper thumbnail of Experiences on haptic interfaces for visually impaired young children

Proceedings of the 6th international conference on Multimodal interfaces - ICMI '04, 2004

... General Terms Design, Experimentation, Human Factors. Keywords Visually impairedchildren, bli... more ... General Terms Design, Experimentation, Human Factors. Keywords Visually impairedchildren, blind children, Phantom, haptic feedback, learning, haptic environment 1. INTRODUCTION People with disabilities have problems with computers. ...

Research paper thumbnail of Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback

IEEE Transactions on Haptics, 2009

Three novel interaction methods were designed for reading six-dot Braille characters from the tou... more Three novel interaction methods were designed for reading six-dot Braille characters from the touchscreen of a mobile device. A prototype device with a piezoelectric actuator embedded under the touchscreen was used to create tactile feedback. The three interaction methods, scan, sweep, and rhythm, enabled users to read Braille characters one at a time either by exploring the characters dot by dot or by sensing a rhythmic pattern presented on the screen. The methods were tested with five blind Braille readers as a proof of concept. The results of the first experiment showed that all three methods can be used to convey information as the participants could accurately (91-97 percent) recognize individual characters. In the second experiment, the presentation rate of the most efficient and preferred method, the rhythm, was varied. A mean recognition accuracy of 70 percent was found when the speed of presenting a single character was nearly doubled from the first experiment. The results showed that temporal tactile feedback and Braille coding can be used to transmit single-character information while further studies are still needed to evaluate the presentation of serial information, i.e., multiple Braille characters. Index Terms-Assistive technologies for persons with disabilities, haptic I/O, input devices and strategies, interaction styles.

Research paper thumbnail of ESD-riskien tunnistaminen ja hallinta erilaisissa työkohteissa

Research paper thumbnail of Developing Intelligent Multimodal IVI Systems to Reduce Driver Distraction

As research into autonomous vehicles gets mainstream, automobile manufacturers are trying to rein... more As research into autonomous vehicles gets mainstream, automobile manufacturers are trying to reinvent the ways we operate and interact with our vehicles. This is now more evident in the central instrument clusters than ever before. While some manufacturers are focusing on adding touchscreens to replace most in-vehicular infotainment (IVI) controls, others are trying to make the IVIS smarter and multimodal. Unfortunately, the lack of reliable tactile feedback for touchscreen interaction in IVI systems can be a major issue. Although this may not be a critical flaw in mobile device interaction, it can be a dangerous limitation for in-car systems where visual distraction can be fatal. For this reason, our research* is focused on exploring and developing new methods of providing tactile actuation using both vibrotactile and pneumatic feedback techniques.

Research paper thumbnail of Testing Usability of Multimodal with Visually Impaired Children

Research paper thumbnail of Actuation Plate for Multi-Layered in-Vehicle Control Panel

High-fidelity localized feedback has the potential of providing new and unique levels of interact... more High-fidelity localized feedback has the potential of providing new and unique levels of interaction with a given device. Achieving this in a cost-effective reproducible manner has been a challenge in modern technology. Past experiments have shown that by using the principles of constructive wave interference introduced by time offsets it is possible to achieve a position of increased vibration displacement at any given location. As new interface form factors increasingly incorporate curved surfaces, we now show that these same techniques can successfully be applied and mechanically coupled with a universal actuation plate.

Research paper thumbnail of MICOLE D 14: Final User Requiremants and Design Recommendations

SwePub titelinformation: MICOLE D 14: Final User Requiremants and Design Recommendations [Elektro... more SwePub titelinformation: MICOLE D 14: Final User Requiremants and Design Recommendations [Elektronisk resurs].

Research paper thumbnail of Haptic Actuation Plate for Multi-Layered In-Vehicle Control Panel

High-fidelity localized feedback has the potential of providing new and unique levels of interact... more High-fidelity localized feedback has the potential of providing new and unique levels of interaction with a given device. Achieving this in a cost-effective reproducible manner has been a challenge in modern technology. Past experiments have shown that by using the principles of constructive wave interference introduced by time offsets it is possible to achieve a position of increased vibration displacement at any given location. As new interface form factors increasingly incorporate curved surfaces, we now show that these same techniques can successfully be applied and mechanically coupled with a universal actuation plate.

Research paper thumbnail of Future user interfaces are developed today

A good user interface is a necessity for producing successful products in the future. Rapidly cha... more A good user interface is a necessity for producing successful products in the future. Rapidly changing user expectations and technologies challenge companies to compete with innovative solutions. The future-oriented companies are decidedly ahead of the field. However, making use of methods of advanced research and procedures appears to be difficult for companies. VTT Automation has taken up the challenge to combine methods of research into future developments with methods of advanced product and user-interface development so that they supplement good industrial product development practices. The result is a toolbox of practical methods applicable in different fields of industrial development.

Research paper thumbnail of Origo Steering Wheel: Improving Tactile Feedback for Steering Wheel IVIS Interaction using Embedded Haptic Wave Guides and Constructive Wave Interference

13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Automotive industry is evolving through "Electrification", "Autonomous Driving Systems", and "Rid... more Automotive industry is evolving through "Electrification", "Autonomous Driving Systems", and "Ride Sharing", and all three vectors of change are taking place in the same timeframe. One of the key challenges during this transition will be to present critical information collected through additional onboard systems, to the driver and passengers, enhancing multimodal in-vehicle interaction. In this research authors suggest creating embedded tactile-feedback zones on the steering wheel itself, which can be used to relay haptic signals to the driver with little to no visual demand. Using "Haptic Mediation" techniques such as 3D-printed Embedded Haptic Waveguides (EHWs) and Constructive Wave Interference (CWI), the authors were able to provide reliable tactile feedback in normal driving environments. Signal analysis shows that EHWs and CWI can reduce haptic signal distortion and attenuation in noisy environments and during user testing, this technique yielded better driving performance and required lower cognitive load while completing common IVIS tasks. CCS CONCEPTS • Human-centered computing; • Human Computer Interaction (HCI); • Interactive Systems and Tools;

Research paper thumbnail of Testing Usability of Multimodal Applications with Visually Impaired Children

IEEE Multimedia, 2006

Testing multimodal applications with visually impaired children requires specific testing methods... more Testing multimodal applications with visually impaired children requires specific testing methods and procedures. In this article, we used a SensAble Phantom device to produce haptic feedback together with stereo sound and visual feedback. We also experimented with low-cost haptic devices, such as force-feedback game controllers and tactile-feedback devices. Here we discuss how to conduct usability testing for multimodal applications with

Research paper thumbnail of Experiences on haptic interfaces for visually impaired young children

Proceedings of the 6th international conference on Multimodal interfaces - ICMI '04, 2004

Visually impaired children do not have equal opportunities to learn and play compared to sighted ... more Visually impaired children do not have equal opportunities to learn and play compared to sighted children. Computers have a great potential to correct this problem. In this paper we present a series of studies where multimodal applications were designed for a group of eleven visually impaired children aged from 3.5 to 7.5 years. We also present our testing procedure specially adapted for visually impaired young children. During the two-year project it became clear that with careful designing of the tasks and proper use of haptic and auditory features usable computing environments can be created for visually impaired children.

Research paper thumbnail of Methods for Presenting Braille Characters on a Mobile Device with a Touchscreen and Tactile Feedback

IEEE Transactions on Haptics, 2009

Three novel interaction methods were designed for reading six-dot Braille characters from the tou... more Three novel interaction methods were designed for reading six-dot Braille characters from the touchscreen of a mobile device. A prototype device with a piezoelectric actuator embedded under the touchscreen was used to create tactile feedback. The three interaction methods, scan, sweep, and rhythm, enabled users to read Braille characters one at a time either by exploring the characters dot by dot or by sensing a rhythmic pattern presented on the screen. The methods were tested with five blind Braille readers as a proof of concept. The results of the first experiment showed that all three methods can be used to convey information as the participants could accurately (91-97 percent) recognize individual characters. In the second experiment, the presentation rate of the most efficient and preferred method, the rhythm, was varied. A mean recognition accuracy of 70 percent was found when the speed of presenting a single character was nearly doubled from the first experiment. The results showed that temporal tactile feedback and Braille coding can be used to transmit single-character information while further studies are still needed to evaluate the presentation of serial information, i.e., multiple Braille characters.