Wendy Ju | Cornell University (original) (raw)

Papers by Wendy Ju

Research paper thumbnail of AdVANcing Design: Customizing Spaces for Vanlife

Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Figure 1: Four examples of interiors representing variants with (1) Bunk bed, (2) Fold-able Bed, ... more Figure 1: Four examples of interiors representing variants with (1) Bunk bed, (2) Fold-able Bed, (3) Low-Positioned Bed, (4) High-Positioned Bed.

Research paper thumbnail of Trash Barrel Robots in the City

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Research paper thumbnail of Intervening, Teaming, Delegating: Creating Engaging Automation Experiences

Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Automated systems are becoming common in private, public and professional life. Given their incre... more Automated systems are becoming common in private, public and professional life. Given their increasing ubiquity and availability to a growing diversity of users, it is important to explore requirements, design principles, and user experience factors across application sectors and scientific disciplines. This workshop provides a forum for researchers and practitioners active in the field of "Automation Experience". In a keynote talk, a poster madness, discussions, and hands-on sessions, the participants will explore and discuss specific opportunities and challenges related to future forms of engagement with an increasing number of automated entities (automations). To this end, the focus topics for the workshop comprise (1) novel ways for monitoring of and intervening with increasingly intelligent agents and artifacts, (2) collaborative interaction to support teaming up and cooperation among humans and automations, and (3) orchestration and delegation of increasingly complex tasks to smart spaces. The results of the workshop are a set of research ideas and drafts of joint research initiatives to drive further automation experience research in a collaborative and interdisciplinary manner. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI).

Research paper thumbnail of Automation Experience at the Workplace

Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 2021

Automation is transforming traditional workplaces and work processes tremendously. While automate... more Automation is transforming traditional workplaces and work processes tremendously. While automated systems are no longer restricted to manufacturing environments but pervade various work domains in manifold appearances, automation initiatives and research are still driven from a technology and performance perspective. The goal of this workshop is to provide an interdisciplinary forum for automation-focused user experience research. It will bring together researchers and practitioners from diferent disciplines to create and transfer knowledge on automation experiences of skilled workers and professionals at workplaces across domains. In a keynote talk, participant presentations, and the group-wise drafting of research ideas, the workshop will address three recent main challenges: encountering workplace automation, collaborating as well as building meaningful relationships with workplace automation. The outcome of this workshop will be a research agenda consisting of ideas for promising future research on automation experiences at the workplace. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI).

Research paper thumbnail of A Faust Based Driving Simulator Sound Synthesis Engine

Proceedings of the SMC Conferences, Aug 31, 2016

A driver's awareness while on the road is a critical factor in his or her ability to make decisio... more A driver's awareness while on the road is a critical factor in his or her ability to make decisions to avoid hazards, plan routes and maintain safe travel. Situational awareness is gleaned not only from visual observation of the environment, but also the audible cues the environment provides-police sirens, honking cars, and crosswalk beeps, for instance, alert the driver to events around them. In our ongoing project on "investigating the influence of audible cues on driver situational awareness", we implemented a custom audio engine that synthesizes in real time the soundscape of our driving simulator and renders it in 3D. This paper describes the implementation of this system, evaluates it and suggests future improvements. We believe that it provides a good example of use of a technology developed by the computer music community outside of this field and that it demonstrates the potential of the use of driving simulators as a music performance venue.

Research paper thumbnail of Utility Belt for an Agricultural Robot

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

By performing design research in the field, designers can better understand the target context, n... more By performing design research in the field, designers can better understand the target context, needs, values, and concerns of their users, and iterate on potential solutions. This, in turn, helps designers apply their work to unexplored territories. We illustrate the opportunities and requirements of this method through a case study of the development of a multipurpose utility belt for an agriculture robot. We benefited from being able to observe current practices, collaborating to test prototypes with on-site roboticists and farmers, and sharing documentation in the moment. On the other hand, it could be challenging to improvise space for the design work or to find the right times to interrupt locals, and to negotiate the documentation activity with people who have concerns about being recorded. CCS CONCEPTS • Human-centered computing → Contextual design.

Research paper thumbnail of Voice Assistant Strategies and Opportunities for People with Tetraplegia

The 21st International ACM SIGACCESS Conference on Computers and Accessibility, 2019

Research paper thumbnail of ReRun

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Rerun is a software system to support post-facto analysis in simulation research. In this submiss... more Rerun is a software system to support post-facto analysis in simulation research. In this submission, we show it working inside a multiplayer driving simulator. Rerun is built in Unity 3D and captures the virtual behavior of participants and their interactions with virtual objects. These recorded behaviors can then be played back from any perspective in the virtual space. This is useful in multi-agent interaction studies because researchers can sift through scenarios carefully from each participant's perspective or even from an outside observer's perspective. This enables a fine-grained understanding of implicit and explicit signaling between participants and other human or AI-controlled agents. CCS CONCEPTS • Human-centered computing → User studies; Mixed / augmented reality;

Research paper thumbnail of Session details: Doctoral Symposium

Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology, 2020

Research paper thumbnail of Acoustically Aware Robots

Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, 2021

The sound a robot or automated system makes and the sounds it listens for in our shared acoustic ... more The sound a robot or automated system makes and the sounds it listens for in our shared acoustic environment can greatly expand its contextual understanding and to shape its behaviors to the interactions it is trying to perform. People convey significant information with sound in interpersonal communication in social contexts. Para-linguistic information about where we are, how loud we're speaking, or if we sound happy, sad or upset are relevant to understand for a robot that looks to adapt its interactions to be socially appropriate. Similarly, the qualities of the sound an object makes can change how people perceive that object and can alter whether or not it attracts attention, interrupts other interactions, reinforces or contradicts an emotional expression, and as such should be aligned with the designer's intention for the object. In this tutorial, we will introduce the participants to software and design methods to help robots recognize and generate sound for human-robot interaction (HRI). Using open-source tools and methods designers can apply to their own robots, we seek to increase the application of sound to robot design and stimulate HRI research in robot sound.

Research paper thumbnail of ”Ah! he wants to win!”: Social responses to playing Tic-Tac-Toe against a physical drawing robot

Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2022

We present an exploratory human participant study (N=3) examining how people interact with a pen-... more We present an exploratory human participant study (N=3) examining how people interact with a pen-plotting robot that interactively plays Tic-Tac-Toe on a shared physical sheet of paper. Each participant played a round of Tic-Tac-Toe against the robot, while we observed. We particularly focused our observations on the participants' physical and social behaviors during game interaction, as well as in-moment reactions from the participants. Following each game, we performed semi-structured qualitative interviews to understand the user's experience interacting with the robot. Our questions were designed to elicit comparisons of their experience with less tangible interactions that players might have with a computer or phone-based app, as well as more traditional interactions that players might have with other people. We found that participants directly addressed the robot by talking to it during play and openly expressed competitiveness against the robot. Furthermore, participants displayed careful movements around the robot and attentively observed its behaviors. Based on these initial insights from our exploratory study, we are planning future experiments to investigate the effect that the mutuality of the physical Tic-Tac-Toe interaction has on social responses to the robot to understand what this implies for embodied and tangible interaction design. CCS CONCEPTS • Human-centered computing → Empirical studies in interaction design; • Hardware → Tactile and hand-based interfaces.

Research paper thumbnail of SPECIAL ISSUE ON DESIGN & EMOTION Approachability: How People Interpret Automatic Door Movement as Gesture

Automatic doors exemplify the challenges of designing emotionally welcoming interactive systems—a... more Automatic doors exemplify the challenges of designing emotionally welcoming interactive systems—a critical issue in the design of any system of incidental use. We attempt to broaden the automatic door’s repertoire of signals by examining how people respond to a variety of “door gestures ” designed to offer different levels of approachability. In a pilot study, participants (N=48) who walked past a physical gesturing door were asked to fill out a questionnaire about that experience. In our follow-up study, participants (N=51) viewed 12 video clips depicting a person walking toward and past an automatic door that moved with different speeds and trajectories. In both studies, our Likert-scale measures and open-ended responses indicated significant uniformity in participants ’ interpretation of the behaviour of the door prototypes. The participants saw these motions as gestures with human-like characteristics such as cognition and intent. Our work suggests that even in non-anthropomorph...

Research paper thumbnail of ¡Vamos!: Observations of Pedestrian Interactions with Driverless Cars in Mexico

Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2018

How will pedestrians from different regions interact with an approaching autonomous vehicle? Unde... more How will pedestrians from different regions interact with an approaching autonomous vehicle? Understanding differences in pedestrian culture and responses can help inform autonomous cars how to behave appropriately in different regional contexts. We conducted a field study comparing the behavioral response of pedestrians between metropolitan Mexico City (N=113) and Colima, a smaller coastal city (N=81). We hid a driver in a car seat costume as a Wizard-of-Oz prototype to evoke pedestrian interaction behavior at a crosswalk or street. Pedestrian interactions were coded for crossing decision, crossing pathway, pacing, and observational behavior. Most distinctly, pedestrians in Mexico City kept their pace and more often crossed in front of the vehicle, while those in Colima stopped in front of the car more often.

Research paper thumbnail of Enacting metaphors to explore relations and interactions with automated driving systems

Design Studies, 2020

Conventional interaction design methodologies cannot fully encompass the redefined relationships ... more Conventional interaction design methodologies cannot fully encompass the redefined relationships between humans and increasingly intelligent technology. New methods are necessary to address interaction at early stages in the design process. Both design metaphors and enactment techniques have been suggested, and this paper explores whether a combination of these can support the design of future interactions. Across three workshops, 27 participants utilised the combination to design the interaction with an automated driving system. Analysis shows that the method combination supported imagining and designing; metaphors aided the creation of a joint conceptual vision of the relationship, and the enactment created tangible experiences and contextualisation of the design concepts. Jointly the methods brought together multi-disciplinary teams in a shared vision, by acting as a shared language and enacted representations of insights that could be engaged with and experienced together.

Research paper thumbnail of Design skills for HRI

2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2016

This tutorial is a hands-on introduction to human-centered design topics and practices for human-... more This tutorial is a hands-on introduction to human-centered design topics and practices for human-robot interaction. It is intended for researchers with a variety of backgrounds, particularly those with little or no prior experience in design. In the morning, participants will learn about user needs and needfinding, as ways to understand the stakeholders in research outcomes, guide the selection of participants, and as possible measures of success. We then focus on design sketching, including ways to represent objects, people and their interactions through storyboards. Design sketching is not intended to be art, rather a way to develop and build upon ideas with oneself, and quickly communicate with colleagues. In the afternoon, participants will use the tools and materials, and learn techniques for lightweight physical prototyping and improvisation. Participants will build a small paper robot (not actuated) of their own design, to practice puppeteering, explore bodily movement and prototype interactions.

Research paper thumbnail of Take the wheel: Effects of available modalities on driver intervention

2016 IEEE Intelligent Vehicles Symposium (IV), 2016

While automated driving systems will become increasingly capable and common in the future, there ... more While automated driving systems will become increasingly capable and common in the future, there will still be instances when human drivers want or need to make corrections to the car's automated driving behavior. We conducted two studies exploring how driving interfaces could be designed to better execute the drivers' intentions. In our first study, adult participants (N=40) experienced a simulated driving scenario that varied the behavior of the car's automation (perfect driving and imperfect driving) and the intervention modalities (takeover and takeover+influence). At certain segments, the car's automation would drive perfectly or weave within the lane. During those times, participants could intervene using the available modalities. When experiencing instances of imperfect driving, drivers who had the ability to takeover+influence intervened more often than drivers who were only given the option to takeover. As intervening would require them to resume full control, drivers in the takeover condition were more tolerant of the imperfect driving. Also, most drivers tried to intervene initially by influencing the car, even those drivers who were only given the ability to takeover. In our second study, we examined how participants (N=40) of different demographics (high school students and seniors) would respond when they were subjected to the imperfect driving scenarios. High school drivers intervened just as much as the adult drivers. However, senior drivers intervened far less. These two studies suggest that when intervention is necessary, human drivers have a desire for shared control, which allows them to act as supervisors rather than operators of automated vehicles.

Research paper thumbnail of Quantitative Measures of User Experience in Autonomous Driving Simulators

Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '14, 2014

As autonomous cars gain popularity, the importance of studying user experience (UX) in autonomous... more As autonomous cars gain popularity, the importance of studying user experience (UX) in autonomous cars becomes increasingly important. Because validated UX measures specific to autonomous driving have not been developed, we identified several factors of interest common to researchers working at the intersection of autonomous driving, driving simulators, and user experience. We have collected corresponding validated questionnaires to create a comprehensive inventory. We based our selection on attributes such as length of the questionnaires, validation, and prevalence of use such that our work may contribute to an easy and fast setup of high quality questionnaires for the study of UX in autonomous cars. In this extended abstract, we recap the factors we have inventoried.

Research paper thumbnail of The Push vs Pull of Information between Autonomous Cars and Human Drivers

Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2014

How should information be exchanged between drivers and their cars? What types of information sho... more How should information be exchanged between drivers and their cars? What types of information should be exchanged? These questions have become increasingly important as research into autonomous cars interfaces continues to develop. To examine these questions, a varied and complex simulation course has been created for the Stanford Driving Simulator together with a Wizard of Oz Station for operators to manipulate the driving simulation. Outlined in this paper is a Wizard of Oz study that observes/records the effects of "Push vs. Pull" of driving information from the autonomous car, as well as the use of "What vs. Why" information. The objective of this research is to provide a set of psychological principles that will guide the driver-vehicle interface design in providing effective, real-time support for drivers of increasingly autonomous vehicles.

Research paper thumbnail of Does The First Officer Concur? Shared Control with Smart Vehicle Systems

Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '14, 2014

New computation and sensing capabilities in road vehicles present possibilities for advanced driv... more New computation and sensing capabilities in road vehicles present possibilities for advanced driver assistance systems that can increase safety and efficiency, if the driver will trust them appropriately and use them properly. The two-stage 'trust fall' is a way to study trust in automated systems by testing whether trust established in normal circumstances transfers to trust under extreme circumstances, which will be essential for the successful employment of new automotive systems. Understanding the mental models drivers create of advanced systems, and how they use those mental models to share control with the computer will be crucial to successful design.

Research paper thumbnail of Effect of cognitive load in autonomous vehicles on driver performance during transfer of control

Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2014

Present study on cognitive workload in driving focuses on reduction of workload for better drivin... more Present study on cognitive workload in driving focuses on reduction of workload for better driving performance. In this paper, we talk about the cognitive load in drivers of autonomous cars and their performance under multiple cognitive loads. Our previous studies have indicated that low to no workload is likely to induce drowsiness in drivers of autonomous vehicles. We hypothesize that there is an optimal cognitive load for a driver during autonomous driving for best performance after transfer of control from autonomous to manual. We propose an experiment to study the cognitive load on the driver of a simulated autonomous car and the effects on manual driving performance. We also describe our use of biometric devices to obtain physiological measures indicative of cognitive workload.

Research paper thumbnail of AdVANcing Design: Customizing Spaces for Vanlife

Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Figure 1: Four examples of interiors representing variants with (1) Bunk bed, (2) Fold-able Bed, ... more Figure 1: Four examples of interiors representing variants with (1) Bunk bed, (2) Fold-able Bed, (3) Low-Positioned Bed, (4) High-Positioned Bed.

Research paper thumbnail of Trash Barrel Robots in the City

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Research paper thumbnail of Intervening, Teaming, Delegating: Creating Engaging Automation Experiences

Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Automated systems are becoming common in private, public and professional life. Given their incre... more Automated systems are becoming common in private, public and professional life. Given their increasing ubiquity and availability to a growing diversity of users, it is important to explore requirements, design principles, and user experience factors across application sectors and scientific disciplines. This workshop provides a forum for researchers and practitioners active in the field of "Automation Experience". In a keynote talk, a poster madness, discussions, and hands-on sessions, the participants will explore and discuss specific opportunities and challenges related to future forms of engagement with an increasing number of automated entities (automations). To this end, the focus topics for the workshop comprise (1) novel ways for monitoring of and intervening with increasingly intelligent agents and artifacts, (2) collaborative interaction to support teaming up and cooperation among humans and automations, and (3) orchestration and delegation of increasingly complex tasks to smart spaces. The results of the workshop are a set of research ideas and drafts of joint research initiatives to drive further automation experience research in a collaborative and interdisciplinary manner. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI).

Research paper thumbnail of Automation Experience at the Workplace

Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 2021

Automation is transforming traditional workplaces and work processes tremendously. While automate... more Automation is transforming traditional workplaces and work processes tremendously. While automated systems are no longer restricted to manufacturing environments but pervade various work domains in manifold appearances, automation initiatives and research are still driven from a technology and performance perspective. The goal of this workshop is to provide an interdisciplinary forum for automation-focused user experience research. It will bring together researchers and practitioners from diferent disciplines to create and transfer knowledge on automation experiences of skilled workers and professionals at workplaces across domains. In a keynote talk, participant presentations, and the group-wise drafting of research ideas, the workshop will address three recent main challenges: encountering workplace automation, collaborating as well as building meaningful relationships with workplace automation. The outcome of this workshop will be a research agenda consisting of ideas for promising future research on automation experiences at the workplace. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI).

Research paper thumbnail of A Faust Based Driving Simulator Sound Synthesis Engine

Proceedings of the SMC Conferences, Aug 31, 2016

A driver's awareness while on the road is a critical factor in his or her ability to make decisio... more A driver's awareness while on the road is a critical factor in his or her ability to make decisions to avoid hazards, plan routes and maintain safe travel. Situational awareness is gleaned not only from visual observation of the environment, but also the audible cues the environment provides-police sirens, honking cars, and crosswalk beeps, for instance, alert the driver to events around them. In our ongoing project on "investigating the influence of audible cues on driver situational awareness", we implemented a custom audio engine that synthesizes in real time the soundscape of our driving simulator and renders it in 3D. This paper describes the implementation of this system, evaluates it and suggests future improvements. We believe that it provides a good example of use of a technology developed by the computer music community outside of this field and that it demonstrates the potential of the use of driving simulators as a music performance venue.

Research paper thumbnail of Utility Belt for an Agricultural Robot

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

By performing design research in the field, designers can better understand the target context, n... more By performing design research in the field, designers can better understand the target context, needs, values, and concerns of their users, and iterate on potential solutions. This, in turn, helps designers apply their work to unexplored territories. We illustrate the opportunities and requirements of this method through a case study of the development of a multipurpose utility belt for an agriculture robot. We benefited from being able to observe current practices, collaborating to test prototypes with on-site roboticists and farmers, and sharing documentation in the moment. On the other hand, it could be challenging to improvise space for the design work or to find the right times to interrupt locals, and to negotiate the documentation activity with people who have concerns about being recorded. CCS CONCEPTS • Human-centered computing → Contextual design.

Research paper thumbnail of Voice Assistant Strategies and Opportunities for People with Tetraplegia

The 21st International ACM SIGACCESS Conference on Computers and Accessibility, 2019

Research paper thumbnail of ReRun

Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

Rerun is a software system to support post-facto analysis in simulation research. In this submiss... more Rerun is a software system to support post-facto analysis in simulation research. In this submission, we show it working inside a multiplayer driving simulator. Rerun is built in Unity 3D and captures the virtual behavior of participants and their interactions with virtual objects. These recorded behaviors can then be played back from any perspective in the virtual space. This is useful in multi-agent interaction studies because researchers can sift through scenarios carefully from each participant's perspective or even from an outside observer's perspective. This enables a fine-grained understanding of implicit and explicit signaling between participants and other human or AI-controlled agents. CCS CONCEPTS • Human-centered computing → User studies; Mixed / augmented reality;

Research paper thumbnail of Session details: Doctoral Symposium

Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology, 2020

Research paper thumbnail of Acoustically Aware Robots

Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, 2021

The sound a robot or automated system makes and the sounds it listens for in our shared acoustic ... more The sound a robot or automated system makes and the sounds it listens for in our shared acoustic environment can greatly expand its contextual understanding and to shape its behaviors to the interactions it is trying to perform. People convey significant information with sound in interpersonal communication in social contexts. Para-linguistic information about where we are, how loud we're speaking, or if we sound happy, sad or upset are relevant to understand for a robot that looks to adapt its interactions to be socially appropriate. Similarly, the qualities of the sound an object makes can change how people perceive that object and can alter whether or not it attracts attention, interrupts other interactions, reinforces or contradicts an emotional expression, and as such should be aligned with the designer's intention for the object. In this tutorial, we will introduce the participants to software and design methods to help robots recognize and generate sound for human-robot interaction (HRI). Using open-source tools and methods designers can apply to their own robots, we seek to increase the application of sound to robot design and stimulate HRI research in robot sound.

Research paper thumbnail of ”Ah! he wants to win!”: Social responses to playing Tic-Tac-Toe against a physical drawing robot

Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2022

We present an exploratory human participant study (N=3) examining how people interact with a pen-... more We present an exploratory human participant study (N=3) examining how people interact with a pen-plotting robot that interactively plays Tic-Tac-Toe on a shared physical sheet of paper. Each participant played a round of Tic-Tac-Toe against the robot, while we observed. We particularly focused our observations on the participants' physical and social behaviors during game interaction, as well as in-moment reactions from the participants. Following each game, we performed semi-structured qualitative interviews to understand the user's experience interacting with the robot. Our questions were designed to elicit comparisons of their experience with less tangible interactions that players might have with a computer or phone-based app, as well as more traditional interactions that players might have with other people. We found that participants directly addressed the robot by talking to it during play and openly expressed competitiveness against the robot. Furthermore, participants displayed careful movements around the robot and attentively observed its behaviors. Based on these initial insights from our exploratory study, we are planning future experiments to investigate the effect that the mutuality of the physical Tic-Tac-Toe interaction has on social responses to the robot to understand what this implies for embodied and tangible interaction design. CCS CONCEPTS • Human-centered computing → Empirical studies in interaction design; • Hardware → Tactile and hand-based interfaces.

Research paper thumbnail of SPECIAL ISSUE ON DESIGN & EMOTION Approachability: How People Interpret Automatic Door Movement as Gesture

Automatic doors exemplify the challenges of designing emotionally welcoming interactive systems—a... more Automatic doors exemplify the challenges of designing emotionally welcoming interactive systems—a critical issue in the design of any system of incidental use. We attempt to broaden the automatic door’s repertoire of signals by examining how people respond to a variety of “door gestures ” designed to offer different levels of approachability. In a pilot study, participants (N=48) who walked past a physical gesturing door were asked to fill out a questionnaire about that experience. In our follow-up study, participants (N=51) viewed 12 video clips depicting a person walking toward and past an automatic door that moved with different speeds and trajectories. In both studies, our Likert-scale measures and open-ended responses indicated significant uniformity in participants ’ interpretation of the behaviour of the door prototypes. The participants saw these motions as gestures with human-like characteristics such as cognition and intent. Our work suggests that even in non-anthropomorph...

Research paper thumbnail of ¡Vamos!: Observations of Pedestrian Interactions with Driverless Cars in Mexico

Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2018

How will pedestrians from different regions interact with an approaching autonomous vehicle? Unde... more How will pedestrians from different regions interact with an approaching autonomous vehicle? Understanding differences in pedestrian culture and responses can help inform autonomous cars how to behave appropriately in different regional contexts. We conducted a field study comparing the behavioral response of pedestrians between metropolitan Mexico City (N=113) and Colima, a smaller coastal city (N=81). We hid a driver in a car seat costume as a Wizard-of-Oz prototype to evoke pedestrian interaction behavior at a crosswalk or street. Pedestrian interactions were coded for crossing decision, crossing pathway, pacing, and observational behavior. Most distinctly, pedestrians in Mexico City kept their pace and more often crossed in front of the vehicle, while those in Colima stopped in front of the car more often.

Research paper thumbnail of Enacting metaphors to explore relations and interactions with automated driving systems

Design Studies, 2020

Conventional interaction design methodologies cannot fully encompass the redefined relationships ... more Conventional interaction design methodologies cannot fully encompass the redefined relationships between humans and increasingly intelligent technology. New methods are necessary to address interaction at early stages in the design process. Both design metaphors and enactment techniques have been suggested, and this paper explores whether a combination of these can support the design of future interactions. Across three workshops, 27 participants utilised the combination to design the interaction with an automated driving system. Analysis shows that the method combination supported imagining and designing; metaphors aided the creation of a joint conceptual vision of the relationship, and the enactment created tangible experiences and contextualisation of the design concepts. Jointly the methods brought together multi-disciplinary teams in a shared vision, by acting as a shared language and enacted representations of insights that could be engaged with and experienced together.

Research paper thumbnail of Design skills for HRI

2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2016

This tutorial is a hands-on introduction to human-centered design topics and practices for human-... more This tutorial is a hands-on introduction to human-centered design topics and practices for human-robot interaction. It is intended for researchers with a variety of backgrounds, particularly those with little or no prior experience in design. In the morning, participants will learn about user needs and needfinding, as ways to understand the stakeholders in research outcomes, guide the selection of participants, and as possible measures of success. We then focus on design sketching, including ways to represent objects, people and their interactions through storyboards. Design sketching is not intended to be art, rather a way to develop and build upon ideas with oneself, and quickly communicate with colleagues. In the afternoon, participants will use the tools and materials, and learn techniques for lightweight physical prototyping and improvisation. Participants will build a small paper robot (not actuated) of their own design, to practice puppeteering, explore bodily movement and prototype interactions.

Research paper thumbnail of Take the wheel: Effects of available modalities on driver intervention

2016 IEEE Intelligent Vehicles Symposium (IV), 2016

While automated driving systems will become increasingly capable and common in the future, there ... more While automated driving systems will become increasingly capable and common in the future, there will still be instances when human drivers want or need to make corrections to the car's automated driving behavior. We conducted two studies exploring how driving interfaces could be designed to better execute the drivers' intentions. In our first study, adult participants (N=40) experienced a simulated driving scenario that varied the behavior of the car's automation (perfect driving and imperfect driving) and the intervention modalities (takeover and takeover+influence). At certain segments, the car's automation would drive perfectly or weave within the lane. During those times, participants could intervene using the available modalities. When experiencing instances of imperfect driving, drivers who had the ability to takeover+influence intervened more often than drivers who were only given the option to takeover. As intervening would require them to resume full control, drivers in the takeover condition were more tolerant of the imperfect driving. Also, most drivers tried to intervene initially by influencing the car, even those drivers who were only given the ability to takeover. In our second study, we examined how participants (N=40) of different demographics (high school students and seniors) would respond when they were subjected to the imperfect driving scenarios. High school drivers intervened just as much as the adult drivers. However, senior drivers intervened far less. These two studies suggest that when intervention is necessary, human drivers have a desire for shared control, which allows them to act as supervisors rather than operators of automated vehicles.

Research paper thumbnail of Quantitative Measures of User Experience in Autonomous Driving Simulators

Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '14, 2014

As autonomous cars gain popularity, the importance of studying user experience (UX) in autonomous... more As autonomous cars gain popularity, the importance of studying user experience (UX) in autonomous cars becomes increasingly important. Because validated UX measures specific to autonomous driving have not been developed, we identified several factors of interest common to researchers working at the intersection of autonomous driving, driving simulators, and user experience. We have collected corresponding validated questionnaires to create a comprehensive inventory. We based our selection on attributes such as length of the questionnaires, validation, and prevalence of use such that our work may contribute to an easy and fast setup of high quality questionnaires for the study of UX in autonomous cars. In this extended abstract, we recap the factors we have inventoried.

Research paper thumbnail of The Push vs Pull of Information between Autonomous Cars and Human Drivers

Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2014

How should information be exchanged between drivers and their cars? What types of information sho... more How should information be exchanged between drivers and their cars? What types of information should be exchanged? These questions have become increasingly important as research into autonomous cars interfaces continues to develop. To examine these questions, a varied and complex simulation course has been created for the Stanford Driving Simulator together with a Wizard of Oz Station for operators to manipulate the driving simulation. Outlined in this paper is a Wizard of Oz study that observes/records the effects of "Push vs. Pull" of driving information from the autonomous car, as well as the use of "What vs. Why" information. The objective of this research is to provide a set of psychological principles that will guide the driver-vehicle interface design in providing effective, real-time support for drivers of increasingly autonomous vehicles.

Research paper thumbnail of Does The First Officer Concur? Shared Control with Smart Vehicle Systems

Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '14, 2014

New computation and sensing capabilities in road vehicles present possibilities for advanced driv... more New computation and sensing capabilities in road vehicles present possibilities for advanced driver assistance systems that can increase safety and efficiency, if the driver will trust them appropriately and use them properly. The two-stage 'trust fall' is a way to study trust in automated systems by testing whether trust established in normal circumstances transfers to trust under extreme circumstances, which will be essential for the successful employment of new automotive systems. Understanding the mental models drivers create of advanced systems, and how they use those mental models to share control with the computer will be crucial to successful design.

Research paper thumbnail of Effect of cognitive load in autonomous vehicles on driver performance during transfer of control

Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 2014

Present study on cognitive workload in driving focuses on reduction of workload for better drivin... more Present study on cognitive workload in driving focuses on reduction of workload for better driving performance. In this paper, we talk about the cognitive load in drivers of autonomous cars and their performance under multiple cognitive loads. Our previous studies have indicated that low to no workload is likely to induce drowsiness in drivers of autonomous vehicles. We hypothesize that there is an optimal cognitive load for a driver during autonomous driving for best performance after transfer of control from autonomous to manual. We propose an experiment to study the cognitive load on the driver of a simulated autonomous car and the effects on manual driving performance. We also describe our use of biometric devices to obtain physiological measures indicative of cognitive workload.