Luka Rukonić | Université catholique de Louvain (original) (raw)

Papers by Luka Rukonić

Research paper thumbnail of Teaching Drivers about ADAS using Spoken Dialogue: A Wizard of Oz Study

Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2022

Understanding the limitations and capabilities of the advanced driver-assistance systems (ADAS) i... more Understanding the limitations and capabilities of the advanced driver-assistance systems (ADAS) is a prerequisite for their safe and comfortable use. This paper presents a formative user study on the use of a dialogue-based system, implemented using the Wizard of Oz (WOz) technique, to help drivers learn about the correct use of driving assistance. We investigated whether drivers would build the correct mental model of the driving assistance systems through natural language dialogue. We describe the evolution of the prototype over four iterations of formative evaluation with older and younger drivers. Using a mixed-method approach, combining the WOz, interviews, questionnaires, and a knowledge quiz, we evaluated the prototype of a voice assistant and identified the teaching content objectives. Participants' mental model about ADAS was assessed to evaluate the efficacy of the teaching approach. The results show that the teaching goals need to be clearly communicated to the drivers to ensure the adoption of the VA.

Research paper thumbnail of How Older Drivers Perceive Warning Alerts? Insights for the Design of Driver–Car Interaction

SN computer science, Nov 16, 2022

The automotive industry is working toward driving automation and driver-assistance technology is ... more The automotive industry is working toward driving automation and driver-assistance technology is becoming a norm in modern cars. Warning alert systems support the driver-car interaction and inform drivers about automation system status, upcoming obstacles, or dangers ahead. However, older drivers' needs are not always addressed in research studies, although they make up a large segment of drivers. Therefore, we conducted a qualitative three-round formative evaluation of a warning alert system using video prototypes in lab and remote settings. The goal was to evaluate visual-, sound-, and speech-based alerts based on: (a) their efficiency in informing drivers about the road situation ahead, and (b) participants' subjective opinions. We evaluated the system's efficiency using self-reported data measuring participants' cognitive load, usability, UX, and ease of use. Also, we conducted interviews to collect subjective feedback about proposed prototypes. In this article, we describe the design of warning alerts and report on their evaluation results. Our results show that speech-based warnings, especially when coupled with visual warnings, are efficient and accepted well by the participants. This article illustrates older drivers' attitude toward the use of different warning modalities in the driving context.

Research paper thumbnail of UX Design and Evaluation of Warning Alerts for Semi-autonomous Cars with Elderly Drivers

This paper presents a study on user experience (UX) design and evaluation of warning systems inte... more This paper presents a study on user experience (UX) design and evaluation of warning systems intended for older adults in semi-autonomous cars. We used combinations of visual, auditory, and speech modalities to design the warning alerts and created three low-fidelity, video-based prototypes. We conducted user tests with elderly drivers, both in the lab and remotely, within a test-and-refine approach involving three experiments. The methods used for data collection included Wizard of Oz, standard questionnaires and interviews. We collected qualitative user feedback and self-reported ratings of user experience and cognitive load. We report on the iterative development of our design solution, findings from these user studies, and our methodological insights, that UX researchers and practitioners could use in similar settings.

Research paper thumbnail of Fast Detection and Classification of Drivers’ Responses to Stressful Events and Cognitive Workload

Research paper thumbnail of Measuring driving simulator adaptation using EDA

AHFE international, 2022

Most research about simulator adaptation focus on driving style and participants' comfort. Ho... more Most research about simulator adaptation focus on driving style and participants' comfort. However, in recent years, there is a growing interest in physiological data analysis as part of the user experience (UX) assessment. Furthermore, the application of machine learning (ML) techniques to those data may allow the automatic detection of stress and cognitive load. Previously, we noticed that new participants in experiments with our simulator were often in a constant state of tension. This prevented optimal training of our ML models as many of the collected data were not representative of a person's normal state.Our work focuses on improving driver's UX by keeping the cognitive load and stress at levels that do not interfere with the primary task of driving. We use a custom-made driving simulator as our testing platform and evaluate participants' emotional state with physiological signals, specifically electrodermal activity (EDA). EDA is the variation of the skin conductance created by sweat glands. It is linked to the sympathetic nervous system and is an indication of physiological and psychological arousal. We selected EDA because several studies have shown that it is a fast indicator of stress and cognitive load.To ensure that we are consistently collecting accurate data that could be fed to ML algorithms, we need to be able to correlate physiological reactions to external stimuli. We want to avoid them to be confused with general tension. Therefore, we need to determine the time it takes for most participants to physiologically adapt to our simulator. In this between-subjects study, we examined the impact of short time (ca. 10 min) exposures to the simulation and compared it with a longer exposure period (ca. 35 min).Another problem we faced was that some participants were too indisposed by driving in the simulator to complete testing sessions. Therefore, we needed to find a way to discriminate them during the recruitment process. Literature has shown that there might be a link between motion sickness and simulator sickness and in this study, we searched for a correlation between the motion sickness susceptibility questionnaire (MSSQ) and the self-reported simulator sickness using the simulator sickness questionnaire (SSQ).For our investigation, we recruited 22 people through an agency. They were divided in two groups. Group A (short-time exposures) had 10 participants between 25 and 69 years old (M=49.5; SD=17.1, 5 women, 5 men) and group B (long-time exposure) had 12 people between 28 and 65 years old (M=43; SD=12.8, 5 women, 7 men). We requested from the agency to recruit only active drivers of automatic transmissions cars as our simulator mimics this type of vehicle.Motion sickness susceptibility and discomfort felt in the simulator are moderately correlated. The coefficient value is 0.51. The number of participants of our study being small, further research is necessary to determine if the MSSQ can be used as a discriminator in the recruitment phase. In addition, we can conclude that a longer exposure of 35 min results overall in better physiological adaptation.

Research paper thumbnail of Overcoming Organizational Barriers to the Integration of UX Methods in Software Development: A Case Study

Lecture Notes in Computer Science, 2019

Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate... more Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate it into their processes and UX practitioners still encounter challenges in integrating UX methods. Research in HCI has presented theoretical and pragmatic models. Most of the time, these models lack presenting validation in practice, documentation or support for their use when difficulties appear. Even if difficulties could be expected. In this paper, we present a categorization of organizational barriers extracted from the relevant literature: lack of UX resources, lack of UX literacy, poor use of UX artifacts and communication breakdowns. Then, we propose a 4-step procedure to identify and overcome organizational barriers with a case study describing how this procedure helped us to anticipate and overcome organizational barriers encountered in a project. With a UX Capability/Maturity (UX CM) assessment conducted at the beginning of the project, we were expecting organizational barriers and constant readjustment of our UX strategy. We Communicated about findings and readjustment to stakeholders in order to increase their awareness about problems along the way of the project and we had prepared remediation strategies for the emergence of barriers.

Research paper thumbnail of Measuring UX Capability and Maturity in Organizations

Lecture Notes in Computer Science, 2019

Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover... more Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover, the lack of empirically developed maturity models, models validated in practice, studies demonstrating their benefit and poor documentation or support for their use, has made this measurement even more problematic. To date, there is no straightforward and efficient method to assess UXCM although such assessment is a prerequisite for the improvement of UX processes. UX artifacts, methods and resources contribute toward the execution of UX processes: the production of UX artifacts demonstrate the execution of a process, whereas the use of UX methods demonstrates the implementation of specific UX processes with specific UX resources. In this paper, we present a measurement structure aiming at assessing organizational capabilities to implement UX processes. This structure consists of a capability scale, a maturity scale, a rating scale and a set of process attributes as measurable characteristics of UX processes. The contribution of this paper is threefold: a description of the measurement structure for the UXCM assessment, a questionnaire for the capability assessment by means of online survey or remote interviews and the documentation of a case study demonstrating the efficiency of the proposed model in an industrial project.

Research paper thumbnail of Specification of a UX Process Reference Model towards the Strategic Planning of UX Activities

In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds ... more In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds on the related work and report our experience using it. The UXPRM includes a description of primary UX lifecycle processes, and a classification of UX methods and artifacts. This work draws an accurate picture of UX base practices and allows the reader to compare and select methods for different purposes. Building on that basis, our future work consists of developing a UX Capability/Maturity Model (UXCMM) intended for UX activity planning according to the organization's UX capabilities. Ultimately, the UXCMM aims to facilitate the integration of UX processes in software engineering, which should contribute to reducing the gap between UX research and UX practice.

Research paper thumbnail of A Process Reference Model for UX

Communications in computer and information science, 2020

We propose a process reference model for UX (UXPRM), which includes a description of the primary ... more We propose a process reference model for UX (UXPRM), which includes a description of the primary UX lifecycle processes within a UX lifecycle and a set of supporting UX methods. The primary UX lifecycle processes are refined into objectives, outcomes and base practices. The supporting UX methods are refined into related techniques, specific objectives and references to the related documentation available in the literature. The contribution of the proposed UXPRM is three-fold: conceptual, as it draws an accurate picture of the UX base practices; practical, as it is intended for both researchers and practitioners and customizable for different organizational settings; methodological, as it supports researchers and practitioners to make informed decisions while selecting UX methods and techniques. This is a first step towards the strategic planning of UX activities.

Research paper thumbnail of A Questionnaire for Collecting Data Relevant to UX Experimental Design

Proceedings of the 3rd International Conference on Computer-Human Interaction Research and Applications, 2019

This paper presents the set of experimental cues involved in the UX experiments that define the c... more This paper presents the set of experimental cues involved in the UX experiments that define the characteristics of signals, objects, individuals and prototypes in the lab setting. The contribution of this paper is threefold. First, methodological, as the method employed for creating the questionnaire is reproducible in other domain-applications. Second, practical, as the questionnaire itself can serve as a tool for capturing the experimental cues relevant to the UX evaluation of similar applications. Third, conceptual, as this paper renders a first account of how the questionnaire-collected data can inform other activities ranging from the selection of evaluation methods to the specification of independent variables, UX measures, experimental tasks and apparatus.

Research paper thumbnail of Overcoming Organizational Barriers to the Integration of UX Methods in Software Development: A Case Study

Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate... more Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate it into their processes and UX practitioners still encounter challenges in integrating UX methods. Research in HCI has presented theoretical and pragmatic models. Most of the time, these models lack presenting validation in practice, documentation or support for their use when difficulties appear. Even if difficulties could be expected. In this paper, we present a categorization of organizational barriers extracted from the relevant literature: lack of UX resources, lack of UX literacy, poor use of UX artifacts and communication breakdowns. Then, we propose a 4-step procedure to identify and overcome organizational barriers with a case study describing how this procedure helped us to anticipate and overcome organizational barriers encountered in a project. With a UX Capability/Maturity (UX CM) assessment conducted at the beginning of the project, we were expecting organizational barrier...

Research paper thumbnail of Measuring UX Capability and Maturity in Organizations

Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover... more Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover, the lack of empirically developed maturity models, models validated in practice, studies demonstrating their benefit and poor documentation or support for their use, has made this measurement even more problematic. To date, there is no straightforward and efficient method to assess UXCM although such assessment is a prerequisite for the improvement of UX processes. UX artifacts, methods and resources contribute toward the execution of UX processes: the production of UX artifacts demonstrate the execution of a process, whereas the use of UX methods demonstrates the implementation of specific UX processes with specific UX resources. In this paper, we present a measurement structure aiming at assessing organizational capabilities to implement UX processes. This structure consists of a capability scale, a maturity scale, a rating scale and a set of process attributes as measurable characte...

Research paper thumbnail of Specification of a UX Process Reference Model towards the Strategic Planning of UX Activities

Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2019

In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds ... more In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds on the related work and report our experience using it. The UXPRM includes a description of primary UX lifecycle processes, and a classification of UX methods and artifacts. This work draws an accurate picture of UX base practices and allows the reader to compare and select methods for different purposes. Building on that basis, our future work consists of developing a UX Capability/Maturity Model (UXCMM) intended for UX activity planning according to the organization's UX capabilities. Ultimately, the UXCMM aims to facilitate the integration of UX processes in software engineering, which should contribute to reducing the gap between UX research and UX practice.

Research paper thumbnail of Perceived Value of UX in Organizations: A Systematic Literature Review

HCII, 2024

This systematic literature review (SLR) examines what factors affect the perceived value of user ... more This systematic literature review (SLR) examines what factors affect the perceived value of user experience (UX) in organizations. Integrating UX activities into organizational processes and software development is a widely addressed topic in the literature. However, although the social perception of the UX integration process is key for its successful execution, we do not have a concise understanding of this concept. To bridge this gap, we conducted an SLR answering two research questions: 1) What factors influence the perceived value of UX in organizations? and 2) What are the existing tools to measure or evaluate the perceived value of UX? Database search retrieved 49 publications, and we analyzed the content of 14 papers published between 2012 and 2023. The results are divided into six themes, each describing the positive and negative impacts on the perceived value of UX: understanding UX, UX resources, UX culture, perceived UX value, UX management, and UX work organization. Also, we found that the concept of the perceived value of UX is not yet developed in the HCI literature, and no tools have been developed to measure it. Therefore, further research on defining this concept is needed to understand better how social perception of UX affects its integration.

Research paper thumbnail of Subjective Evaluation of Road Situation Alerts Using Visual, Speech and Auditory Modalities with Elderly Drivers

Advances in Human Aspects of Transportation

Research paper thumbnail of Design Requirements for Recommendations in End-User User Interface Design

User interface design has become increasingly difficult due to the rise of new kinds of electroni... more User interface design has become increasingly difficult due to the rise of new kinds of electronic devices and the emergence of the Internet of Things (IoT). Further, user interface (UI) designers struggle to adapt their UIs to evolving user needs and preferences. In order to address these issues, we want to support end users in designing their own user interfaces. However, end-user UI design represents a major challenge, given that end users often lack the necessary design skills. We investigated how design recommendations might be used to address the research question on how to help end users during the UI design process? A first step towards answering this question is the analysis of how end users should best get recommendations about potential design improvements. We therefore conducted a survey on how end users would like to get design recommendations, whether they trust user- or machine-generated recommendations, and whether they agree that their interactions are tracked and shared in order to improve the recommendations. Based on the results of our survey, we present a set of design requirements for the integration of recommendations in end-user UI design tools.

Research paper thumbnail of Teaching Drivers about ADAS using Spoken Dialogue: A Wizard of Oz Study

Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2022

Understanding the limitations and capabilities of the advanced driver-assistance systems (ADAS) i... more Understanding the limitations and capabilities of the advanced driver-assistance systems (ADAS) is a prerequisite for their safe and comfortable use. This paper presents a formative user study on the use of a dialogue-based system, implemented using the Wizard of Oz (WOz) technique, to help drivers learn about the correct use of driving assistance. We investigated whether drivers would build the correct mental model of the driving assistance systems through natural language dialogue. We describe the evolution of the prototype over four iterations of formative evaluation with older and younger drivers. Using a mixed-method approach, combining the WOz, interviews, questionnaires, and a knowledge quiz, we evaluated the prototype of a voice assistant and identified the teaching content objectives. Participants' mental model about ADAS was assessed to evaluate the efficacy of the teaching approach. The results show that the teaching goals need to be clearly communicated to the drivers to ensure the adoption of the VA.

Research paper thumbnail of How Older Drivers Perceive Warning Alerts? Insights for the Design of Driver–Car Interaction

SN computer science, Nov 16, 2022

The automotive industry is working toward driving automation and driver-assistance technology is ... more The automotive industry is working toward driving automation and driver-assistance technology is becoming a norm in modern cars. Warning alert systems support the driver-car interaction and inform drivers about automation system status, upcoming obstacles, or dangers ahead. However, older drivers' needs are not always addressed in research studies, although they make up a large segment of drivers. Therefore, we conducted a qualitative three-round formative evaluation of a warning alert system using video prototypes in lab and remote settings. The goal was to evaluate visual-, sound-, and speech-based alerts based on: (a) their efficiency in informing drivers about the road situation ahead, and (b) participants' subjective opinions. We evaluated the system's efficiency using self-reported data measuring participants' cognitive load, usability, UX, and ease of use. Also, we conducted interviews to collect subjective feedback about proposed prototypes. In this article, we describe the design of warning alerts and report on their evaluation results. Our results show that speech-based warnings, especially when coupled with visual warnings, are efficient and accepted well by the participants. This article illustrates older drivers' attitude toward the use of different warning modalities in the driving context.

Research paper thumbnail of UX Design and Evaluation of Warning Alerts for Semi-autonomous Cars with Elderly Drivers

This paper presents a study on user experience (UX) design and evaluation of warning systems inte... more This paper presents a study on user experience (UX) design and evaluation of warning systems intended for older adults in semi-autonomous cars. We used combinations of visual, auditory, and speech modalities to design the warning alerts and created three low-fidelity, video-based prototypes. We conducted user tests with elderly drivers, both in the lab and remotely, within a test-and-refine approach involving three experiments. The methods used for data collection included Wizard of Oz, standard questionnaires and interviews. We collected qualitative user feedback and self-reported ratings of user experience and cognitive load. We report on the iterative development of our design solution, findings from these user studies, and our methodological insights, that UX researchers and practitioners could use in similar settings.

Research paper thumbnail of Fast Detection and Classification of Drivers’ Responses to Stressful Events and Cognitive Workload

Research paper thumbnail of Measuring driving simulator adaptation using EDA

AHFE international, 2022

Most research about simulator adaptation focus on driving style and participants' comfort. Ho... more Most research about simulator adaptation focus on driving style and participants' comfort. However, in recent years, there is a growing interest in physiological data analysis as part of the user experience (UX) assessment. Furthermore, the application of machine learning (ML) techniques to those data may allow the automatic detection of stress and cognitive load. Previously, we noticed that new participants in experiments with our simulator were often in a constant state of tension. This prevented optimal training of our ML models as many of the collected data were not representative of a person's normal state.Our work focuses on improving driver's UX by keeping the cognitive load and stress at levels that do not interfere with the primary task of driving. We use a custom-made driving simulator as our testing platform and evaluate participants' emotional state with physiological signals, specifically electrodermal activity (EDA). EDA is the variation of the skin conductance created by sweat glands. It is linked to the sympathetic nervous system and is an indication of physiological and psychological arousal. We selected EDA because several studies have shown that it is a fast indicator of stress and cognitive load.To ensure that we are consistently collecting accurate data that could be fed to ML algorithms, we need to be able to correlate physiological reactions to external stimuli. We want to avoid them to be confused with general tension. Therefore, we need to determine the time it takes for most participants to physiologically adapt to our simulator. In this between-subjects study, we examined the impact of short time (ca. 10 min) exposures to the simulation and compared it with a longer exposure period (ca. 35 min).Another problem we faced was that some participants were too indisposed by driving in the simulator to complete testing sessions. Therefore, we needed to find a way to discriminate them during the recruitment process. Literature has shown that there might be a link between motion sickness and simulator sickness and in this study, we searched for a correlation between the motion sickness susceptibility questionnaire (MSSQ) and the self-reported simulator sickness using the simulator sickness questionnaire (SSQ).For our investigation, we recruited 22 people through an agency. They were divided in two groups. Group A (short-time exposures) had 10 participants between 25 and 69 years old (M=49.5; SD=17.1, 5 women, 5 men) and group B (long-time exposure) had 12 people between 28 and 65 years old (M=43; SD=12.8, 5 women, 7 men). We requested from the agency to recruit only active drivers of automatic transmissions cars as our simulator mimics this type of vehicle.Motion sickness susceptibility and discomfort felt in the simulator are moderately correlated. The coefficient value is 0.51. The number of participants of our study being small, further research is necessary to determine if the MSSQ can be used as a discriminator in the recruitment phase. In addition, we can conclude that a longer exposure of 35 min results overall in better physiological adaptation.

Research paper thumbnail of Overcoming Organizational Barriers to the Integration of UX Methods in Software Development: A Case Study

Lecture Notes in Computer Science, 2019

Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate... more Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate it into their processes and UX practitioners still encounter challenges in integrating UX methods. Research in HCI has presented theoretical and pragmatic models. Most of the time, these models lack presenting validation in practice, documentation or support for their use when difficulties appear. Even if difficulties could be expected. In this paper, we present a categorization of organizational barriers extracted from the relevant literature: lack of UX resources, lack of UX literacy, poor use of UX artifacts and communication breakdowns. Then, we propose a 4-step procedure to identify and overcome organizational barriers with a case study describing how this procedure helped us to anticipate and overcome organizational barriers encountered in a project. With a UX Capability/Maturity (UX CM) assessment conducted at the beginning of the project, we were expecting organizational barriers and constant readjustment of our UX strategy. We Communicated about findings and readjustment to stakeholders in order to increase their awareness about problems along the way of the project and we had prepared remediation strategies for the emergence of barriers.

Research paper thumbnail of Measuring UX Capability and Maturity in Organizations

Lecture Notes in Computer Science, 2019

Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover... more Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover, the lack of empirically developed maturity models, models validated in practice, studies demonstrating their benefit and poor documentation or support for their use, has made this measurement even more problematic. To date, there is no straightforward and efficient method to assess UXCM although such assessment is a prerequisite for the improvement of UX processes. UX artifacts, methods and resources contribute toward the execution of UX processes: the production of UX artifacts demonstrate the execution of a process, whereas the use of UX methods demonstrates the implementation of specific UX processes with specific UX resources. In this paper, we present a measurement structure aiming at assessing organizational capabilities to implement UX processes. This structure consists of a capability scale, a maturity scale, a rating scale and a set of process attributes as measurable characteristics of UX processes. The contribution of this paper is threefold: a description of the measurement structure for the UXCM assessment, a questionnaire for the capability assessment by means of online survey or remote interviews and the documentation of a case study demonstrating the efficiency of the proposed model in an industrial project.

Research paper thumbnail of Specification of a UX Process Reference Model towards the Strategic Planning of UX Activities

In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds ... more In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds on the related work and report our experience using it. The UXPRM includes a description of primary UX lifecycle processes, and a classification of UX methods and artifacts. This work draws an accurate picture of UX base practices and allows the reader to compare and select methods for different purposes. Building on that basis, our future work consists of developing a UX Capability/Maturity Model (UXCMM) intended for UX activity planning according to the organization's UX capabilities. Ultimately, the UXCMM aims to facilitate the integration of UX processes in software engineering, which should contribute to reducing the gap between UX research and UX practice.

Research paper thumbnail of A Process Reference Model for UX

Communications in computer and information science, 2020

We propose a process reference model for UX (UXPRM), which includes a description of the primary ... more We propose a process reference model for UX (UXPRM), which includes a description of the primary UX lifecycle processes within a UX lifecycle and a set of supporting UX methods. The primary UX lifecycle processes are refined into objectives, outcomes and base practices. The supporting UX methods are refined into related techniques, specific objectives and references to the related documentation available in the literature. The contribution of the proposed UXPRM is three-fold: conceptual, as it draws an accurate picture of the UX base practices; practical, as it is intended for both researchers and practitioners and customizable for different organizational settings; methodological, as it supports researchers and practitioners to make informed decisions while selecting UX methods and techniques. This is a first step towards the strategic planning of UX activities.

Research paper thumbnail of A Questionnaire for Collecting Data Relevant to UX Experimental Design

Proceedings of the 3rd International Conference on Computer-Human Interaction Research and Applications, 2019

This paper presents the set of experimental cues involved in the UX experiments that define the c... more This paper presents the set of experimental cues involved in the UX experiments that define the characteristics of signals, objects, individuals and prototypes in the lab setting. The contribution of this paper is threefold. First, methodological, as the method employed for creating the questionnaire is reproducible in other domain-applications. Second, practical, as the questionnaire itself can serve as a tool for capturing the experimental cues relevant to the UX evaluation of similar applications. Third, conceptual, as this paper renders a first account of how the questionnaire-collected data can inform other activities ranging from the selection of evaluation methods to the specification of independent variables, UX measures, experimental tasks and apparatus.

Research paper thumbnail of Overcoming Organizational Barriers to the Integration of UX Methods in Software Development: A Case Study

Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate... more Despite User Experience (UX)’ increased popularity, the willingness of organizations to integrate it into their processes and UX practitioners still encounter challenges in integrating UX methods. Research in HCI has presented theoretical and pragmatic models. Most of the time, these models lack presenting validation in practice, documentation or support for their use when difficulties appear. Even if difficulties could be expected. In this paper, we present a categorization of organizational barriers extracted from the relevant literature: lack of UX resources, lack of UX literacy, poor use of UX artifacts and communication breakdowns. Then, we propose a 4-step procedure to identify and overcome organizational barriers with a case study describing how this procedure helped us to anticipate and overcome organizational barriers encountered in a project. With a UX Capability/Maturity (UX CM) assessment conducted at the beginning of the project, we were expecting organizational barrier...

Research paper thumbnail of Measuring UX Capability and Maturity in Organizations

Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover... more Measuring organizational UX Capability/Maturity (UXCM) has been difficult or inaccurate. Moreover, the lack of empirically developed maturity models, models validated in practice, studies demonstrating their benefit and poor documentation or support for their use, has made this measurement even more problematic. To date, there is no straightforward and efficient method to assess UXCM although such assessment is a prerequisite for the improvement of UX processes. UX artifacts, methods and resources contribute toward the execution of UX processes: the production of UX artifacts demonstrate the execution of a process, whereas the use of UX methods demonstrates the implementation of specific UX processes with specific UX resources. In this paper, we present a measurement structure aiming at assessing organizational capabilities to implement UX processes. This structure consists of a capability scale, a maturity scale, a rating scale and a set of process attributes as measurable characte...

Research paper thumbnail of Specification of a UX Process Reference Model towards the Strategic Planning of UX Activities

Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2019

In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds ... more In this conceptual paper, we present a UX process reference model (UXPRM), explain how it builds on the related work and report our experience using it. The UXPRM includes a description of primary UX lifecycle processes, and a classification of UX methods and artifacts. This work draws an accurate picture of UX base practices and allows the reader to compare and select methods for different purposes. Building on that basis, our future work consists of developing a UX Capability/Maturity Model (UXCMM) intended for UX activity planning according to the organization's UX capabilities. Ultimately, the UXCMM aims to facilitate the integration of UX processes in software engineering, which should contribute to reducing the gap between UX research and UX practice.

Research paper thumbnail of Perceived Value of UX in Organizations: A Systematic Literature Review

HCII, 2024

This systematic literature review (SLR) examines what factors affect the perceived value of user ... more This systematic literature review (SLR) examines what factors affect the perceived value of user experience (UX) in organizations. Integrating UX activities into organizational processes and software development is a widely addressed topic in the literature. However, although the social perception of the UX integration process is key for its successful execution, we do not have a concise understanding of this concept. To bridge this gap, we conducted an SLR answering two research questions: 1) What factors influence the perceived value of UX in organizations? and 2) What are the existing tools to measure or evaluate the perceived value of UX? Database search retrieved 49 publications, and we analyzed the content of 14 papers published between 2012 and 2023. The results are divided into six themes, each describing the positive and negative impacts on the perceived value of UX: understanding UX, UX resources, UX culture, perceived UX value, UX management, and UX work organization. Also, we found that the concept of the perceived value of UX is not yet developed in the HCI literature, and no tools have been developed to measure it. Therefore, further research on defining this concept is needed to understand better how social perception of UX affects its integration.

Research paper thumbnail of Subjective Evaluation of Road Situation Alerts Using Visual, Speech and Auditory Modalities with Elderly Drivers

Advances in Human Aspects of Transportation

Research paper thumbnail of Design Requirements for Recommendations in End-User User Interface Design

User interface design has become increasingly difficult due to the rise of new kinds of electroni... more User interface design has become increasingly difficult due to the rise of new kinds of electronic devices and the emergence of the Internet of Things (IoT). Further, user interface (UI) designers struggle to adapt their UIs to evolving user needs and preferences. In order to address these issues, we want to support end users in designing their own user interfaces. However, end-user UI design represents a major challenge, given that end users often lack the necessary design skills. We investigated how design recommendations might be used to address the research question on how to help end users during the UI design process? A first step towards answering this question is the analysis of how end users should best get recommendations about potential design improvements. We therefore conducted a survey on how end users would like to get design recommendations, whether they trust user- or machine-generated recommendations, and whether they agree that their interactions are tracked and shared in order to improve the recommendations. Based on the results of our survey, we present a set of design requirements for the integration of recommendations in end-user UI design tools.