Marjolein Van Der Zwaag - Academia.edu (original) (raw)
Papers by Marjolein Van Der Zwaag
Although emotions are embraced by science, their recognition has not reached a satisfying level. ... more Although emotions are embraced by science, their recognition has not reached a satisfying level. Through a concise overview of affect, its signals, features, and classification methods, we provide understanding for the problems encountered. Next, we identify the prerequisites for successful Affective Signal Processing: validation (e.g., mapping of constructs on signals), triangulation, a physiology-driven approach, and contributions of the signal processing community. Using these directives, a critical analysis of a real-world case is provided. This illustrates that the prerequisites can become a valuable guide for Affective Signal Processing.
BMC Psychiatry, 2016
Depression during pregnancy is a common and high impact disease. Generally, 5-10 % of pregnant wo... more Depression during pregnancy is a common and high impact disease. Generally, 5-10 % of pregnant women suffer from depression. Children who have been exposed to maternal depression during pregnancy have a higher risk of adverse birth outcomes and more often show cognitive, emotional and behavioural problems. Therefore, early detection and treatment of antepartum depression is necessary. Both psychotherapy and antidepressant medication, first choice treatments in a non-pregnant population, have limitations in treating depression during pregnancy. Therefore, it is urgent and relevant to investigate alternative treatments for antepartum depression. Bright light therapy (BLT) is a promising treatment for pregnant women with depressive disorder, for it combines direct availability, sufficient efficacy, low costs and high safety, taking the safety for the unborn child into account as well. In this study, 150 pregnant women (12-18 weeks pregnant) with a DSM-V diagnosis of depressive disorder will be randomly allocated in a 1:1 ratio to one of the two treatment arms: treatment with BLT (9.000 lux) or treatment with dim red light therapy (100 lux). Both groups will be treated for 6 weeks at home on a daily basis for 30 min, within 30 min of habitual wake-up time. Follow-up will take place after 6 weeks of therapy, 3 and 10 weeks after end of therapy, at birth and 2, 6 and 18 months postpartum. Primary outcome will be the average change in depressive symptoms between the two groups, as measured by the Structured Interview Guide for the Hamilton Depression Scale - Seasonal Affective Disorder version and the Edinburg Postnatal Depression Scale. Changes in rating scale scores of these questionnaires over time will be analysed using generalized linear mixed models. Secondary outcomes will be the changes in maternal cortisol and melatonin levels, in maternal sleep quality and gestational age, birth weight, infant behaviour, infant cortisol exposure and infant cortisol stress response. If BLT reduces depressive symptoms in pregnant women, it will provide a safe, cheap, non-pharmacological and efficacious alternative treatment for psychotherapy and antidepressant medication in treating antepartum depression, without any expected adverse reactions for the unborn child. Netherlands Trial Register NTR5476 . Registered 5 November 2015.
Emotions are a core influence on our health and well-being, and are considered a crucial element ... more Emotions are a core influence on our health and well-being, and are considered a crucial element for Ambient Intelligence. This book provides readers with a broad overview of the areas that should be familiar to anyone who wants to work on emotion-oriented computing. In eight parts, the foundations of such systems are presented, including theories and models, affective signal processing, databases, embodied conversational agents and emotion synthesis, persuasion, communication, designing user centric closed-loops, and ethical issues. All in all, this book provides a comprehensive overview of the field and is a very useful introduction for those new to affective computing.
In this paper a people-centred design and creation process is described for a healing environment... more In this paper a people-centred design and creation process is described for a healing environment for acute psychiatric wards. In the realized healing environment several ambient aspects can be controlled by the client via an interactive wall, to empower the client in the healing process. The combination of the ambient aspects with various carefully designed physical aspects aims to create a healing environment that improve the recovery process of clients, improve staff morale, and eventually reduce the number of seclusions. The work described in this paper is a joint effort between Philips Research and the GGzE mental health institute in the Netherlands and is realized in a new build acute psychiatric ward of the GGzE. Currently, a validation study is being executed to gain insights in the number of seclusions and satisfaction of clients and team members with the newly designed rooms.
A new concept aiming to reduce seclusion of clients in mental healthcare is presented in this art... more A new concept aiming to reduce seclusion of clients in mental healthcare is presented in this article. The concept, which has been installed as a prototype at the GGzE institute in Eindhoven includes dynamic lighting and a large interactive touchscreen. The concept is designed from a user perspective with the aim of reducing stress and anxiety for both staff and client. An important aspect is the large interactive screen with adaptable functionality that can be matched to specific needs of the client at different stages of escalation and recovery. Coupled to this is a control system that empowers the staff to control the therapeutic environment and set the sensory stimuli to an optimum level for the mental state of the client. This publication focuses on the design considerations and implementation of the staff screen. The concept illustrates the possibility of using technology to reduce seclusions in mental healthcare.
2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops, 2008
As software is more and more interweaving with our everyday life, designing software in a way tha... more As software is more and more interweaving with our everyday life, designing software in a way that it reflects and respects the user and her emotional physical conditions, cognitive engagement, and emotional state, become imperative. However, how such human-centred pervasive adaptive applications are to be designed and realized is still hardly understood. Both engineering approaches and runtime support for such applications are still in their infancy. In this paper, we present the REFLECTive middleware, a framework that facilitates the development and operation of such applications. The middleware is explained on the base of an envisioned example, the affective music player. By offering design patterns geared towards pervasive adaptive applications and leveraging them for achieving adaptivity, the REFLECTive middleware support a systematic and clear approach to engineering and deploying humancentred pervasive adaptive applications in daily life situations.
International Journal of Human Factors and Ergonomics, 2012
Lecture Notes in Computer Science, 2011
ABSTRACT While studying body postures in relation to mood is not a new concept, the majority of t... more ABSTRACT While studying body postures in relation to mood is not a new concept, the majority of these studies rely on actors interpretations. This project investigated the temporal aspects of naturalistic body postures while users listened to mood inducing music. Video data was collected while participants listened to eight minutes of music during two sessions (happy and sad) in a within-subjects design. Subjectively reported mood scores validated that mood did differ significantly for valence and energy. Video analysis consisted of postural ratings for the head, shoulders, trunk, arms, and head and hand tapping. Results showed significant differences for the majority of these dimensions by mood. This study showed that certain body postures are indicative of certain mood states in a naturalistic setting.
Lecture Notes in Computer Science, 2011
Driver anger could be potentially harmful for road safety and long-term health. Because of its mo... more Driver anger could be potentially harmful for road safety and long-term health. Because of its mood inducing properties, music is assumed to be a potential medium that could prevent anger induction during driving. In the current study the influence of music on anger, mood, skin conductance, and systolic blood pressure was investigated during anger inducing scenarios in a driving simulator. 100 participants were split into five groups: four listened to different types of music (high/low energy in combination with both positive/negative ...
IEEE Transactions on Affective Computing, 2013
Physiology & Behavior, 2014
Musicae Scientiae, 2011
People often listen to music to influence their emotional state. However, the specific musical ch... more People often listen to music to influence their emotional state. However, the specific musical characteristics which cause this process are not yet fully understood. We have investigated the influence of the musical characteristics of tempo, mode, and percussiveness on our emotions. In a quest towards ecologically valid results, 32 participants listened to 16 pop and 16 rock songs while conducting an office task. They rated experienced arousal, valence, and tension, while skin conductance and cardiovascular responses were recorded. An increase in tempo was found to lead to an increase in reported arousal and tension and a decrease in heart rate variability. More arousal was reported during minor than major mode songs. Level and frequency of skin conductance responses increased with an increase in percussiveness. Physiological responses revealed patterns that might not have been revealed by self-report. Interaction effects further suggest that musical characteristics interplay in modulating emotions. So, tempo, mode, and percussiveness indeed modulate our emotions and, consequently, can be used to direct emotions. Music presentation revealed subtly different results in a laboratory setting, where music was altered with breaks, from those in a more ecologically valid setting where continuous music was presented. All in all, this enhances our understanding of the influence of music on emotions and creates opportunities seamlessly to tap into listeners' emotional state through their physiological responses.
Ergonomics, 2013
This study investigated whether gradual or abrupt music change towards more calming music is most... more This study investigated whether gradual or abrupt music change towards more calming music is most effective in calming drivers during high-demand driving situations. Twenty-eight participants were subjected to two types of music change (gradual, abrupt) in a within-subject design. First, a relatively happy mood was induced with personally selected music during an eight-minute simulated high-demand drive. The drive then continued and the mood was changed either gradually or abruptly. Subjective results showed successful music mood induction irrespective of gradual or abrupt changes. The results further showed lower skin conductance (less arousal) and more facial corrugator muscle tension (more sadness) during the abrupt music change. Fewer accidents occurred during the abrupt music mood change. To conclude, the results support the abrupt way of changing music type to down-regulate one's mood: during high-demand driving, abrupt changes in music led to more physiological calmness and improved driving performance, and were thus safer and more effective. The current study shows that during high-demand drives, drivers are calmed more effectively using abrupt music changes compared to gradual music changes. This is illustrated by reductions in physiological arousal and improved driving behaviour. Hence, in-car music presentation can be used as a tool to improve driver's mood and behaviour.
Ergonomics, 2012
Mood can influence our everyday behaviour and people often seek to reinforce, or to alter their m... more Mood can influence our everyday behaviour and people often seek to reinforce, or to alter their mood, for example by turning on music. Music listening while driving is a popular activity. However, little is known about the impact of music listening while driving on physiological state and driving performance. In the present experiment, it was investigated whether individually selected music can induce mood and maintain moods during a simulated drive. In addition, effects of positive, negative, and no music on driving behaviour and physiological measures were assessed for normal and high cognitive demanding rides. Subjective mood ratings indicated that music successfully maintained mood while driving. Narrow lane width drives increased task demand as shown in effort ratings and increased swerving. Furthermore, respiration rate was lower during music listening compared to rides without music, while no effects of music were found on heart rate. Overall, the current study demonstrates that music listening in car influences the experienced mood while driving, which in turn can impact driving behaviour.
Unobtrusive physiological sensors that seamlessly integrate in the automotive environment provide... more Unobtrusive physiological sensors that seamlessly integrate in the automotive environment provide a novel way to measure driver’s health and well-being. A driver pilot was conducted to test the accuracy of some new unobtrusive and wearable physiological sensors that currently are under development. Six drivers drove a pre-defined route twice, once during light and once during dark conditions. The drive included different road types to be able to identify possible differences in measurement precision. Heart rate measurements were done using a standard ECG method as well as via two types of unobtrusive measurements. These included a watch equipped with a photo-plethysmograph and a driver seat that was equipped with capacitive ECG sensors. Skin conductance levels were measured by means of dry sensors at the finger and a wristwatch was used for unobtrusive skin conductance measurements. Results show high intraclass correlation between the unobtrusive and reference physiological measurem...
Biosignals, peripheral or from the brain, can be used to recognize mental states. Subsequently, t... more Biosignals, peripheral or from the brain, can be used to recognize mental states. Subsequently, these signals can be employed to enhance user experiences. This paper identifies challenges that have to be faced with processing such signals and defines guidelines to tackle them. We pose that these guidelines can initialize a leap forward in the development of real-time biosignaldriven adaptive systems.
Although emotions are embraced by science, their recognition has not reached a satisfying level. ... more Although emotions are embraced by science, their recognition has not reached a satisfying level. Through a concise overview of affect, its signals, features, and classification methods, we provide understanding for the problems encountered. Next, we identify the prerequisites for successful Affective Signal Processing: validation (e.g., mapping of constructs on signals), triangulation, a physiology-driven approach, and contributions of the signal processing community. Using these directives, a critical analysis of a real-world case is provided. This illustrates that the prerequisites can become a valuable guide for Affective Signal Processing.
Although emotions are embraced by science, their recognition has not reached a satisfying level. ... more Although emotions are embraced by science, their recognition has not reached a satisfying level. Through a concise overview of affect, its signals, features, and classification methods, we provide understanding for the problems encountered. Next, we identify the prerequisites for successful Affective Signal Processing: validation (e.g., mapping of constructs on signals), triangulation, a physiology-driven approach, and contributions of the signal processing community. Using these directives, a critical analysis of a real-world case is provided. This illustrates that the prerequisites can become a valuable guide for Affective Signal Processing.
BMC Psychiatry, 2016
Depression during pregnancy is a common and high impact disease. Generally, 5-10 % of pregnant wo... more Depression during pregnancy is a common and high impact disease. Generally, 5-10 % of pregnant women suffer from depression. Children who have been exposed to maternal depression during pregnancy have a higher risk of adverse birth outcomes and more often show cognitive, emotional and behavioural problems. Therefore, early detection and treatment of antepartum depression is necessary. Both psychotherapy and antidepressant medication, first choice treatments in a non-pregnant population, have limitations in treating depression during pregnancy. Therefore, it is urgent and relevant to investigate alternative treatments for antepartum depression. Bright light therapy (BLT) is a promising treatment for pregnant women with depressive disorder, for it combines direct availability, sufficient efficacy, low costs and high safety, taking the safety for the unborn child into account as well. In this study, 150 pregnant women (12-18 weeks pregnant) with a DSM-V diagnosis of depressive disorder will be randomly allocated in a 1:1 ratio to one of the two treatment arms: treatment with BLT (9.000 lux) or treatment with dim red light therapy (100 lux). Both groups will be treated for 6 weeks at home on a daily basis for 30 min, within 30 min of habitual wake-up time. Follow-up will take place after 6 weeks of therapy, 3 and 10 weeks after end of therapy, at birth and 2, 6 and 18 months postpartum. Primary outcome will be the average change in depressive symptoms between the two groups, as measured by the Structured Interview Guide for the Hamilton Depression Scale - Seasonal Affective Disorder version and the Edinburg Postnatal Depression Scale. Changes in rating scale scores of these questionnaires over time will be analysed using generalized linear mixed models. Secondary outcomes will be the changes in maternal cortisol and melatonin levels, in maternal sleep quality and gestational age, birth weight, infant behaviour, infant cortisol exposure and infant cortisol stress response. If BLT reduces depressive symptoms in pregnant women, it will provide a safe, cheap, non-pharmacological and efficacious alternative treatment for psychotherapy and antidepressant medication in treating antepartum depression, without any expected adverse reactions for the unborn child. Netherlands Trial Register NTR5476 . Registered 5 November 2015.
Emotions are a core influence on our health and well-being, and are considered a crucial element ... more Emotions are a core influence on our health and well-being, and are considered a crucial element for Ambient Intelligence. This book provides readers with a broad overview of the areas that should be familiar to anyone who wants to work on emotion-oriented computing. In eight parts, the foundations of such systems are presented, including theories and models, affective signal processing, databases, embodied conversational agents and emotion synthesis, persuasion, communication, designing user centric closed-loops, and ethical issues. All in all, this book provides a comprehensive overview of the field and is a very useful introduction for those new to affective computing.
In this paper a people-centred design and creation process is described for a healing environment... more In this paper a people-centred design and creation process is described for a healing environment for acute psychiatric wards. In the realized healing environment several ambient aspects can be controlled by the client via an interactive wall, to empower the client in the healing process. The combination of the ambient aspects with various carefully designed physical aspects aims to create a healing environment that improve the recovery process of clients, improve staff morale, and eventually reduce the number of seclusions. The work described in this paper is a joint effort between Philips Research and the GGzE mental health institute in the Netherlands and is realized in a new build acute psychiatric ward of the GGzE. Currently, a validation study is being executed to gain insights in the number of seclusions and satisfaction of clients and team members with the newly designed rooms.
A new concept aiming to reduce seclusion of clients in mental healthcare is presented in this art... more A new concept aiming to reduce seclusion of clients in mental healthcare is presented in this article. The concept, which has been installed as a prototype at the GGzE institute in Eindhoven includes dynamic lighting and a large interactive touchscreen. The concept is designed from a user perspective with the aim of reducing stress and anxiety for both staff and client. An important aspect is the large interactive screen with adaptable functionality that can be matched to specific needs of the client at different stages of escalation and recovery. Coupled to this is a control system that empowers the staff to control the therapeutic environment and set the sensory stimuli to an optimum level for the mental state of the client. This publication focuses on the design considerations and implementation of the staff screen. The concept illustrates the possibility of using technology to reduce seclusions in mental healthcare.
2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops, 2008
As software is more and more interweaving with our everyday life, designing software in a way tha... more As software is more and more interweaving with our everyday life, designing software in a way that it reflects and respects the user and her emotional physical conditions, cognitive engagement, and emotional state, become imperative. However, how such human-centred pervasive adaptive applications are to be designed and realized is still hardly understood. Both engineering approaches and runtime support for such applications are still in their infancy. In this paper, we present the REFLECTive middleware, a framework that facilitates the development and operation of such applications. The middleware is explained on the base of an envisioned example, the affective music player. By offering design patterns geared towards pervasive adaptive applications and leveraging them for achieving adaptivity, the REFLECTive middleware support a systematic and clear approach to engineering and deploying humancentred pervasive adaptive applications in daily life situations.
International Journal of Human Factors and Ergonomics, 2012
Lecture Notes in Computer Science, 2011
ABSTRACT While studying body postures in relation to mood is not a new concept, the majority of t... more ABSTRACT While studying body postures in relation to mood is not a new concept, the majority of these studies rely on actors interpretations. This project investigated the temporal aspects of naturalistic body postures while users listened to mood inducing music. Video data was collected while participants listened to eight minutes of music during two sessions (happy and sad) in a within-subjects design. Subjectively reported mood scores validated that mood did differ significantly for valence and energy. Video analysis consisted of postural ratings for the head, shoulders, trunk, arms, and head and hand tapping. Results showed significant differences for the majority of these dimensions by mood. This study showed that certain body postures are indicative of certain mood states in a naturalistic setting.
Lecture Notes in Computer Science, 2011
Driver anger could be potentially harmful for road safety and long-term health. Because of its mo... more Driver anger could be potentially harmful for road safety and long-term health. Because of its mood inducing properties, music is assumed to be a potential medium that could prevent anger induction during driving. In the current study the influence of music on anger, mood, skin conductance, and systolic blood pressure was investigated during anger inducing scenarios in a driving simulator. 100 participants were split into five groups: four listened to different types of music (high/low energy in combination with both positive/negative ...
IEEE Transactions on Affective Computing, 2013
Physiology & Behavior, 2014
Musicae Scientiae, 2011
People often listen to music to influence their emotional state. However, the specific musical ch... more People often listen to music to influence their emotional state. However, the specific musical characteristics which cause this process are not yet fully understood. We have investigated the influence of the musical characteristics of tempo, mode, and percussiveness on our emotions. In a quest towards ecologically valid results, 32 participants listened to 16 pop and 16 rock songs while conducting an office task. They rated experienced arousal, valence, and tension, while skin conductance and cardiovascular responses were recorded. An increase in tempo was found to lead to an increase in reported arousal and tension and a decrease in heart rate variability. More arousal was reported during minor than major mode songs. Level and frequency of skin conductance responses increased with an increase in percussiveness. Physiological responses revealed patterns that might not have been revealed by self-report. Interaction effects further suggest that musical characteristics interplay in modulating emotions. So, tempo, mode, and percussiveness indeed modulate our emotions and, consequently, can be used to direct emotions. Music presentation revealed subtly different results in a laboratory setting, where music was altered with breaks, from those in a more ecologically valid setting where continuous music was presented. All in all, this enhances our understanding of the influence of music on emotions and creates opportunities seamlessly to tap into listeners' emotional state through their physiological responses.
Ergonomics, 2013
This study investigated whether gradual or abrupt music change towards more calming music is most... more This study investigated whether gradual or abrupt music change towards more calming music is most effective in calming drivers during high-demand driving situations. Twenty-eight participants were subjected to two types of music change (gradual, abrupt) in a within-subject design. First, a relatively happy mood was induced with personally selected music during an eight-minute simulated high-demand drive. The drive then continued and the mood was changed either gradually or abruptly. Subjective results showed successful music mood induction irrespective of gradual or abrupt changes. The results further showed lower skin conductance (less arousal) and more facial corrugator muscle tension (more sadness) during the abrupt music change. Fewer accidents occurred during the abrupt music mood change. To conclude, the results support the abrupt way of changing music type to down-regulate one's mood: during high-demand driving, abrupt changes in music led to more physiological calmness and improved driving performance, and were thus safer and more effective. The current study shows that during high-demand drives, drivers are calmed more effectively using abrupt music changes compared to gradual music changes. This is illustrated by reductions in physiological arousal and improved driving behaviour. Hence, in-car music presentation can be used as a tool to improve driver's mood and behaviour.
Ergonomics, 2012
Mood can influence our everyday behaviour and people often seek to reinforce, or to alter their m... more Mood can influence our everyday behaviour and people often seek to reinforce, or to alter their mood, for example by turning on music. Music listening while driving is a popular activity. However, little is known about the impact of music listening while driving on physiological state and driving performance. In the present experiment, it was investigated whether individually selected music can induce mood and maintain moods during a simulated drive. In addition, effects of positive, negative, and no music on driving behaviour and physiological measures were assessed for normal and high cognitive demanding rides. Subjective mood ratings indicated that music successfully maintained mood while driving. Narrow lane width drives increased task demand as shown in effort ratings and increased swerving. Furthermore, respiration rate was lower during music listening compared to rides without music, while no effects of music were found on heart rate. Overall, the current study demonstrates that music listening in car influences the experienced mood while driving, which in turn can impact driving behaviour.
Unobtrusive physiological sensors that seamlessly integrate in the automotive environment provide... more Unobtrusive physiological sensors that seamlessly integrate in the automotive environment provide a novel way to measure driver’s health and well-being. A driver pilot was conducted to test the accuracy of some new unobtrusive and wearable physiological sensors that currently are under development. Six drivers drove a pre-defined route twice, once during light and once during dark conditions. The drive included different road types to be able to identify possible differences in measurement precision. Heart rate measurements were done using a standard ECG method as well as via two types of unobtrusive measurements. These included a watch equipped with a photo-plethysmograph and a driver seat that was equipped with capacitive ECG sensors. Skin conductance levels were measured by means of dry sensors at the finger and a wristwatch was used for unobtrusive skin conductance measurements. Results show high intraclass correlation between the unobtrusive and reference physiological measurem...
Biosignals, peripheral or from the brain, can be used to recognize mental states. Subsequently, t... more Biosignals, peripheral or from the brain, can be used to recognize mental states. Subsequently, these signals can be employed to enhance user experiences. This paper identifies challenges that have to be faced with processing such signals and defines guidelines to tackle them. We pose that these guidelines can initialize a leap forward in the development of real-time biosignaldriven adaptive systems.
Although emotions are embraced by science, their recognition has not reached a satisfying level. ... more Although emotions are embraced by science, their recognition has not reached a satisfying level. Through a concise overview of affect, its signals, features, and classification methods, we provide understanding for the problems encountered. Next, we identify the prerequisites for successful Affective Signal Processing: validation (e.g., mapping of constructs on signals), triangulation, a physiology-driven approach, and contributions of the signal processing community. Using these directives, a critical analysis of a real-world case is provided. This illustrates that the prerequisites can become a valuable guide for Affective Signal Processing.