Hearing Impairment and Emotion Identification from Auditory and Visual Stimuli (original) (raw)
Related papers
Hearing Aids Benefit Recognition of Words in Emotional Speech but Not Emotion Identification
Trends in hearing
Vocal emotion perception is an important part of speech communication and social interaction. Although older adults with normal audiograms are known to be less accurate at identifying vocal emotion compared to younger adults, little is known about how older adults with hearing loss perceive vocal emotion or whether hearing aids improve the perception of emotional speech. In the main experiment, older hearing aid users were presented with sentences spoken in seven emotion conditions, with and without their own hearing aids. Listeners reported the words that they heard as well as the emotion portrayed in each sentence. The use of hearing aids improved word-recognition accuracy in quiet from 38.1% (unaided) to 65.1% (aided) but did not significantly change emotion-identification accuracy (36.0% unaided, 41.8% aided). In a follow-up experiment, normal-hearing young listeners were tested on the same stimuli. Normal-hearing younger listeners and older listeners with hearing loss showed si...
Findings from several studies have suggested that deaf children have difficulties with emotion identification and that these may impact upon social skills. The authors of these studies have typically attributed such problems to delayed language acquisition and/or opportunity to converse about personal experiences with other people. The current study aimed to investigate emotion identification in children with varying levels of deafness by specifically testing their ability to recognize perceptual aspects of emotions depicted in upright or inverted human and cartoon faces. The findings from the study showed that, in comparison with both chronological- and mental-age-matched controls, the deaf children were significantly worse at identifying emotions. However, like controls, their performance decreased when emotions were presented on the inverted faces, thus indexing a typical configural processing style. No differences were found across individuals with different levels of deafness or in those with and without signing family members. The results are supportive of poor emotional identification in hearing-impaired children and are discussed in relation to delays in language acquisition and intergroup differences in perceptual processing.
Frontiers in Psychology, 2015
A poorly understood aspect of deaf people (DP) is how their emotional information is processed. Verbal ability is key to improve emotional knowledge in people. Nevertheless, DP are unable to distinguish intonation, intensity, and the rhythm of language due to lack of hearing. Some DP have acquired both lip-reading abilities and sign language, but others have developed only sign language. PERVALE-S was developed to assess the ability of DP to perceive both social and basic emotions. PERVALE-S presents different sets of visual images of a real deaf person expressing both basic and social emotions, according to the normative standard of emotional expressions in Spanish Sign Language. Emotional expression stimuli were presented at two different levels of intensity (1: low; and 2: high) because DP do not distinguish an object in the same way as hearing people (HP) do. Then, participants had to click on the more suitable emotional expression. PERVALE-S contains video instructions (given by a sign language interpreter) to improve DP's understanding about how to use the software. DP had to watch the videos before answering the items. To test PERVALE-S, a sample of 56 individuals was recruited (18 signers, and 30 HP). Participants also performed a personality test (High School Personality Questionnaire adapted) and a fluid intelligence (Gf) measure (RAPM). Moreover, all deaf participants were rated by four teachers for the deaf. Results: there were no significant differences between deaf and HP in performance in PERVALE-S. Confusion matrices revealed that embarrassment, envy, and jealousy were worse perceived. Age was just related to social-emotional tasks (but not in basic emotional tasks). Emotional perception ability was related mainly to warmth and consciousness, but negatively related to tension. Meanwhile, Gf was related to only social-emotional tasks. There were no gender differences.
Interpreting Behaviour and Emotions for People with Deafblindness
2018
This case study investigates interpreting emotions and behaviour for the deafblind. Here we give examples on the different methods used for enhancing emotions based on sign language, speech-to-text and other types of interpreting. The group in question consists of individuals with a hearing impairment (the deaf and hard-of-hearing groups), individuals with a dual-sensory impairment and individuals with a deafblindness. The study investigates the interpreting process as a means to increase a person’s social inclusion and well-being. The examples given in the article consist of different types of interprets received by the individuals within a film watching event. A further note is made on venue layout and individual needs with regards to interpreting needs and preferences.
Emotion Understanding in Deaf Children with a Cochlear Implant
Journal of Deaf Studies and Deaf Education, 2013
It is still largely unknown how receiving a cochlear implant affects the emotion understanding in deaf children. We examined indices for emotion understanding and their associations with communication skills in children aged 2.5-5 years, both hearing children (n = 52) and deaf children with a cochlear implant (n = 57). 2 aspects of emotion understanding were examined: (a) emotion recognition in facial expressions and (b) emotion attribution in a situational context. On all emotion-understanding tasks, children with a cochlear implant were less proficient than children with normal hearing. In children with normal hearing, performance and language skills were positively associated. In children with cochlear implants, language was positively associated only with tasks in which a verbal demand was made on children. These findings indicate that hearing loss in children, despite a cochlear implant, affects all aspects of emotion understanding measured in this study, including their nonverbal emotion-understanding skills.
Hearing Research, 2017
Visual processing has been extensively explored in deaf subjects in the context of verbal communication, through the assessment of speech reading and sign language abilities. However, little is known about visual emotional processing in adult progressive deafness, and after cochlear implantation. The goal of our study was thus to assess the influence of acquired post-lingual progressive deafness on the recognition of dynamic facial emotions that were selected to express canonical fear, happiness, sadness, and anger. A total of 23 adults with post-lingual deafness separated into two groups; those assessed either before (n ¼ 10) and those assessed after (n ¼ 13) cochlear implantation (CI); and 13 normal hearing (NH) individuals participated in the current study. Participants were asked to rate the expression of the four cardinal emotions, and to evaluate both their emotional valence (unpleasant-pleasant) and arousal potential (relaxing-stimulating). We found that patients with deafness were impaired in the recognition of sad faces, and that patients equipped with a CI were additionally impaired in the recognition of happiness and fear (but not anger). Relative to controls, all patients with deafness showed a deficit in perceiving arousal expressed in faces, while valence ratings remained unaffected. The current results show for the first time that acquired and progressive deafness is associated with a reduction of emotional sensitivity to visual stimuli. This negative impact of progressive deafness on the perception of dynamic facial cues for emotion recognition contrasts with the proficiency of deaf subjects with and without CIs in processing visual speech cues (Rouger et al., 2007; Strelnikov et al., 2009; Lazard and Giraud, 2017). Altogether these results suggest there to be a trade-off between the processing of linguistic and nonlinguistic visual stimuli.
Trends in hearing
The question of how hearing loss and hearing rehabilitation affect patients' momentary emotional experiences is one that has received little attention but has considerable potential to affect patients' psychosocial function. This article is a product from the Hearing, Emotion, Amplification, Research, and Training workshop, which was convened to develop a consensus document describing research on emotion perception relevant for hearing research. This article outlines conceptual frameworks for the investigation of emotion in hearing research; available subjective, objective, neurophysiologic, and peripheral physiologic data acquisition research methods; the effects of age and hearing loss on emotion perception; potential rehabilitation strategies; priorities for future research; and implications for clinical audiologic rehabilitation. More broadly, this article aims to increase awareness about emotion perception research in audiology and to stimulate additional research on th...
Multisensory emotion perception in congenitally, early, and late deaf CI users
PloS one, 2017
Emotions are commonly recognized by combining auditory and visual signals (i.e., vocal and facial expressions). Yet it is unknown whether the ability to link emotional signals across modalities depends on early experience with audio-visual stimuli. In the present study, we investigated the role of auditory experience at different stages of development for auditory, visual, and multisensory emotion recognition abilities in three groups of adolescent and adult cochlear implant (CI) users. CI users had a different deafness onset and were compared to three groups of age- and gender-matched hearing control participants. We hypothesized that congenitally deaf (CD) but not early deaf (ED) and late deaf (LD) CI users would show reduced multisensory interactions and a higher visual dominance in emotion perception than their hearing controls. The CD (n = 7), ED (deafness onset: <3 years of age; n = 7), and LD (deafness onset: >3 years; n = 13) CI users and the control participants perfo...
Emotional Recognition and Empathy both in Deaf and Blind Adults
The Journal of Deaf Studies and Deaf Education, 2018
Studies addressing the recognition of emotions in blind or deaf participants have been carried out only with children and adolescents. Due to these age limits, such studies do not clarify the long-term effects of vision and hearing disabilities on emotion recognition in adults. We assessed the ability to recognize basic emotions in 15 deaf adults (aged 32.4 ± 8.1 yrs) and in 15 blind adults (48.3 ± 10.5 yrs). Auditory and visual stimuli expressing six basic emotional states were presented to participants (Florida Affect Battery). Participants also performed an empathy test. Deaf participants showed difficulties in emotion recognition tasks compared to the typical hearing participants; however, differences were only statistically reliable for Facial Emotion Discrimination and Naming tasks (specifically, naming expressions of fear). Deaf participants also revealed inferior levels of cognitive empathy. Concerning blind participants, their performance was lower than the controls' only when the task required the evaluation of emotional prosody while ignoring the semantic content of the sentence. Overall, although deaf and blind participants performed reasonably well on tasks requiring recognition of basic emotions, sensory loss may hinder their social perception skills when processing subtle emotions or when the extraction of simultaneous prosodic and semantic information is required.