Emotional Voice Modulates the Recognition of Facial Expression: Evidences from an ERP Study

Journal of Psychological Science ›› 2013, Vol. 36 ›› Issue (1) : 33-37.

PDF(476 KB)
PDF(476 KB)
Journal of Psychological Science ›› 2013, Vol. 36 ›› Issue (1) : 33-37.

Emotional Voice Modulates the Recognition of Facial Expression: Evidences from an ERP Study

  • 1,
Author information +
History +

Abstract

Continuous integration of information from multiple sensory inputs is very important for daily life of human being. But the mechanisms underlying the interaction of cross-modal stimulus processing failed to draw sufficient attention, especially on the cross-modal interaction of the stimulus containing emotional significance. This study aimed to investigate the neural mechanism of interaction of emotional voice and facial expression. Event-related potentials(ERP) technique and cross-modal priming paradigm were used to explore the influence of emotional voice on the recognition of facial expression. The materials consisted of 240 prime-target pairs using voices as primes and facial expressions as targets. Neutral semantic words were spoken with happy or angry prosody and followed by congruous or incongruous facial expressions. The participants were asked to judge the consistency between the valence of emotional voice and facial expression, during which ERPs were recorded. Each trial began with a central fixation cross presented for 500ms, then the priming stimuli(emotional voice) was presented through headphone. The central fixation cross displayed on the screen until the target(facial expression) was presented. The inter-stimulus-interval(ISI) is 1000ms. The facial expression was presented for 500ms, followed by a black screen for 2000-2200ms. After the presentation of facial expression, participants were instructed to indicate the consistence of valance between the emotional voice and facial expression by pressing a mouse button as quickly and accurately as possible. The results were analyzed by Repeated Measure ANOVA. The response time (RT) results showed that subjects responded more quickly to the congruous trials than the incongruous trials. It suggested the existence of the priming effect of emotional voice on recognition of emotional facial expression. The analysis of ERPs waveforms indicated that emotional voice modulates the time course of processing of facial expression. At the time window of 70-130ms and 220-450ms, facial expressions evoked more negative waveforms in incongruous trials than in congruous trials. At the time window of 450-750ms, facial expressions evoked more positive late positive component(LPC) in incongruous trials than in congruous trials. The ERPs results suggested that emotional voice influences the processing of emotional facial expression at the early perception stage, the emotional significance evaluation stage and the subsequent decision-making stage. This study demonstrated that emotional voice can influence the processing of facial expression in a cross-modal manner, and provided converging evidences for the interaction of multi-sensory inputs.

Key words

emotional voice / facial expression / cross-modal / event-related potential(ERP)

Cite this article

Download Citations
Emotional Voice Modulates the Recognition of Facial Expression: Evidences from an ERP Study[J]. Journal of Psychological Science. 2013, 36(1): 33-37
PDF(476 KB)

Accesses

Citation

Detail

Sections
Recommended

/