Abstract: Abstract Changeable aspects of faces, such as gaze shifts and facial expressions, provide human with powerful social signals that permit inferences about the internal states and intentions of others. It is important for observer to understand how facial expression and gaze direction change in social situations. In order to investigate the problem, the current study adopted spatial cues paradigm to examine the impact of concurrent changes in cue and target emotion and their interactions with gaze shifts during attentional orienting. Each trial consisted of a dynamic neutral face cue stimulus and a neutral word target in the first experiment. Subjects should look at faces gazed ahead in the first frame for 300ms. The second frame consisted of a left, direct, or right eye gaze for 300 or 700ms. Subjects were to determine where words would appear in the third frame. The goal was to confirm gaze cuing effect. During the second experiment，the only difference was face cues. Fearful and happy expression faces adopted in the second frame. Participants’ reaction was the same with that in the first experiment. We obtained the results suggest there was gaze cuing effect in neutral and emotional faces in both stimulus onset asynchrony. But only in long stimulus onset asynchrony, the difference of cuing effect amount was significant between fearful and neutral faces as well as fearful and happy faces. But happy face isn’t significantly different from neutral one. So gaze and emotional expression may be processed in separate streams at first. Facial expression took precedence over gaze direction with respect to its early effect. Then facial expression and gaze direction interacted after some time. Besides behavioral data，Event-related Potentials(ERP) data acquisition by 128 electrode cap link with Net Station showed the main effect of emotion appeared in P1 triggered by expression cues. The amplitude of P1 induced by fearful faces was bigger than the other two expressions. It showed fearful expression indicated potential dangerous in environment. So observers needed more attentional resources to react appropriately. The brain components of P1 and N1 evoked by target reflected main effect of cuing effect. The P1 and N1 amplitude was bigger when the target was opposite the position cued by faces. In sum，the current study illustrated that how individuals process attentional orienting in different emotional faces when they can’t predict the outcome of environment. ERP analysis also showed that the emotion and direction of gaze separated in early stage. And then they interacted after full processing. This research explored the time course integration of facial expression and gaze direction which has not been studied before. The behavioral and ERP results provided us new evidence of different effects about gaze direction and expression. It helped us describe the physiological mechanisms in human brain of joint attention and social reference.

Key words: facial expression, attentional orienting, Event-related Potentials(ERP)

摘要： 摘 要 本文以三种表情面孔为材料，运用事件相关电位（ERP）方法探讨表情线索在注意朝向中与注视转移发生的交互及两者如何共同影响观察者的反应。结果发现：（1）线索效应在三种表情面孔的两种SOA中都出现了；（2）SOA较长时，注视线索效应量间的显著差异出现在中性和恐惧面孔、高兴和恐惧面孔间；（3）面部表情的效应出现在了表情线索诱发的P1成分上；（4）目标诱发的P1和N1说明了注视线索效应的存在及与表情间的交互。结论：表情线索先对观察者的朝向反应产生影响，随后是注视线索及其与表情线索发生的交互。

关键词: 表情, 注意朝向, 事件相关电位