In Previous study, we found a cross-modal mapping effect between person's name pronunciation and face shape. Participants tended to think that round lip names match round face, flat lip names match sharp face (Yan et al., 2020). However, there are mainly two different views on the formation mechanism of sound shape cross modal mapping: shared physical perceptual attributes and shared connotative attributes (Sidhu & Pexman, 2018). Considering that the pronunciation of names also contained round lip / flat lip vowels (/ o / or / i /), which had the stimulation basis to convey the concept of shape, and the face shape was also a more vivid feature of the face, there might be conceptual connection between the pronunciation of names and the face. Therefore, this study used ERP technology with high temporal resolution to reveal which stage of the cognitive processing occurs in the cross-modal correspondence effect between name pronunciation and face shape, and to explore whether there is a relationship between name pronunciation and face shape.
In the ERP research conducted by Zhou et al. (2016) using the priming paradigm, music clips that can convey the concept of space (closed or open space) were used as the priming material, and pictures showing the space scene (open or closed space scene pictures) were used as the target material, so that the subjects could judge whether the target picture was an open scene or a closed scene. The results showed that music and pictures were related to the spatial concept. Inspired by this research, this study used priming paradigm and face shape judgment task (used name pronunciation as priming stimulus and face material as target stimulus) to investigate whether name pronunciation could directly initiate face shape processing.
In behavior results, we found that the correct rate of the subjects under the consistent condition is significantly higher than that under the inconsistent condition, and the reaction time under the consistent condition is significantly lower than that under the inconsistent condition. In event-related potential results, we found that there was no significant experimental effect showed in the early stage of face processing indexed by P1 (occipital area) and N170 (bilateral occipitotemporal area). On the other hand, compared with the consistent condition, we found that N400 was more negative in the central -parietal region of the brain under inconsistent conditions.
In summary, the behavioral and ERP results of this study consistently show that there is a relationship between the pronunciation of names and the shape concept of faces, Furthermore, there is no evidence to support that the priming effect occurs in the early stage of face processing, and there is no evidence that name pronunciation and face share physical perceptual attributes. The N400 component reflecting semantic violation presented the difference between the consistent and the inconsistent condition, which confirmed that there is a conceptual connection between the pronunciation of names and the shape of faces.
{{custom_sec.title}}
{{custom_sec.title}}
{{custom_sec.content}}
References
丁瑛, 庞隽, 王妍苏. (2019). 形状-性别内隐联结及其对消费者形状偏好的影响. 心理学报, 51(2), 216-226.
蒋存梅. (2016). 音乐心理学 (pp. 138–220). 上海: 华东师范大学出版社.
闫向博, 蒋重清, 冷海州, 李东. (2020). 人名发音与脸型的跨模态映射效应. 心理科学, 43(5), 1125-1131.
叶浩生. (2011). 有关具身认知思潮的理论心理学思考.心理学报, 43(5), 589-598.
余习德, 鲁成, 熊希灵, 高定国. (2017). 音乐意义传递的神经证据——基于启动范式的发现与思考. 心理科学进展, 25(5), 742-756.
Angier, N. (2010). Abstract thoughts? The body takes them literally. The New York Times, 159, 54.
Barton, D. N., & Halberstadt, J. (2018). A social bouba/kiki effect: a bias for people whose names match their faces. Psychonomic Bulletin & Review, 25, 1013–1020.
Campanella, S., & Belin, P. (2007). Integrating face and voice in person perception. Trends in Cognitive Sciences, 11(12), 535-543.
Diamond, E., & Zhang, Y. (2016). Cortical processing of phonetic and emotional information in speech: a cross-modal priming study. Neuropsychologia, 82, 110-122.
Eimer, & Martin. (2000). The face-specific n170 component reflects late stages in the structural encoding of faces. Neuroreport, 11(10), 2319-2324.
Farkas, L. G. (1994). Anthropometry of the head and face. New York: Raven Press.
Kamiyama, K. S., Abla, D., Iwanaga, K., & Okanoya, K. (2013). Interaction between musical emotion and facial expression as measured by event-related potentials. Neuropsychologia, 51(3), 500-505.
K?hler, W. (1947). Gestalt psychology: An introduction to new concepts in modern psychology. New York: Liveright.
Luu, P., Jiang, Z., Poulsen, C., Mattson, C., Smith, A., & Tucker, D. M. (2011). Learning and the development of contexts for action. Frontiers in human neuroscience, 5, 159.
Mileva, M., Tompkinson, J. A., Watt, D., & Burton, A. M. (2018). Audiovisual integration in social evaluation. Journal of Experimental Psychology Human Perception & Performance, 44(1), 128-138.
Ramachandran, V. S., & Hubbard, E. M. (2001). Synaesthesia--a window into perception, thought and language. Journal of consciousness studies, 8(12), 3-34.
Sidhu, D. M., & Pexman, P. M. (2018). Five mechanisms of sound symbolic association. Psychonomic Bulletin & Review, 25(5), 1619-1643.
Taylor, M. J. (2002). Non-spatial attentional effects on p1. Clinical Neurophysiology, 113(12), 1903-1908.
Walker, P. (2016). Cross-sensory correspondences and symbolism in spoken and written language. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(9), 1339-1361.
Young, A. W., Frühholz, S., & Schweinberger, S. R. (2020). Face and voice perception: Understanding commonalities and differences. Trends in Cognitive Sciences, 24(5), 398–410.
Zhou, L. S., Jiang, C. M., Wu, Y. Y., & Yang, Y. F. (2016). Conveying the concept of movement in music: An event-related brain potential study. Neuropsychologia, 77, 128-136.
PDF(825 KB)
