音乐学习对语言韵律加工的影响及其作用机制&#x0002A;

张晶晶; 薛亚楠; 冯银; 高攀科; 陈庆荣

doi:10.16719/j.cnki.1671-6981.20240103

PDF(343 KB)

心理科学 ›› 2024, Vol. 47 ›› Issue (1) : 21-27. DOI: 10.16719/j.cnki.1671-6981.20240103

基础、实验与工效

音乐学习对语言韵律加工的影响及其作用机制^*

张晶晶, 薛亚楠, 冯银, 高攀科, 陈庆荣^**

作者信息 +

The Impact of Music Learning on Language Prosodic Processing and Its Underlying Mechanisms

Zhang Jingjing, Xue Yanan, Feng Yin, Gao Panke, Chen Qingrong

Author information +

文章历史 +

摘要

语言和音乐在结构与功能上均具有密切的联系,语言中的韵律和音乐尤其如此。因此,音乐学习是否以及如何影响语言韵律加工受到了研究者们的广泛关注。本文从言语韵律和情感韵律出发,系统论述了音乐学习对正常人群和语言加工障碍人群韵律感知的影响,探讨了音乐学习影响韵律加工的内在机制。未来研究应在现有研究基础上进一步深入思考,挖掘其中的影响因素,并且区分先天音乐能力和后天音乐学习在促进语言韵律加工中的分别作用。

Abstract

Music and language, as two primary communication systems of humans, share similarities in terms of acoustic elements and structural organization. Empirical research has shown that cognitive and neural mechanisms are shared in the processing of music and language. Among the different components of language, prosody and music are most closely related, both of which can convey meaning and express emotion through acoustic cues such as pitch, duration, and intensity. Therefore, exploring whether and how music learning affects prosodic processing has attracted many researchers. The question is significant because it may offer a unique window to reveal the relationship between music and language.
The current study discusses the effects of music learning on language prosodic processing in different groups from two aspects: speech prosody and emotional prosody. For normal populations, using behavioral and neurophysiological techniques, a considerable number of studies have found that music learning enhances the processing of different aspects of speech prosody, such as intonation, tone, and accent. In addition, these effects are not affected by age or language familiarity. Music learning also facilitates both early and late stages of the processing of emotional prosody, particularly the extraction of sensory information from acoustical cues, and the evaluation of the emotional significance of acoustic signal.
For people with prosodic processing disorders, some longitudinal studies have found that music learning enhances speech prosodic processing (e.g., intonation and tone) in both Cochlear Implantation (CI) and Williams syndrome (WS) groups. However, the results are not consistent across studies, which may be due to the severity of the disorder and differences in the timing and learning style of music learning. In addition, the existing research is mainly limited to the above two special groups, so the research subjects need to be expanded. There is also a lack of research on the cognitive and neural mechanisms of the relationship between musical learning and prosodic processing in these populations. Nonetheless, the discovery of the positive effect of music learning has shed light on people with language disorders, and provided a new way for speech rehabilitation.
Moreover, this paper explores the mechanisms underlying the influence of music learning on language prosodic processing. Researchers have attempted to explain the effect using two possible perspectives. One view suggests that music learning facilitates the processing of language prosody through promoting general auditory processing of acoustic cues, such as pitch and intensity. The other view believes that, apart from the strengthened auditory processing, enhancement in general cognitive abilities is also a possible mechanism. Empirical studies have provided evidence for the first view, showing that musical learning enhances the encoding of prosodic information in brainstem and cortex, but the second view remains to be tested.
Based on previous studies, three questions for future research are proposed. Firstly, the impact of music learning on prosodic processing and its underlying mechanisms needs to be further explored. Specifically, how music learning works when different prosodic features interact or when prosody interacts with other language components such as semantics and syntax remain unknown. The cognitive and neural mechanisms underlying the observed prosody benefits of music learning need further research. Secondly, factors that may influence music learning on prosodic processing should be explored in future research, such as music learning style and learning time. More importantly, whether there is a critical period for the promotion of music learning to language prosodic processing and whether different prosodic features have different critical periods are still unclear. Lastly, the influence of music experience on language prosodic processing really comes from music learning, or the innate musical ability also plays an important part? Studies comparing musicians with non-musician as well as existing longitudinal studies confounded the effects of the two factors, which need to be clarified in future studies.

导出引用

张晶晶, 薛亚楠, 冯银, 高攀科, 陈庆荣. 音乐学习对语言韵律加工的影响及其作用机制^*[J]. 心理科学. 2024, 47(1): 21-27 https://doi.org/10.16719/j.cnki.1671-6981.20240103

Zhang Jingjing, Xue Yanan, Feng Yin, Gao Panke, Chen Qingrong. The Impact of Music Learning on Language Prosodic Processing and Its Underlying Mechanisms[J]. Journal of Psychological Science. 2024, 47(1): 21-27 https://doi.org/10.16719/j.cnki.1671-6981.20240103

参考文献

[1] 蒋存梅. (2016). 音乐心理学. 华东师范大学出版社.
[2] 李杨, 李辉, 温鑫. (2022). 音乐训练对3~6岁人工耳蜗植入儿童听觉能力康复的影响. 中国听力语言康复科学杂志, 20(2), 143-146.
[3] 杨洁, 舒华. (2009). 言语韵律加工的ERP研究. 心理学探新, 29(2), 43-47.
[4] 杨玉芳, 黄贤军, 高路. (2006). 韵律特征研究. 心理科学进展, 14(4), 546-550.
[5] 姚尧, 陈晓湘. (2020). 音乐训练对4~5岁幼儿普通话声调范畴感知能力的影响. 心理学报, 52(4), 456-468.
[6] 张晶晶, 杨玉芳. (2019). 语言和音乐层级结构的加工. 心理科学进展, 27(12), 2043-2051.
[7] 张政华, 韩梅, 张放, 李卫君. (2020). 音乐训练促进诗句韵律整合加工的神经过程. 心理学报, 52(7), 847-860.
[8] 赵信娴, 杨小虎. (2022). 老年人群的韵律感知. 心理科学进展, 30(3), 613-622.
[9] 郑志伟, 黄贤军. (2013). 情绪语音调节面孔表情的识别: ERP证据. 心理科学, 36(1), 33-37.
[10] Bennett, R., & Elfner, E. (2019). The syntax-prosody interface. Annual Review of Linguistics, 5, 151-171.
[11] Besson M., Chobert J., & Marie C. (2011). Transfer of training between music and speech: Common processing, attention, and memory. Frontiers in Psychology, 2, Article 94.
[12] Bestelmeyer P. E. G., Maurage P., Rouger J., Latinus M., & Belin P. (2014). Adaptation to vocal expressions reveals multistep perception of auditory emotion. The Journal of Neuroscience, 34(24), 8098-8105.
[13] Bidelman, G. M., & Alain, C. (2015). Musical training orchestrates coordinated neuroplasticity in auditory brainstem and cortex to counteract age-related declines in categorical vowel perception. The Journal of Neuroscience, 35(3), 1240-1249.
[14] Chari D. A., Barrett K. C., Patel A. D., Colgrove T. R., Jiradejvong P., Jacobs L. Y., & Limb C. J. (2020). Impact of auditory-motor musical training on melodic pattern recognition in cochlear implant users. Otology and Neurotology, 41(4), e422-e431.
[15] Cheng X. T., Liu Y. W. Y., Shu Y. L., Tao D. D., Wang B., Yuan Y. S., & Chen B. (2018). Music training can improve music and speech perception in pediatric Mandarin-speaking cochlear implant users. Trends in Hearing, 22(3), 2331216518759214.
[16] Choi, W. (2021). Towards a native OPERA hypothesis: Musicianship and English stress perception. Language and Speech, 65(3), 697-712.
[17] Choi W., Tong X. L., & Samuel A. G. (2019). Better than native: Tone language experience enhances English lexical stress discrimination in Cantonese-English bilingual listeners. Cognition, 189, 188-192.
[18] Deguchi C., Boureux M., Sarlo M., Besson M., Grassi M., Schön D., & Colombo L. (2012). Sentence pitch change detection in the native and unfamiliar language in musicians and non-musicians: Behavioral, electrophysiological and psychoacoustic study. Brain Research, 1455, 75-89.
[19] Du, Y., & Zatorre, R. J. (2017). Musical training sharpens and bonds ears and tongue to hear speech better. Proceedings of the National Academy of Sciences of the United States of America, 114(51), 13579-13584.
[20] Dupuis, K., & Pichora-Fuller, M. K. (2010). Use of affective prosody by young and older adults. Psychology and Aging, 25(1), 16-29.
[21] Fuller C. D., Galvin III J. J., Maat B., Başkent D., & Free R. H. (2018). Comparison of two music training approaches on music and speech perception in cochlear implant users. Trends in Hearing, 22(4), 233121651876537.
[22] Good A., Gordon K. A., Papsin B. C., Nespoli G., Hopyan T., Peretz I., & Russo F. A. (2017). Benefits of music training for perception of emotional speech prosody in deaf children with cochlear implants. Ear and Hearing, 38(4), 455-464.
[23] Hennessy S., Mack W. J., & Habibi A. (2022). Speech-in-noise perception in musicians and non-musicians: A multi-level meta-analysis. Hearing Research, 416, 108442.
[24] Hwang J., Takahashi C., Baek H., Yeung A. H. L., & Broselow E. (2022). Do L1 tone language speakers enjoy a perceptual advantage in processing English contrastive prosody? Bilingualism: Language and Cognition, 25(5), 816-826.
[25] Kolinsky R., Cuvelier H., Goetry V., Peretz I., & Morais J. (2009). Music training facilitates lexical stress processing. Music Perception, 26(3), 235-246.
[26] Kraus, N., & Chandrasekaran, B. (2010). Music training for the development of auditory skills. Nature Reviews Neuroscience, 11(8), 599-605.
[27] Kraus, N., & White-Schwoch, T. (2017). Neurobiology of everyday communication: What have we learned from music? The Neuroscientist, 23(3), 287-298.
[28] Lima, C. F., & Castro, S. L. (2011). Emotion recognition in music changes across the adult life span. Cognition and Emotion, 25(4), 585-598.
[29] Liu F., Patel A. D., Fourcin A., & Stewart L. (2010). Intonation processing in congenital amusia: Discrimination, identification and imitation. Brain, 133(6), 1682-1693.
[30] Lo C. Y., Looi V., Thompson W. F., & McMahon C. M. (2018). Music and speech perception outcomes after 12 weeks of music training for children with prelingual hearing loss. Journal of Hearing Science, 8(2), 89-90.
[31] Lo C. Y., Looi V., Thompson W. F., & McMahon C. M. (2020). Music training for children with sensorineural hearing loss improves speech-in-noise perception. Journal of Speech, Language, and Hearing Research, 63(6), 1990-2015.
[32] Lo C. Y.,McMahon, C. M., Looi, V., & Thompson, W. F. (2015). Melodic contour training and its effect on speech in noise, consonant discrimination, and prosody perception for cochlear implant recipients. Behavioural Neurology, 2015, 352869.
[33] Ma W. Y., Zhou P., & Thompson W. F. (2022). Children’s decoding of emotional prosody in four languages. Emotion, 22(1), 198-212.
[34] Magne C., Schön D., & Besson M. (2006). Musician children detect pitch violations in both music and language better than nonmusician children: Behavioral and electrophysiological approaches. Journal of Cognitive Neuroscience, 18(2), 199-211.
[35] Mankel, K., & Bidelman, G. M. (2018). Inherent auditory skills rather than formal music training shape the neural encoding of speech. Proceedings of the National Academy of Sciences of the United States of America, 115(51), 13129-13134.
[36] Marie C., Delogu F., Lampis G., Belardinelli M. O., & Besson M. (2011). Influence of musical expertise on segmental and tonal processing in Mandarin Chinese. Journal of Cognitive Neuroscience, 23(10), 2701-2715.
[37] Martínez-Castilla P., Campos R., & Sotillo M. (2019). Enhanced linguistic prosodic skills in musically trained individuals with Williams syndrome. Language and Cognition, 11(3), 455-478.
[38] Martínez-Castilla, P., & Sotillo, M. (2014). Pitch processing in children with Williams syndrome: Relationships between music and prosody skills. Brain Sciences, 4(2), 376-395.
[39] Moreno S., Marques C., Santos A., Santos M., Castro S. L., & Besson M. (2009). Musical training influences linguistic abilities in 8-year-old children: More evidence for brain plasticity. Cerebral Cortex, 19(3), 712-723.
[40] Mualem, O., & Lavidor, M. (2015). Music education intervention improves vocal emotion recognition. International Journal of Music Education, 33(4), 413-425.
[41] Nan Y., Liu L., Geiser E., Shu H., Gong C. C., Dong Q., Gabrieli J. D. E., Desimone R. (2018). Piano training enhances the neural processing of pitch and improves speech perception in Mandarin-speaking children. Proceedings of the National Academy of Sciences of the United States of America, 115(28), E6630-E6639.
[42] Nan Y., Sun Y. N., & Peretz I. (2010). Congenital amusia in speakers of a tone language: Association with lexical tone agnosia. Brain, 133(9), 2635-2642.
[43] Patel, A. D. (2003). Language, music, syntax and the brain. Nature Neuroscience, 6(7), 674-681.
[44] Patel A. D.(2010). Music, language, and the brain. Oxford University Press.
[45] Patel, A. D. (2012). The OPERA hypothesis: Assumptions and clarifications. Annals of the New York Academy of Sciences, 1252(1), 124-128.
[46] Patel, A. D. (2014). Can nonlinguistic musical training change the way the brain processes speech? The expanded OPERA hypothesis. Hearing Research, 308, 98-108.
[47] Paulmann, S., & Uskul, A. K. (2017). Early and late brain signatures of emotional prosody among individuals with high versus low power. Psychophysiology, 54(4), 555-565.
[48] Pinheiro A. P., Rezaii N., Rauber A., Liu T. S., Nestor P. G., McCarley R. W., Goncalves O. F., & Niznikiewicz M. A. (2014). Abnormalities in the processing of emotional prosody from single words in schizophrenia. Schizophrenia Research, 152(1), 235-241.
[49] Pinheiro A. P., Vasconcelos M., Dias M., Arrais N., & Gonçalves Ó. F. (2015). The music of language: An ERP investigation of the effects of musical training on emotional prosody processing. Brain and Language, 140, 24-34.
[50] Politimou N., Dalla Bella S., Farrugia N., & Franco F. (2019). Born to speak and sing: Musical predictors of language development in pre-schoolers. Frontiers in Psychology, 10, 948.
[51] Schellenberg, E. G. (2015). Music training and speech perception: A gene-environment interaction. Annals of the New York Academy of Sciences, 1337(1), 170-177.
[52] Schellenberg, E. G. (2019). Music training, music aptitude, and speech perception. Proceedings of the National Academy of Sciences of the United States of America, 116(8), 2783-2784.
[53] Schirmer, A., & Kotz, S. A. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10(1), 24-30.
[54] Schön D., Magne C., & Besson M. (2004). The music of speech: Music training facilitates pitch processing in both music and language. Psychophysiology, 41(3), 341-349.
[55] Steinbrink C., Knigge J., Mannhaupt G., Sallat S., & Werkle A. (2019). Are temporal and tonal musical skills related to phonological awareness and literacy skills? Evidence from two cross-sectional studies with children from different age groups. Frontiers in Psychology, 10, 805.
[56] Strait, D., & Kraus, N. (2011). Playing music for a smarter ear: Cognitive, perceptual and neurobiological evidence. Music Perception, 29(2), 133-146.
[57] Strait D. L., Kraus N., Parbery-Clark A., & Ashley R. (2010). Musical experience shapes top-down auditory mechanisms: Evidence from masking and auditory attention performance. Hearing Research, 261(1-2), 22-29.
[58] Tang W., Xiong W., Zhang Y. X., Dong Q., & Nan Y. (2016). Musical experience facilitates lexical tone processing among Mandarin speakers: Behavioral and neural evidence. Neuropsychologia, 91, 247-253.
[59] Thompson W. F., Schellenberg E. G., & Husain G. (2004). Decoding speech prosody: Do music lessons help? Emotion, 4(1), 46-64.
[60] van der Burght, C. L., Goucha T., Friederici A. D., Kreitewolf J., & Hartwigsen G. (2019). Intonation guides sentence processing in the left inferior frontal gyrus. Cortex, 117, 122-134.
[61] Vidal M. M., Lousada M., & Vigário M. (2020). Music effects on phonological awareness development in 3-year-old children. Applied Psycholinguistics, 41(2), 299-318.
[62] Wagner, M., & McAuliffe, M. (2019). The effect of focus prominence on phrasing. Journal of Phonetics, 77, 100930.
[63] Wang, Q. (2008). Perception of English stress by mandarin Chinese learners of English: An acoustic study (Unpublished doctorial dissertation). University of Victoria.
[64] Wong P. C. M., Skoe E., Russo N. M., Dees T., & Kraus N. (2007). Musical experience shapes human brainstem encoding of linguistic pitch patterns. Nature Neuroscience, 10(4), 420-422.
[65] Wu H., Ma X. H., Zhang L. J., Liu Y. Y., Zhang Y., & Shu H. (2015). Musical experience modulates categorical perception of lexical tones in native Chinese speakers. Frontiers in Psychology, 6, 436.
[66] Yang X. H., Shen X. R., Zhang Q., Wang C., Zhou L. S., & Chen Y. Y. (2022). Music training is associated with better clause segmentation during spoken language processing. Psychonomic Bulletin and Review, 29(4), 1472-1479.
[67] Zendel, B. R. (2022). The importance of the motor system in the development of music-based forms of auditory rehabilitation. Annals of the New York Academy of Sciences, 1515(1), 10-19.
[68] Zhang L., Fu X. Y., Luo D., Xing L. D. S., & Du Y. (2021). Musical experience offsets age-related decline in understanding speech-in-noise: Type of training does not matter, working memory is the key. Ear and Hearing, 42(2), 258-270.
[69] Zhao, T. C., & Kuhl, P. K. (2015a). Effect of musical experience on learning lexical tone categories. The Journal of the Acoustical Society of America, 137(3), 1452-1463.
[70] Zhao, T. C., & Kuhl, P. K. (2015b). Higher-level linguistic categories dominate lower-level acoustics in lexical tone processing. The Journal of the Acoustical Society of America, 138(2), EL133-EL137.
[71] Zioga I., Di Bernardi Luft C., & Bhattacharya J. (2016). Musical training shapes neural responses to melodic and prosodic expectation. Brain Research, 1650, 267-282.