Journal of Psychological Science ›› 2025, Vol. 48 ›› Issue (2): 393-405.DOI: 10.16719/j.cnki.1671-6981.20250212
• Developmental & Educational Psychology • Previous Articles Next Articles
Wang Fuxing1,2, Qiao Peihua1,2, Kuang Ziyi3
Online:
2025-03-20
Published:
2025-04-21
王福兴**1,2, 乔沛桦1,2, 匡子翌3
通讯作者:
**王福兴,E-mail: fxwang@ccnu.edu.cn
基金资助:
Wang Fuxing, Qiao Peihua, Kuang Ziyi. The Role of Instructor’s Social Cues in Video Learning[J]. Journal of Psychological Science, 2025, 48(2): 393-405.
王福兴, 乔沛桦, 匡子翌. 教师社会线索对视频学习的影响*[J]. 心理科学, 2025, 48(2): 393-405.
[1] 匡子翌. (2020). 社会线索对视频学习的影响:基于眼神注视、身体方向和手势的作用 (硕士学位论文). 华中师范大学, 武汉. [2] 匡子翌, 张洋, 王福兴, 杨晓梦, 胡祥恩. (2021). 教师的存在能否促进视频学习?心理科学进展, 29(12), 2184-2194. [3] 王福兴, 李文静, 谢和平, 刘华山. (2017). 多媒体学习中教学代理有利于学习吗?——一项元分析研究. 心理科学进展, 25(1), 12-28. [4] 王福兴, 谢和平, 李卉. (2016). 视觉单通道还是视听双通道? ——通道效应的元分析. 心理科学进展, 24(3), 335-350. [5] Antonenko P., Paas F., Grabner R., & van Gog T. (2010). Using electroencephalography to measure cognitive load. Educational Psychology Review, 22, 425-438. [6] Atkinson R. K., Mayer R. E., & Merrill M. M. (2005). Fostering social agency in multimedia learning: Examining the impact of an animated agent's voice. Contemporary Educational Psychology, 30(1), 117-139. [7] Austin, E. E., & Sweller, N. (2014). Presentation and production: The role of gesture in spatial communication. Journal of Experimental Child Psychology, 122, 92-103. [8] Austin, E. E., & Sweller, N. (2017). Getting to the elephants: Gesture and preschoolers'comprehension of route direction information. Journal of Experimental Child Psychology, 163, 1-14. [9] Ba S., Stein D., Liu Q., Long T., Xie K., & Wu L. (2021). Examining the effects of a pedagogical agent with dual-channel emotional cues on learner emotions, cognitive load, and knowledge transfer performance. Journal of Educational Computing Research, 59(6), 1114-1134. [10] Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645. [11] Baylor, A. L., & Kim, S. (2009). Designing nonverbal communication for pedagogical agents: When less is more. Computers in Human Behavior, 25(2), 450-457. [12] Beaudoin-Ryan, L., & Goldin-Meadow, S. (2014). Teaching moral reasoning through gesture. Developmental Science, 17(6), 984-990. [13] Beege M., Nebel S., Schneider S., & Rey G. D. (2019). Social entities in educational videos: Combining the effects of addressing and professionalism. Computers in Human Behavior, 93, 40-52. [14] Beege M., Ninaus M., Schneider S., Nebel S., Schlemmel J., Weidenmüller J., & Rey G. D. (2020a). Investigating the effects of beat and deictic gestures of a lecturer in educational videos. Computers and Education, 156, 10395. [15] Beege M., Schroeder N. L., Heidig S., Rey G. D., & Schneider S. (2023). The instructor presence effect and its moderators in instructional video: A series of meta-analyses. Educational Research Review, 41, 100564. [16] Beege M., Schneider S., Nebel S., & Rey G. D. (2020b). Does the effect of enthusiasm in a pedagogical agent's voice depend on mental load in the Learner's working memory? Computers in Human Behavior, 112, 1-11. [17] Beege M., Schneider S., Nebel S., & Rey G. D. (2017). Look into my eyes! Exploring the effect of addressing in educational videos. Learning and Instruction, 49, 113-120. [18] Castro-Alonso J. C., Wong R. M., Adesope O. O., & Paas F. (2021). Effectiveness of multimedia pedagogical agents predicted by diverse theories: A meta-analysis. Educational Psychology Review, 33, 989-1015. [19] Chan K. Y., Lyons C., Kon L. L., Stine K., Manley M., & Crossley A. (2020). Effect of on-screen text on multimedia learning with native and foreign-accented narration. Learning and Instruction, 67, 101305. [20] Chiou E. K., Schroeder N. L., & Craig S. D. (2020). How we trust, perceive, and learn from virtual humans: The influence of voice quality. Computers and Education, 146, 103756. [21] Craig, S. D., & Schroeder, N. L. (2017). Reconsidering the voice effect when learning from a virtual human. Computers and Education, 114, 193-205. [22] Dal Monte O., Schintu S., Pardini M., Berti A., Wassermann E. M., Grafman J., & Krueger F. (2014). The left inferior frontal gyrus is crucial for reading the mind in the eyes: Brain lesion evidence. Cortex, 58, 9-17. [23] Dargue, N., & Sweller, N. (2018a). Donald duck's garden: The effects of observing iconic reinforcing and contradictory gestures on narrative comprehension. Journal of Experiment Child Psychology, 175, 96-107. [24] Dargue, N., & Sweller, N. (2018b). Not all gestures are created equal: The effects of typical and atypical iconic gestures on narrative comprehension. Journal of Nonverbal Behavior, 42(3), 327-345. [25] Dargue, N., & Sweller, N. (2020). Learning stories through gesture: Gesture's effects on child and adult narrative comprehension. Educational Psychology Review, 32(1), 249-276. [26] Dargue, N., & Sweller, N. (2020). Two hands and a tale: When gestures benefit adult narrative comprehension. Learning and Instruction, 68, 101331. [27] Dargue N., Sweller N., & Jones M. P. (2019). When our hands help us understand: A meta-analysis into the effects of gesture on comprehension. Psychological Bulletin, 145(8), 765-784. [28] Davis, R. O. (2018). The impact of pedagogical agent gesturing in multimedia learning environments: A meta-analysis. Educational Research Review, 24, 193-209. [29] Davis R. O., Vincent J., & Park T. (2019). Reconsidering the voice principle with non-native language speakers. Computers and Education, 140, 103605. [30] Fiorella, L. (2021). The embodiment principle in multimedia learning. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge handbook of multimedia learning (pp. 286-295). Cambridge University Press. [31] Fiorella L.,& Mayer, R. E. (2022). Principles based on social cues in multimedia learning: Personalization, voice, image, and embodiment principles. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge handbook of multimedia learning ( pp. 277-285). Cambridge University Press. [32] Frechette, C., & Moreno, R. (2010). The roles of animated pedagogical agents'presence and nonverbal communication in multimedia learning environments. Journal of Media Psychology, 22(2), 61-72. [33] Ginns P., Martin A. J., & Marsh H. W. (2013). Designing instructional text in a conversational style: A meta-analysis. Educational Psychology Review, 25(4), 445-472. [34] Goldin-Meadow S., Nusbaum H., Kelly S. D., & Wagner S. (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12(6), 516-522. [35] Hasegawa D., Shirakawa S., Shioiri N., Hanawa T., Sakuta H., & Ohara K. (2015). The effect of metaphoric gestures on schematic understanding of instruction performed by a pedagogical conversational agent. In Learning and collaboration technologies: Second international conference. [36] Horovitz, T., & Mayer, R. E. (2021). Learning with human and virtual instructors who display happy or bored emotions in video lectures. Computers in Human Behavior, 119, 106724. [37] Horton, D., & Wohl, R. R. (1956). Mass communication and para-social interaction: Observations on intimacy at a distance. Psychiatry, 19, 185-206. [38] Kelly, S. D., & Goldsmith, L. H. (2004). Gesture and right hemisphere involvement in evaluating lecture material. Gesture, 4(1), 25-42. [39] Kelly S. D.,& Ngo Tran, Q. A.(in press). Exploring the emotional functions of co-speech hand gesture in language and communication. Topics in Cognitive Science. [40] Krämer, N. C., & Bente, G. (2010). Personalizing e-learning. The social effects of pedagogical agents. Educational Psychology Review, 22, 71-87. [41] Kuang Z., Wang F., Andrasik F., & Hu X. (2024). Instructor's direct gaze not body orientation affects learning. Journal of Computers Assisted Learning, 40(2), 731-741. [42] Kuang Z., Wang F., Xie H., Mayer R. E., & Hu X. (2023). Effect of the instructor's eye gaze on student learning from video lectures: Evidence from two three-level meta-analyses. Educational Psychology Review, 35, 109. [43] Lang, P., & Bradley, M. M. (2007). The International Affective Picture System (IAPS) in the study of emotion and attention. Handbook of Emotion Elicitation and Assessment, 29, 70-73. [44] Lawson, A. P., & Mayer, R. E. (2022). The power of voice to convey emotion in multimedia instructional messages. International Journal of Artificial Intelligence in Education. 32, 971-900. [45] Lawson A. P., Mayer R. E., Adamo-Villani N., Benes B., Lei X., & Cheng J. (2021). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114, 106554. [46] Li W., Wang F., Mayer R. E., & Liu H. (2019). Getting the point: Which kinds of gestures by pedagogical agents improve multimedia learning? Journal of Educational Psychology, 111(8), 1382-1395. [47] Li W., Wang F., Mayer R. E., & Liu T. (2022). Animated pedagogical agents enhance learning outcomes and brain activity during learning. Journal of Computer Assisted Learning, 38(3), 621-637. [48] Li W., Wang F., & Mayer R. E. (2023). How to guide learners'processing of multimedia lessons with pedagogical agents. Learning and Instruction, 84, 101729. [49] Li W., Kuang Z., Leng X., Mayer R. E., Wang F (2024). Role of gesturing onscreen instructors in video lectures: A set of three-level meta-analyses on the embodiment effect. Educational Psychology Review, 36, 67. [50] Li W., Wang F., & Mayer R. E. (2024). Increasing the realism of on-screen instructors creates more looking but less learning. British Journal of Educational Psychology, 94(3), 759-776. [51] Liew T. W., Tan S. M., Tan T. M., & Kew S. N. (2020). Does speaker's voice enthusiasm affect social cue, cognitive load and transfer in multimedia learning. Information and Learning Sciences, 121(3/4), 117-135. [52] Liew T. W., Zin N. A. M., Sahari N., & Tan S. M. (2016). The effects of a pedagogical agent's smiling expression on the learner's emotions and motivation in a virtual learning environment. The International Review of Research in Open and Distributed Learning, 17(5), 248-266. [53] Mayer R. E.(2014). Principles based on social cues in multimedia learning: Personalization, voice, image, and embodiment principles. In. R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 345-370). Cambridge University Press. [54] Mayer, R. E. (2017). How can brain research inform academic learning and instruction? Educational Psychology Review, 29(7), 835-846. [55] Mayer, R. E. (2019). Searching for the role of emotions in e-learning. Learning and Instruction, 101213. [56] Mayer R. E.(2021). Multimedia learning. Cambridge University Press.. [57] Mayer, R. E., & DaPra, C. S. (2012). An embodiment effect in computer-based learning with animated pedagogical agents. Journal of Experimental Psychology, 18(3), 239-252. [58] Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43-52. [59] McNeill, D. (1992). Hand and mind: What gestures reveal about thought. The University of Chicago Press. [60] Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309-326. [61] Niedenthal P. M., Barsalou L. W., Winkielman P., Krauth-Gruber S., & Ric F. (2005). Embodiment in attitudes, social perception, and emotion. Personality and Social Psychology Review, 9, 184-211. [62] Norris, C. J. (2021). The negativity bias, revisited: Evidence from neuroscience measures and an individual differences approach. Social Neuroscience, 16(1), 68-82. [63] Oh Kruzic C., Kruzic D., Herrera F., & Bailenson J. (2020). Facial expressions contribute more than body movements to conversational outcomes in avatar-mediated virtual environments. Scientific Reports, 10(1), 20626. [64] Ouwehand K., Van Gog T., & Paas F. (2015). Designing effective video-based modeling examples using gaze and gesture cues. Educational Technology and Society, 18, 78-88. [65] Özder L.,E. Özer,D. & Göksun,T. (2023). Gesture use in L1-Turkish and L2-English: Evidence from emotional narrative retellings. Quarterly Journal of Experimental Psychology, 76(8), 1797-1816. [66] Pi Z., Chen M., Zhu F., Yang J., & Hu W. (2020b). Modulation of instructor's eye gaze by facial expression in video lectures. Innovations in Education and Teaching International, 59(1), 15-23. [67] Pi Z., Hong J., & Yang J. (2017). Effects of the instructor's pointing gestures on learning performance in video lectures. British Journal of Educational Technology, 48(4), 1020-1029. [68] Pi Z., Ling H., Li X., & Wang, Q.(in press). Instructors'pointing gestures and positive facial expressions hinder learning in video lectures: Insights from teachers and students in China. Education and Information Technologies. [69] Pi Z., Liu W., Ling H., Zhang X., & Li X. (2023). Does an instructor's facial expressions override their body gestures in video lectures? Computers and Education, 193, 104679. [70] Pi Z., Liu R., Ling H., Zhang X., Wang S., & Li X. (2022b). The emotional design of an instructor: Body gestures do not boost the effects of facial expressions in video lectures. Interactive Learning Environments. 32(3), 952-971. [71] Pi Z., Xu K., Liu C., & Yang J. (2020a). Instructor presence in video lectures: Eye gaze matters, but not body orientation. Computers and Education, 144, 103713. [72] Pi Z., Zhang Y., Zhu F., Chen L., Guo X., & Yang J. (2021). The mutual influence of an instructor's eye gaze and facial expression in video lectures. Interactive Learning Environments, 31(6), 3664-3681. [73] Pi Z., Zhu F., Zhang Y., Chen L., & Yang J. (2022a). Complexity of visual learning material moderates the effects of instructor's beat gestures and head nods in video lectures. Learning and Instruction, 77, 101520. [74] Ping, R., & Goldin-Meadow, S. (2010). Gesturing saves cognitive resources when talking about non-present objects. Cognitive Science, 34, 602-619. [75] Pursel B. K., Zhang L., Jablokow K. W., Choi G. W., & Velegol D. (2016). Understanding MOOC students: Motivations and behaviours indicative of MOOC completion. Journal of Computer Assisted Learning, 32(3), 202-217. [76] Redcay E., Dodell-Feder D., Pearrow M. J., Mavros P. L., Kleiner M., Gabrieli J. D. E., & Saxe R. (2010). Live face-to-face interaction during fMRI: A new tool for social cognitive neuroscience. NeuroImage, 50(4), 1639-1647. [77] Ritzhaupt A. D., Gomes N. D., & Barron A. E. (2008). The effects of time-compressed audio and verbal redundancy on learner performance and satisfaction. Computers in Human Behavior, 24(5), 2434-2445. [78] Ritzhaupt A. D., Pastore R., & Davis R. (2015). Effects of captions and time-compressed video on learner performance and satisfaction. Computers in Human Behavior, 45, 222-227. [79] Schneider S., Beege M., Nebel S., & Rey G. D. (2018). A meta-analysis of how signaling affects learning with media. Educational Research Review, 23, 1-24. [80] Schneider S., Beege M., Nebel S., Schnaubert L., & Rey G. D. (2022b). The cognitive-affective-social theory of learning in digital environments (CASTLE). Educational Psychology Review, 34, 1-38. [81] Schneider S., Krieglstein F., Beege M., & Rey G. D. (2022a). The impact of video lecturers'nonverbal communication on learning-An experiment on gestures and facial expressions of pedagogical agents. Computers and Education, 176, 104350. [82] Schroeder, N. L., & Adesope, O. O. (2014). A systematic review of pedagogical agents'persona, motivation, and cognitive load implications for learners. Journal of Research on Technology in Education, 46(3), 229-251. [83] Stull A. T., Fiorella L., & Mayer R. E. (2021). The case for embodied instruction: The instructor as a source of attentional and social cues in video lectures. Journal of Educational Psychology, 113(7), 1441-1453. [84] Traulsen, S. J., & Zander, L. (2024). Straighten your back, open your arms! Effects of instructor's body postures in educational videos on students'interest and motivation. Learning and Instruction, 93, 101959. [85] Twyford, J., & Craig, S. (2013). Virtual humans and gesturing during multimedia learning: An investigation of predictions from the temporal contiguity effect. In T. Bastiaens, & G. Marks (Eds.), Proceedings of E-learn 2013-world conference on E-learning in corporate, government, healthcare, and higher education (pp. 2145-2149). Association for the Advancement of Computing in Education (AACE). [86] van Gog, T., & Scheiter, K. (2010). Eye tracking as a tool to study and enhance multimedia learning. Learning and Instruction, 20(2), 95-99. [87] van Gog T., Verveer I., & Verveer L. (2014). Learning from video modeling examples: Effects of seeing the human model's face. Computers and Education, 72, 323-327. [88] van Gog, T. (2022). The signaling (or cueing) principle in multimedia learning. In R. E. Mayer & L. Fiorella (Eds.), The Cambridge handbook of multimedia learning (pp. 221-230). Cambridge University Press. [89] van Wermeskerken, M., & van Gog, T. (2017). Seeing the instructor's face and gaze in demonstration video examples affects attention allocation but not learning. Computers and Education, 113, 98-107. [90] van Wermeskerken M., Grimmius B., & van Gog T. (2018). Attention to the model's face when learning from video modeling examples in adolescents with and without autism spectrum disorder. Journal of Computer Assisted Learning, 34(1), 32-41. [91] Wang F., Li W., Mayer R. E., & Liu H. (2018). Animated pedagogical agents as aids in multimedia learning: Effects on eye-fixations during learning and learning outcomes. Journal of Educational Psychology, 110(2), 250-268. [92] Wang F., Li W., & Zhao, T. (2022). Multimedia learning with animated pedagogical agents. In R. E. Mayer & L. Fiorella, (Ed.), The Cambridge handbook of multimedia learning (pp. 450-460). Cambridge University Press. [93] Wang H., Pi Z., & Hu W. (2019). The instructor's gaze guidance in video lectures improves learning. Journal of Computer Assisted Learning, 35(1), 42-50. [94] Wang J., Antonenko P., & Dawson K. (2020). Does visual attention to the instructor in online video affect learning and learner perceptions? An eye-tracking analysis. Computers and Education, 146, 103779. [95] Wang, Y. (2022). To be expressive or not: The role of teachers'emotions in students'learning. Frontiers in Psychology, 12, 737310. [96] Wang Y., Feng X., Guo J., Gong S., Wu Y., & Wang J. (2022). Benefits of affective pedagogical agents in multimedia instruction. Frontiers in Psychology, 12, 797236. [97] Xing, W., & Du, D. (2019). Dropout prediction in MOOCs: Using deep learning for personalized intervention. Journal of Educational Computing Research, 57(3), 547-570. [98] Zahra, S. A. (2021). Learning through screens: How gestures, facial expressions, and motivational statements influence foreign language learning experience online. University of Twente. [99] Zhang, R., Cheng, G. & Wu, L. (2023). Influence of instructor's facial expressions in video lectures on motor learning in children with autism spectrum disorder. Education and Information Technologies, 28, 11867-11880. [100] Zhang C., Wang Z., Fang Z., & Xia X. (2024). Guiding student learning in video lectures: Effects of instructors'emotional expressions and visual cues. Computers and Education, 218, 105062. [101] Zhu F., Yang J., & Pi Z. (2022). The interaction effects of an instructor's emotions in instructional videos and students'emotional intelligence on L2 vocabulary learning. Educational Technology Research and Development, 70, 1695-1718. |
[1] | Wang Lu, Luo Shucheng, Liu Xinyan, Mao Songping. Overcoming the Negative Effects of Perceived Bad Luck on the Preference of Uncertain Products [J]. Journal of Psychological Science, 2025, 48(1): 164-176. |
[2] | . Eliciting Effects on Shy Individuals’ Inclination of Withdrawal Behaviors by Social Cues [J]. Psychological Science, 2012, 35(5): 1164-1168. |
Viewed | ||||||||||||||||||||||||||||||||||||||||||||||||||
Full text 200
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||
Abstract 183
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||