Psychological Science ›› 2017, Vol. 40 ›› Issue (4): 850-855.

Previous Articles     Next Articles

Advances of Co-Registration of Eye Movement and EEG in Psycholinguistic Studies

Zhu-Yang LI1,   

  • Received:2016-10-10 Revised:2017-04-18 Online:2017-07-20 Published:2017-09-21

眼动与脑电同步记录技术在心理语言学研究中的新进展

李诸洋1,刘璐2   

  1. 1. 天津师范大学心理与行为研究院
    2. 天津师范大学
  • 通讯作者: 刘璐

Abstract: Brain-electric correlates of reading have traditionally been studied with word-by-word presentation, called serial visual presentation (SVP), a condition that eliminates important aspects of the normal reading process and precludes direct comparisons between neural activity and oculomotor behavior, so that the results obtained by this method had lower ecological validity, which was difficult to be popularized. And EM only describes a summation of all cognitive processing occurring during reading, which can not show the sequence of the cognitive processes. This paper presents a new methodology for studying psycholinguistic, which combines eye movements (EM) and electroencephalogram (EEG) to track the time course of cognitive processes. This technique has the advantage of coupling accurate time measures from Event-related potentials (ERPs) and the location of the eye on the stimulus, which can compensate for the lack of EM and ERPs, so it can be used to explore the time course of cognitive processes and its neural mechanism in the process of reading under the natural reading condition. The realization of this technique needed two computers, which were connected through parallel ports. The computer A was used for stimulus presentation and the eye-movement acquisition. And the computer B was used to collect the EEG signals by means of EEG amplifier. It should be noted that eye tracker and EEG amplifier must have the same sampling rate. The computer A would send a synchronization signal (TTL Pulse) to computer B as soon as the stimulus was presented on the screen. The synchronization signal could allow the EM and EEG signals to be recorded simultaneously, which could provide an accurate mark for the off-line analysis of EEG data. It should be pointed that saccde offset or the onset of the first fixation were treated as the reference mark of EEG segment obtained by co-registration of eye movement and EEG record, which was different from traditional ERP off-line analysis. Some studies have begun to make use of this technique to explore fundamental phenomena of psycholinguistic and the mechanism of prafoveal processing during reading, and made some valuable outcomes through this technique. For example, Dimigen, Kliegl & Sommer(2012)utilized co-registration of EM and EEG and combined the boundary paradigm to investigate the neural mechanism of parafoveal preview effect. The results demonstrated that a correct parafoveal preview during the previous fixation could lead to a modulation of fixation-related potentials (FRP) amplitude over occipitotemporal areas. This component could be located to extrastriate occipital or occipitotemporal cortex. At last, based on the problems existing in this technique and its application prospect, some advises have been put forward for the future: (1) A standardized procedure should be developed for the processing of data obtained by co-registration of EM and EEG. (2) More indexes should be selected in using the approach of co-registration of EM and EEG recording. This can achieve more valuable results. (3) Because of the uniqueness of Chinese characters, some studies have found that some effects are different from the alphabetic characters. Therefore, co-registration of EM and EEG recording should be widely used in Chinese reading.

Key words: Co-registration of EM and EEG, Natural reading, Psycholinguistic

摘要: 传统的心理语言学研究手段存在一定的弊端,眼动和脑电同步记录技术具有高时间和高空间分辨率的特性,能够在自然阅读情境下探讨人在阅读过程中认知加工的时间进程及其相应的神经机制。本文在阐述眼动与脑电同步记录的必要性和方法的基础上,较为全面地介绍了近10年来同步记录技术在心理语言学研究中的新进展,并对该技术的应用前景进行了展望,以期对国内从事心理语言学领域的研究者有一定的启示。

关键词: 眼动与脑电同步技术, 自然阅读, 心理语言学