Information Distribution Modulates Integration Strategies: Evidence from Eye Movements

REN Yan-Ju; XUAN Yu-Meng; FU Xiao-Lan

PDF(413 KB)

Journal of Psychological Science ›› 2013, Vol. 36 ›› Issue (1) : 2-6.

Information Distribution Modulates Integration Strategies: Evidence from Eye Movements

Yanju Ren¹, ²,Xiao-Lan FU

Author information +

History +

Abstract

In the present study, empty cell localization task was used to explore how information is integrated between visual short-term memory (VSTM) and visual perception. To explain the participants performances of the task, two hypotheses were proposed: image-percept hypothesis and convert-and-compare hypothesis. Image-percept hypothesis suggested that participants firstly encoded the locations of dots in array 1 and its mental image was formed to integrate with array 2. On the contrary, convert-and-compare hypothesis asserted that participants firstly encoded the location of empty cells in array 1 and its negative image was formed to compare with array 2. Analyzing the existing evidence for or against the two hypotheses, we found that the difference in dot distribution might contribute to different integrating strategies. To test this hypothesis, two experiments were conducted. In experiment 1, the dot distribution of sequential arrays (4–11, 5–10, 6–9, 7–8 and 8–7) and interstimulus interval (ISI, 500 ms, 1500 ms and 2500 ms) were manipulated. The results showed that the accuracy was a U-shaped function of array 1 dot number and at the condition of 6–9 distribution the accuracy reached a lowest value. We argued the findings suggested that integration strategies might change from “memorizing dots” to “memorizing empty cells” of array 1. In experiment 2, participants’ eye movements were monitored when performing empty cell localization task. Dot distribution varied in 3 levels (5–10, 6–9, 7–8) and ISI varied in 2 levels (500ms and 1500ms). The accuracy again showed a U-shaped function of array 1 dot number. In 1500ms ISI condition, there were significant different eye movement patterns between the 3 levels of dot distribution. Specifically, in 5–10 condition, participants showed a bias to look at dot locations during ISI period; in 6–9 condition, participants looked at locations of dots or empty cells on a chance level; while in 7–8 condition, a bias to looking at empty cell location was showed. Thus we found clear eye-movement evidence indicating a change of integration strategy from “memorizing dots” to “memorizing empty cells” in experiment 2. In sum, the present study suggested that human participants are flexible in integrating sequentially presented information because a change of integration strategy was revealed by our data. We argued that the limit of VSTM capacity played an important role in this adaptive characteristic. It seemed that “memorizing dots” strategy was adopted when dot numbers were within the capacity of VSTM while “memorizing empty cells” strategy was adopted when dot numbers were out of VSTM capacity.

Key words

sequential arrays / empty cell localization / image-percept integration hypothesis / convert-and-compare hypothesis / eye movements

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

Yanju Ren Xiao-Lan FU. Information Distribution Modulates Integration Strategies: Evidence from Eye Movements[J]. Journal of Psychological Science. 2013, 36(1): 2-6

References

张霞, 刘鸣. (2009). 视觉表象操作加工的眼动实验研究. 心理学报, 41(4), 305–315
Al-Aidroos, N., Emirich, S. M., Ferber, S., & Pratt, J. (in press). Visual working memory supports the inhibition of previously processed information: evidence from preview search. Journal of Experimental Psychology: Human Perception and Performance.
Alvarez, G. A., & Cavanagh, P. (2004). The capacity of visual short-term memory is set both by visual information load and by number of objects. Psychological Science, 15, 106–111.
Anaki, D., Boyd, J., & Moscovitch, M. (2007). Temporal Integration in Face Perception：Evidence of Configural Processing of Temporally Separated Face Parts. Journal of Experimental Psychology: Human Perception and Performance, 33, 1–19．
Brockmole, J. R., & Irwin, D. E. (2005). Eye movements and the integration of visual memory and visual perception. Perception & Psychophysics, 67, 495–512.
Brockmole, J. R., & Wang, R. F. (2003). Integrating visual images and visual percepts across time and space. Visual Cognition, 10, 853–873.
Brockmole, J. R., Irwin, D. E., & Wang, R. F. (2003). The locus of spatial attention during the temporal integration of visual memories and visual percepts. Psychonomic Bulletin & Review, 10, 510–515.
Brockmole, J. R., Wang, R. F., & Irwin, D. E. (2002). Temporal integration of visual images and visual percepts. Journal of Experimental Psychology: Human Perception and Performance, 28, 315–334.
Castelhano, M.S., Pollatsek, A., & Rayner, K. (2009). Integration of multiple views of scenes. Attention, Perception & Psychophysics, 71, 490-502.
Duchowski, A. T., Jr. (2007). Eye Tracking Methodology: Theory and Practice (2nd ed.). London: Springer-Verlag.
Gao, T., Gao, Z., Li, J., Sun, Z., & Shen, M. (in press). The perceptual root of object-based storage: an interactive model of perception and viusal working memory. Journal of Experimental Psychology: Human Perception and Performance.
Goldberg, J. H., & Kotval, X. P. (1998). Eye movement-based evaluation of the computer interface. In: S. K. Kumar (ed.), Advances in Occupational Ergonomics and Safety (pp. 529–532). Amsterdam: ISO Press.
Hollingworth, A., & Franconeri, S. L. (2009). Object correspondence across brief occlusion is established on the basis of both spatiotemporal and surface feature cues. Cognition, 113, 150-166.
Hollingworth, A., Hyun, J., & Zhang, W. (2005). The role of visual short-term memory in empty cell localization. Perception & Psychophysics, 67, 1332–1344.
Hollingworth, A., Richard, A. M., & Luck, S. J. (2008). Understanding the function of visual short-term memory: Transsaccadic memory, object correspondence, and gaze correction. Journal of Experimental Psychology: General, 137, 163–181.
Hyun, J. -S., Woodman, G. F., Vogel, E. K., Hollingworth, A., & Luck, S. J. (2009). The comparison of visual working memory representations with perceptual inputs. Journal of Experimental Psychology: Human Perception and Performance, 35, 1140–1160.
Jiang, Y. (2004). Time window from visual images to visual short-term memory: consolidation or integration? Experimental Psychology, 51, 45–51.
Jiang, Y., & Kumar, A. (2004). Visual short-term memory for two sequential arrays: One integrated representation or two separate representations? Psychonomic Bulletin & Review, 11, 495–500.
Jiang, Y., Kumar, A., & Vickery, T. J. (2005). Integrating visual arrays in visual-short term memory. Experimental Psychology, 52, 39–46.
Kumar, A., & Jiang, Y. (2005). Visual short-term memory for sequential arrays. Memory & Cognition, 33, 488–498.
Kotval, X. P., & Goldberg, J. H. (1998). Eye movements and interface components grouping: An evaluation method. In: Proceedings of the 42nd Annual Meeting of the Human Factors and Ergonomics Society (pp. 486–490). Santa Monica: Human Factors and Ergonomics Society.
Laeng, B., & Teodorescu, D. (2002). Eye scanpathes during visual imagery reenact those of perception of the same visual scene. Cognitive Science, 26, 207–231.
Luck, S. J., & Vogel, E. (1997). The capacity of visual working memory for features and conjunctions. Nature, 390, 279–281.
Matsukura, M., & Hollingworth, A. (in press). Does visual short-term memory have a high-capacity stage? Psychonomic Bulletin & Review.
Melcher, D. (2007). Predictive remapping of visual features precedes saccadic eye movements. Nature Neuroscience, 10, 903–907.
Melcher, D., & Morrone, M. C. (2003). Spatiotopic temporal integration of visual motion across saccadic eye movements. Nature Neuroscience, 6, 877–881.
Ren, Y., Xuan, Y., & Fu, X. (2007). Effects of pattern complexity on information integration: evidence from eye movements. In: D. Harris (Ed.), Lecture notes in artificial intelligence: Vol. 4562: Engineering Psychology and Cognitive Ergonomics (pp. 582–590). Berlin, Germany: Springer-Verlag.
Ren, Y., Xuan, Y., & Fu, X. (2009). Information Representation and Mechanism in the Integration of Sequential Arrays: Evidences from eye movements. Paper presented at the 17th Congress of the International Ergonomics Association, Beijing, China, August, 9-14.
Richard, A. M., Luck, S. J., & Hollingworth, A. (2008). Establishing object correspondence across eye movements: Flexible use of spatiotemporal and surface feature information. Cognition, 109, 66–88.
Sanocki, T., Sellers, E., Mittelstadt, J., & Sulman, N. (2010). How high is visual short-term memory capacity for object layout? Attention, Perception, & Psychophysics, 72(4), 1097–1109.
Shulman, G. L., & Wilson, J. (1987). Spatial frequency and selective attention to spatial location. Perception & Psychophysics, 16, 103–111.
Song, J. H., & Jiang, Y. V. (2006). Motion tracking mediates capacity allocation in visual working memory. Psychonomic Bulletin & Review, 13, 1011–1015.
Watson, D. G., & Humphreys, G. W. (1997). Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. Psychological Review, 104, 90–122.