The Efficient-Coding Constrained Bayesian Inference Model in Visual Perception and Application Perspectives

Sun Qi

Journal of Psychological Science ›› 2026, Vol. 49 ›› Issue (5) : 1268-1279.

PDF(804 KB)
PDF(804 KB)
Journal of Psychological Science ›› 2026, Vol. 49 ›› Issue (5) : 1268-1279. DOI: 10.16719/j.cnki.1671-6981.20260521
Theories & History of Psychology

The Efficient-Coding Constrained Bayesian Inference Model in Visual Perception and Application Perspectives

Author information +
History +

Abstract

The efficient-coding constrained Bayesian inference model, developed by Stocker and colleagues (Wei & Stocker, 2012, 2015, 2017; Sun, Xu & Stocker, 2025), has emerged as a pivotal theoretical framework in visual cognition research. This model delineates a comprehensive perceptual process comprising three key stages: efficient sensory encoding, Bayesian decoding, and perception-action mapping. It formally characterizes the interplay between neural resource allocation (Fisher Information, $ J(\theta)$), prior ($P(\theta)$), width of neural tuning curves/likelihood distribution $\left(\sigma^{2}\right)$, perception biases ($b(\theta)$), as expressed by the following relationships:$ p(\theta) \propto \sqrt{J(\theta)} ; \sigma^{2} \geq 1 / \sqrt{J(\theta)} \propto 1 / p(\theta) ; b(\theta) \propto\left(\frac{1}{p(\theta)^{2}}\right)^{\prime}$

Collectively, these equations unveil the computational principles governing visual perception under environmental constraints.

Existing research has explored the model’s implications from three primary perspectives:

1. Unified Account of Perceptual Biases: The model provides a parsimonious computational framework explaining diverse phenomena, including noise-dependent biases (Wei & Stocker, 2012, 2015), trade-offs between prior efficiency and encoding fidelity (Hahn & Wei, 2024), and response-range effects (Sun et al., 2025). Notably, it maintains predictive consistency across both low-level (e.g., orientation) and high-level (e.g., optic flow) visual features.

2. Multi-Timescale Prior Integration: The framework reveals how long-term priors (reflecting learned statistical regularities) stabilize perception, while short-term priors (driven by recent stimuli) induce serial dependence (Fischer & Whitney, 2014). Dynamic weighting between these mechanisms enables adaptive optimization (Fritsche et al., 2020; Sun et al., 2025).

3. Computational Basis of ASD Perceptual Anomalies: Compared to neurotypical individuals, populations with autism spectrum disorder (ASD) exhibit reduced encoding efficiency and impaired statistical adaptation (Noel et al., 2021; Sapey-Triomphe et al., 2023), offering a novel computational lens for understanding sensory processing differences.

Building on these advances, four critical directions can be considered in future studies:

1. Multisensory and Cross-Modal Applications: Current research indicates that the efficient coding principle is universally observed across unimodal sensory systems, such as vision and audition, while Bayesian decoding mechanisms are also applicable to cross-modal integration (e.g., Ernst & Banks, 2002). However, existing studies integrating these two frameworks remain largely confined to the visual domain. Future work should validate the applicability of the "efficient coding-constrained Bayesian model with perceptual-response mapping modulation" in other sensory modalities and cross-modal contexts, thereby establishing a unified computational framework for perception (Sun et al., 2025).

2. Extensions to Social Cognition: Social cognitive processes are similarly influenced by prior experience and exhibit Bayesian inference properties (e.g., the Prevalence-Induced Concept Change [PICC] phenomenon, Levari et al., 2018). While prior research has confirmed the ubiquity of Bayesian inference in social cognition—including intention understanding, emotion recognition (Baker et al., 2009), and cultural transmission—the role of resource-constrained encoding mechanisms remains unexplored. Future studies should investigate whether social cognitive priors adhere to efficient coding principles, how limited cognitive resources modulate information integration, and how these processes differ from general perceptual mechanisms. Such efforts will advance computational theories of the "social brain."

3. Computational Specificity in Special Populations: Individuals with ADHD, dyslexia, and other neurodevelopmental conditions exhibit atypical perceptual processing, including impaired encoding efficiency or aberrant prior formation (e.g., Nigg & Casey, 2005). Future research should employ psychophysical experiments and computational modeling (e.g., Cramér-Rao lower bound) to quantify these population-specific encoding differences. These findings could inform targeted perceptual training protocols, providing computational biomarkers for clinical diagnosis and theoretical foundations for intervention strategies.

4. Elucidating Neural Mechanisms: Although existing studies demonstrate that neural activity aligns with both efficient coding (Ganguli & Simoncelli, 2014) and Bayesian decoding (Rao, 2004) principles—and fMRI research has preliminarily linked neural activity to behavioral performance (Zhang et al., 2025)—three critical gaps remain: (1) the neural basis of multimodal perception, (2) the synergistic mechanisms between efficient coding and Bayesian inference, and (3) the development of an integrated "behavior-neural-computation" mapping model. Addressing these challenges will provide theoretical foundations for brain-inspired artificial intelligence systems.

Addressing these questions will not only advance theoretical paradigms in perceptual computation but also deepen our understanding of human perception. Moreover, these insights may inspire biologically grounded designs for brain-like artificial intelligence systems, with transformative implications for clinical practice and machine perception.

Key words

efficient encoding / Bayesian decoding / perception-action mapping / sensation and perception

Cite this article

Download Citations
Sun Qi. The Efficient-Coding Constrained Bayesian Inference Model in Visual Perception and Application Perspectives[J]. Journal of Psychological Science. 2026, 49(5): 1268-1279 https://doi.org/10.16719/j.cnki.1671-6981.20260521

References

[1]
孙琪. (2025). 视知觉中的贝叶斯观察者模型及其未来展望. 心理科学, 48(4), 836-846.
[2]
Adams, W. J., Graf, E. W., & Ernst, M. O. (2004). Experience can change the 'light-from-above' prior. Nature Neuroscience, 7(10), 1057-1058.
[3]
Ahissar, M. (2007). Dyslexia and the anchoring-deficit hypothesis. Trends in Cognitive Sciences, 11(11), 458-465.
[4]
Ahissar, M., Lubin, Y., Putter-Katz, H., & Banai, K. (2006). Dyslexia and the failure to form a perceptual anchor. Nature Neuroscience, 9(12), 1558-1564.
[5]
Appelle, S. (1972). Perception and discrimination as a function of stimulus orientation: The “oblique effect” in man and animals. Psychological Bulletin, 78(4), 266-278.
[6]
Attneave, F. (1954). Some informational aspects of visual perception. Psychological Review, 61(3), 183-193.
[7]
Auksztulewicz, R., & Friston, K. (2016). Repetition suppression and its contextual determinants in predictive coding. Cortex, 80, 125-140.
[8]
Baker, C. L., Saxe, R., & Tenenbaum, J. B. (2009). Action understanding as inverse planning. Cognition, 113(3), 329-349.
[9]
Barlow, H., B. (1961). Possible principles underlying the transformations of sensory messages. In M. A. Rosenblith (Ed.), Sensory communication (pp. 216-234). MIT Press.
[10]
Barnes, K. A., Howard, J. H. Jr., Howard, D. V., Kenealy, L., & Vaidya, C. J. (2010). Two forms of implicit learning in childhood ADHD. Developmental Neuropsychology, 35(5), 494-505.
[11]
Barnum, G., & Hong, E. J. (2022). Olfactory coding. Current Biology, 32(23), R1296-R1301.
[12]
Berniker, M., Voss, M., & Kording, K. (2010). Learning priors for Bayesian computations in the nervous system. PLoS ONE, 5(9), Article e12686.
[13]
Bishop, S. J., & Gagne, C. (2018). Anxiety, depression, and decision making: A computational perspective. Annual Review of Neuroscience, 41, 371-388.
[14]
Brunel, N., & Nadal, J. P. (1998). Mutual information, fisher information, and population coding. Neural Computation, 10(7), 1731-1757.
[15]
Burge, J., & Geisler, W. S. (2011). Optimal defocus estimation in individual natural images. Proceedings of the National Academy of Sciences of the United States of America, 108(40), 16849-16854.
[16]
Cavanaugh, J. R., Bair, W., & Movshon, J. A. (2002). Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. Journal of Neurophysiology, 88(5), 2530-2546.
[17]
Ceylan, G., Herzog, M. H., & Pascucci, D. (2021). Serial dependence does not originate from low-level visual processing. Cognition, 212, Article 104709.
[18]
Chalk, M., Seitz, A. R., & Seriès, P. (2010). Rapidly learned stimulus expectations alter perception of motion. Journal of Vision, 10(8), Article 2.
[19]
Chrysaitis, N. A., & Seriès, P. (2023). 10 years of Bayesian theories of autism: A comprehensive review. Neuroscience and Biobehavioral Reviews, 145, Article 105022.
[20]
Cicchini, G. M., Mikellidou, K., & Burr, D. C. (2018). The functional role of serial dependence. Proceedings of the Royal Society B: Biological Sciences, 285(1890), Article 20181722.
[21]
Cicchini, G. M., Mikellidou, K., & Burr, D. C. (2024). Serial dependence in perception. Annual Review of Psychology, 75, 129-154.
[22]
Cover, T. M., & Thomas, J. A. (1991). Entropy, relative entropy, and mutual information. In T. M. Cover, & J. A. Thomas (Eds.), Elements of information theory (pp.13-56). John Wiley & Sons, Inc.
[23]
Crane, B. T. (2012). Direction specific biases in human visual and vestibular heading perception. PLoS ONE, 7(12), Article e51383.
[24]
De Gardelle, V., Kouider, S., & Sackur, J. (2010). An oblique illusion modulated by visibility: Non-monotonic sensory integration in orientation processing. Journal of Vision, 10(10), Article 6.
[25]
Deneve, S. (2004, December 1). Bayesian inference in spiking neurons. Proceedings of the 18th International Conference on Neural Information Processing Systems, British, Canada.
[26]
Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415(6870), 429-433.
[27]
Fischer, J., & Whitney, D. (2014). Serial dependence in visual perception. Nature Neuroscience, 17(5), 738-743.
[28]
Fritsche, M., Spaak, E., & De Lange, F. P. (2020). A Bayesian and efficient observer model explains concurrent attractive and repulsive history biases in visual perception. eLife, 9, Article e55389.
[29]
Ganguli, D., & Simoncelli, E. P. (2014). Efficient sensory encoding and Bayesian inference with heterogeneous neural populations. Neural Computation, 26(10), 2103-2134.
[30]
Geisler, W. S., & Kersten, D. (2002). Illusions, perception and Bayes. Nature Neuroscience, 5(6), 508-510.
[31]
Gekas, N., Chalk, M., Seitz, A. R., & Seriès, P. (2013). Complexity and specificity of experimentally-induced expectations in motion perception. Journal of Vision, 13(4), Article 8.
[32]
Girshick, A. R., Landy, M. S., & Simoncelli, E. P. (2011). Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics. Nature Neuroscience, 14(7), 926-932.
[33]
Gu, Y., Fetsch, C. R., Adeyemo, B., DeAngelis, G. C., & Angelaki, D. E. (2010). Decoding of MSTd population activity accounts for variations in the precision of heading perception. Neuron, 66(4), 596-609.
[34]
Hahn, M., & Wei, X. X. (2024). A unifying theory explains seemingly contradictory biases in perceptual estimation. Nature Neuroscience, 27(4), 793-804.
[35]
Hasson, U., Ghazanfar, A. A., Galantucci, B., Garrod, S., & Keysers, C. (2012). Brain-to-brain coupling: A mechanism for creating and sharing a social world. Trends in Cognitive Sciences, 16(2), 114-121.
[36]
Henrich, J., & Boyd, R. (1998). The evolution of conformist transmission and the emergence of between-group differences. Evolution and Human Behavior, 19(4), 215-241.
[37]
Hiratani, N., & Latham, P. E. (2020). Rapid Bayesian learning in the mammalian olfactory system. Nature Communications, 11(1), Article 3845.
[38]
Jazayeri, M., & Movshon, J. A. (2006). Optimal representation of sensory information by neural populations. Nature Neuroscience, 9(5), 690-696.
[39]
Jazayeri, M., & Shadlen, M. N. (2010). Temporal context calibrates interval timing. Nature Neuroscience, 13(8), 1020-1026.
[40]
Knill, D. C., & Richards, W. (1996). Perception as Bayesian inference. Cambridge University Press.
[41]
Levari, D. E. (2022). Range-frequency effects can explain and eliminate prevalence-induced concept change. Cognition, 226, Article 105196.
[42]
Levari, D. E., Gilbert, D. T., Wilson, T. D., Sievers, B., Amodio, D. M., & Wheatley, T. (2018). Prevalence-induced concept change in human judgment. Science, 360(6396), 1465-1467.
[43]
Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nature Neuroscience, 9(11), 1432-1438.
[44]
Majumdar, G., Yazin, F., Banerjee, A., & Roy, D. (2023). Emotion dynamics as hierarchical Bayesian inference in time. Cerebral Cortex, 33(7), 3750-3772.
[45]
Mamassian, P., Landy, M., & Maloney, L. T. (2002). Bayesian modelling of visual perception. In R. P. N. Rao, B. A. Olshausen, & M. S. Lewicki (Eds.), Probabilistic models of the brain: Perception and neural function (pp. 13-36). MIT Press. MIT Press.
[46]
Mansfield, R. J. W. (1974). Neural basis of orientation perception in primate vision. Science, 186(4169), 1133-1135.
[47]
Nigg, J. T., & Casey, B. J. (2005). An integrative theory of attention-deficit/ hyperactivity disorder based on the cognitive and affective neurosciences. Development and Psychopathology, 17(3), 785-806.
[48]
Noel, J. P., Zhang, L. Q., Stocker, A. A., & Angelaki, D. E. (2021). Individuals with autism spectrum disorder have altered visual encoding capacity. PLoS Biology, 19(5), Article e3001215.
[49]
Olkkonen, M., McCarthy, P. F., & Allred, S. R. (2014). The central tendency bias in color perception: Effects of internal and external noise. Journal of Vision, 14(11), 5-5.
[50]
Pike, A. C., & Robinson, O. J. (2022). Reinforcement learning in patients with mood and anxiety disorders vs control individuals: A systematic review and meta-analysis. JAMA Psychiatry, 79(4), 313-322.
[51]
Rao, R. P. N. (2004). Bayesian computation in recurrent neural circuits. Neural Computation, 16(1), 1-38.
[52]
Sapey-Triomphe, L. A., Sanchez, G., Hénaff, M. A., Sonié S., Schmitz, C., & Mattout, J. (2023). Disentangling sensory precision and prior expectation of change in autism during tactile discrimination. npj Science of Learning, 8(1), Article 54.
[53]
Saxe, R., & Houlihan, S. D. (2017). Formalizing emotion concepts within a Bayesian model of theory of mind. Current Opinion in Psychology, 17, 15-21.
[54]
Shams, L., & Beierholm, U. (2011). Humans' multisensory perception, from integration to segregation, follows Bayesian inference. In J. Trommershäuser, K. Kording, & M. S. Landy (Eds.), Sensory cue integration (pp. 251-262). Oxford University Press.
[55]
Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27(3), 379-423.
[56]
Simoncelli, E. P., & Olshausen, B. A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience, 24, 1193-1216.
[57]
Sims, C. R. (2018). Efficient coding explains the universal law of generalization in human perception. Science, 360(6389), 652-656.
[58]
Siposova, B., & Carpenter, M. (2019). A new look at joint attention and common knowledge. Cognition, 189, 260-274.
[59]
Solanki, P., & Cesario, J. (2025). Stereotypes as Bayesian prediction of social groups. The Journal of Social Psychology, 165(5), 640-662.
[60]
Stocker, A. A., & Simoncelli, E. P. (2006). Noise characteristics and prior expectations in human visual speed perception. Nature Neuroscience, 9(4), 578-585.
[61]
Sun, Q., Gong, X. M., & Sun, Q. (2025). Impact of conflicts between long- and short-term priors on the weighted prior integration in visual perception. Cognition, 254, Article 106006.
[62]
Sun, Q., Xu, L. H., & Stocker, A. A. (2025). A linear perception-action mapping accounts for response range-dependent biases in heading estimation from optic flow. PLoS Computational Biology, 21(6), Article e1013147.
[63]
Sun, Q., Zhan, L. Z., You, F. H., & Dong, X. F. (2024). Attention affects the perception of self-motion direction from optic flow. iScience, 27(4), Article 109373.
[64]
Sun, Q., Zhan, L. Z., Zhang, B. Y., Jia, S. W., & Gong, X. M. (2023). Heading perception from optic flow occurs at both perceptual representation and working memory stages with EEG evidence. Vision Research, 208, Article 108235.
[65]
van Hateren, J. H., & van Der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society of London. Series B: Biological Sciences, 265(1394), 359-366.
[66]
Wang, S. Y., Zhang, X. Y., & Sun, Q. (2024). Estimation bias and serial dependence in speed perception. BMC Psychology, 12(1), Article 598.
[67]
Wei, X. X., & Stocker, A. A. (2012). Efficient coding provides a direct link between prior and likelihood in perceptual Bayesian inference. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe.
[68]
Wei, X. X., & Stocker, A. A. (2015). A Bayesian observer model constrained by efficient coding can explain 'anti-Bayesian' percepts. Nature Neuroscience, 18(10), 1509-1517.
[69]
Wei, X. X., & Stocker, A. A. (2016). Mutual information, fisher information, and efficient coding. Neural Computation, 28(2), 305-326.
[70]
Wei, X. X., & Stocker, A. A. (2017). Lawful relation between perceptual bias and discriminability. Proceedings of the National Academy of Sciences of the United States of America, 114(38), 10244-10249.
[71]
Weiss, Y., Simoncelli, E. P., & Adelson, E. H. (2002). Motion illusions as optimal percepts. Nature Neuroscience, 5(6), 598-604.
[72]
Xu, L. H., Sun, Q., Zhang, B. Y., & Li, X. Y. (2022). Attractive serial dependence in heading perception from optic flow occurs at the perceptual and postperceptual stages. Journal of Vision, 22(12), Article 11.
[73]
Yarrow, S., Challis, E., & Seriès, P. (2012). Fisher and Shannon information in finite neural populations. Neural Computation, 24(7), 1740-1780.
[74]
Yu, J. M., Yang, W. Y., & Ying, H. J. (2023). Modeling facial perception in group context from a serial perception perspective. Journal of Vision, 23(3), Article 4.
[75]
Yu, J. M., & Ying, H. J. (2025). The asymmetry system properties of the visual system: Evidence from serial face processing. Journal of Vision, 25(10), Article 12.
[76]
Zhang, L. Q., Mao, J., Aguirre, G. K., & Stocker, A. A. (2025). The tilt illusion arises from an efficient reallocation of neural coding resources at the contextual boundary. Proceedings of the National Academy of Sciences of the United States of America, 122(17), Article e2421565122.
PDF(804 KB)

Accesses

Citation

Detail

Sections
Recommended

/

〈 〉