Bayesian inference explains perception of unity and ventriloquism aftereffect: Identification of common sources of audiovisual stimuli

Yoshiyuki Sato, Taro Toyoizumi, Kazuyuki Aihara

Research output: Contribution to journalArticlepeer-review

110 Citations (Scopus)

Abstract

We study a computational model of audiovisual integration by setting a Bayesian observer that localizes visual and auditory stimuli without presuming the binding of audiovisual information. The observer adopts the maximum a posteriori approach to estimate the physically delivered position or timing of presented stimuli, simultaneously judging whether they are from the same source or not. Several experimental results on the perception of spatial unity and the ventriloquism effect can be explained comprehensively if the subjects in the experiments are regarded as Bayesian observers who try to accurately locate the stimulus. Moreover, by adaptively changing the inner representation of the Bayesian observer in terms of experience, we show that our model reproduces perceived spatial frame shifts due to the audiovisual adaptation known as the ventriloquism aftereffect.

Original languageEnglish
Pages (from-to)3335-3355
Number of pages21
JournalNeural Computation
Volume19
Issue number12
DOIs
Publication statusPublished - 2007 Dec
Externally publishedYes

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Cognitive Neuroscience

Fingerprint Dive into the research topics of 'Bayesian inference explains perception of unity and ventriloquism aftereffect: Identification of common sources of audiovisual stimuli'. Together they form a unique fingerprint.

Cite this