Changing pitch of sounds alters perceived visual motion trajectory

Yasuhiro Takeshima, Jiro Gyoba

    Research output: Contribution to journalArticlepeer-review

    6 Citations (Scopus)

    Abstract

    Several studies have examined the effects of auditory stimuli on visual perception. In studies of cross-modal correspondences, auditory pitch has been shown to modulate visual motion perception. In particular, low-reliability visual motion stimuli tend to be affected by metaphorically or physically congruent or incongruent sounds. In the present study, we examined the modulatory effects of auditory pitch on visual perception of motion trajectory for visual inputs of varying reliability. Our results indicated that an auditory pitch implying the illusory motion toward the outside of the visual field-modulated perceived motion trajectory. In contrast, auditory pitch implying the illusory motion toward the central visual field did not affect the perception of motion trajectory. This asymmetrical effect of auditory stimuli occurred depending on the reliability of the visual input. Moreover, sounds that corresponded in terms of their pitch-elevation mapping altered the perception of the trajectory of visual motion when apparent motion could be perceived smoothly. Therefore, the present results demonstrate that auditory stimuli modulate visual motion perception especially when smooth motion is perceived in the peripheral visual field.

    Original languageEnglish
    Pages (from-to)317-332
    Number of pages16
    JournalMultisensory Research
    Volume26
    Issue number4
    DOIs
    Publication statusPublished - 2013

    Keywords

    • Apparent motion
    • Audio-visual interaction
    • Cross-modal correspondences
    • Multisensory perception

    ASJC Scopus subject areas

    • Experimental and Cognitive Psychology
    • Ophthalmology
    • Sensory Systems
    • Computer Vision and Pattern Recognition
    • Cognitive Neuroscience

    Fingerprint

    Dive into the research topics of 'Changing pitch of sounds alters perceived visual motion trajectory'. Together they form a unique fingerprint.

    Cite this