Comparison of the effects of verbal versus visual information about sound sources on the perception of environmental sounds

Koji Abe, Kenji Ozawa, Yôiti Suzuki, Toshio Sone

Research output: Contribution to journalArticlepeer-review

30 Citations (Scopus)

Abstract

We perceive our environment by integrating multi-modal information. Although researchers have attempted to interpret sound perception solely through hearing, few attempts have been made using multi-modal information to understand our perception of environmental sounds. In this study, we conducted three experiments in which the sound stimuli were presented alone, with corresponding verbal information, or with corresponding visual information. In order to investigate the difference in the perception attributable to the verbal and visual information, analysis of variance was applied to the factor scores of each stimulus. Our analyses revealed that the effects of additional information on factor scores were different for verbal and visual information, except in the case of brightness. We suggest that the image intrinsic to a sound sources, evoked by verbal and visual information, affects the evaluation of sounds. Furthermore, moving pictures (visual information) contain a variety of information, whereas verbal information gives only determinative information. When this discrepancy produces appreciable differences between verbal and visual information, the changes in the factor scores can be rationally explained. Hence, we consider both the visibility and movement of the sound source to be important factors in our perception of environmental sounds.

Original languageEnglish
Pages (from-to)51-60
Number of pages10
JournalActa Acustica united with Acustica
Volume92
Issue number1
Publication statusPublished - 2006 Jan 1

ASJC Scopus subject areas

  • Music
  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Comparison of the effects of verbal versus visual information about sound sources on the perception of environmental sounds'. Together they form a unique fingerprint.

Cite this