Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning

Haoran Wu, Yuya Chiba, Takashi Nose, Akinori Ito

Research output: Contribution to journalConference articlepeer-review

1 Citation (Scopus)

Abstract

English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.

Original languageEnglish
Pages (from-to)1746-1750
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume2018-September
DOIs
Publication statusPublished - 2018
Event19th Annual Conference of the International Speech Communication, INTERSPEECH 2018 - Hyderabad, India
Duration: 2018 Sep 22018 Sep 6

Keywords

  • Computer-Assisted Language Leaning (CALL)
  • Multimodal interaction
  • Para-linguistic information
  • Physical expressions

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modelling and Simulation

Fingerprint Dive into the research topics of 'Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning'. Together they form a unique fingerprint.

Cite this