Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning

Haoran Wu; Yuya Chiba; Takashi Nose; Akinori Ito

doi:10.21437/Interspeech.2018-1425

Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning

Haoran Wu, Yuya Chiba, Takashi Nose, Akinori Ito

ENG - Communications Engineering

Research output: Contribution to journal › Conference article › peer-review

1 Citation (Scopus)

Abstract

English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.

Original language	English
Pages (from-to)	1746-1750
Number of pages	5
Journal	Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
Volume	2018-September
DOIs	https://doi.org/10.21437/Interspeech.2018-1425
Publication status	Published - 2018
Event	19th Annual Conference of the International Speech Communication, INTERSPEECH 2018 - Hyderabad, India Duration: 2018 Sep 2 → 2018 Sep 6

Keywords

Computer-Assisted Language Leaning (CALL)
Multimodal interaction
Para-linguistic information
Physical expressions

ASJC Scopus subject areas

Language and Linguistics
Human-Computer Interaction
Signal Processing
Software
Modelling and Simulation

Access to Document

10.21437/Interspeech.2018-1425

Fingerprint Dive into the research topics of 'Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning'. Together they form a unique fingerprint.

Cite this

Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning. / Wu, Haoran; Chiba, Yuya; Nose, Takashi ; Ito, Akinori.

In: Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, Vol. 2018-September, 2018, p. 1746-1750.

Research output: Contribution to journal › Conference article › peer-review

@article{f71758ec6f224e05bc9bf2419e5706be,

title = "Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning",

abstract = "English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.",

keywords = "Computer-Assisted Language Leaning (CALL), Multimodal interaction, Para-linguistic information, Physical expressions",

author = "Haoran Wu and Yuya Chiba and Takashi Nose and Akinori Ito",

note = "Funding Information: This work was supported by JSPS KAKENHI Grant Numbers JP15H02720 and JP17H00823. Publisher Copyright: {\textcopyright} 2018 International Speech Communication Association. All rights reserved.; 19th Annual Conference of the International Speech Communication, INTERSPEECH 2018 ; Conference date: 02-09-2018 Through 06-09-2018",

year = "2018",

doi = "10.21437/Interspeech.2018-1425",

language = "English",

volume = "2018-September",

pages = "1746--1750",

journal = "Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",

issn = "2308-457X",

}

TY - JOUR

T1 - Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning

AU - Wu, Haoran

AU - Chiba, Yuya

AU - Nose, Takashi

AU - Ito, Akinori

N1 - Funding Information: This work was supported by JSPS KAKENHI Grant Numbers JP15H02720 and JP17H00823. Publisher Copyright: © 2018 International Speech Communication Association. All rights reserved.

PY - 2018

Y1 - 2018

N2 - English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.

AB - English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.

KW - Computer-Assisted Language Leaning (CALL)

KW - Multimodal interaction

KW - Para-linguistic information

KW - Physical expressions

UR - http://www.scopus.com/inward/record.url?scp=85055006871&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055006871&partnerID=8YFLogxK

U2 - 10.21437/Interspeech.2018-1425

DO - 10.21437/Interspeech.2018-1425

M3 - Conference article

AN - SCOPUS:85055006871

VL - 2018-September

SP - 1746

EP - 1750

JO - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

JF - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

SN - 2308-457X

T2 - 19th Annual Conference of the International Speech Communication, INTERSPEECH 2018

Y2 - 2 September 2018 through 6 September 2018

ER -

Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this