Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features

Yuya Chiba; Masashi Ito; Akinori Ito

doi:10.1007/978-3-642-39476-8_115

Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features

Yuya Chiba, Masashi Ito, Akinori Ito

ENG - Communications Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

Abstract

Spoken dialog system (SDS) is a typical speech application and sometimes regarded as one of ideal interfaces. However, most of conventional SDSs cannot help their user while waiting for input utterance since they treat a user's utterance as a trigger of processing. This architecture is largely different from the manner of human-human interaction and factor that makes the user feel inconvenience when they cannot respond to the system's prompt appropriately. To solve this problem, the system should be able to estimate the internal state of the user before observing the user's input utterance. In present paper, we proposed twostep discrimination method using multi-modal information to estimate the user's state frame by frame.

Original language	English
Title of host publication	HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings
Publisher	Springer-Verlag
Pages	572-576
Number of pages	5
Edition	PART II
ISBN (Print)	9783642394751
DOIs	https://doi.org/10.1007/978-3-642-39476-8_115
Publication status	Published - 2013 Jan 1
Event	15th International Conference on Human-Computer Interaction, HCI International 2013 - Las Vegas, NV, United States Duration: 2013 Jul 21 → 2013 Jul 26

Publication series

Name	Communications in Computer and Information Science
Number	PART II
Volume	374
ISSN (Print)	1865-0929

Other

Other	15th International Conference on Human-Computer Interaction, HCI International 2013
Country/Territory	United States
City	Las Vegas, NV
Period	13/7/21 → 13/7/26

Keywords

Multi-modal information
Spoken dialog system
User modeling

ASJC Scopus subject areas

Computer Science(all)

Access to Document

10.1007/978-3-642-39476-8_115

Cite this

Chiba, Y., Ito, M., & Ito, A. (2013). Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features. In HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings (PART II ed., pp. 572-576). (Communications in Computer and Information Science; Vol. 374, No. PART II). Springer-Verlag. https://doi.org/10.1007/978-3-642-39476-8_115

Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features. / Chiba, Yuya; Ito, Masashi; Ito, Akinori.

HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings. PART II. ed. Springer-Verlag, 2013. p. 572-576 (Communications in Computer and Information Science; Vol. 374, No. PART II).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chiba, Y, Ito, M & Ito, A 2013, Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features. in HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings. PART II edn, Communications in Computer and Information Science, no. PART II, vol. 374, Springer-Verlag, pp. 572-576, 15th International Conference on Human-Computer Interaction, HCI International 2013, Las Vegas, NV, United States, 13/7/21. https://doi.org/10.1007/978-3-642-39476-8_115

Chiba Y, Ito M, Ito A. Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features. In HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings. PART II ed. Springer-Verlag. 2013. p. 572-576. (Communications in Computer and Information Science; PART II). https://doi.org/10.1007/978-3-642-39476-8_115

@inproceedings{5cc2e2d8a641437f9a44a5f285ab7a13,

title = "Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features",

abstract = "Spoken dialog system (SDS) is a typical speech application and sometimes regarded as one of ideal interfaces. However, most of conventional SDSs cannot help their user while waiting for input utterance since they treat a user's utterance as a trigger of processing. This architecture is largely different from the manner of human-human interaction and factor that makes the user feel inconvenience when they cannot respond to the system's prompt appropriately. To solve this problem, the system should be able to estimate the internal state of the user before observing the user's input utterance. In present paper, we proposed twostep discrimination method using multi-modal information to estimate the user's state frame by frame.",

keywords = "Multi-modal information, Spoken dialog system, User modeling",

author = "Yuya Chiba and Masashi Ito and Akinori Ito",

year = "2013",

month = jan,

day = "1",

doi = "10.1007/978-3-642-39476-8_115",

language = "English",

isbn = "9783642394751",

series = "Communications in Computer and Information Science",

publisher = "Springer-Verlag",

number = "PART II",

pages = "572--576",

booktitle = "HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings",

edition = "PART II",

note = "15th International Conference on Human-Computer Interaction, HCI International 2013 ; Conference date: 21-07-2013 Through 26-07-2013",

}

TY - GEN

T1 - Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features

AU - Chiba, Yuya

AU - Ito, Masashi

AU - Ito, Akinori

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Spoken dialog system (SDS) is a typical speech application and sometimes regarded as one of ideal interfaces. However, most of conventional SDSs cannot help their user while waiting for input utterance since they treat a user's utterance as a trigger of processing. This architecture is largely different from the manner of human-human interaction and factor that makes the user feel inconvenience when they cannot respond to the system's prompt appropriately. To solve this problem, the system should be able to estimate the internal state of the user before observing the user's input utterance. In present paper, we proposed twostep discrimination method using multi-modal information to estimate the user's state frame by frame.

AB - Spoken dialog system (SDS) is a typical speech application and sometimes regarded as one of ideal interfaces. However, most of conventional SDSs cannot help their user while waiting for input utterance since they treat a user's utterance as a trigger of processing. This architecture is largely different from the manner of human-human interaction and factor that makes the user feel inconvenience when they cannot respond to the system's prompt appropriately. To solve this problem, the system should be able to estimate the internal state of the user before observing the user's input utterance. In present paper, we proposed twostep discrimination method using multi-modal information to estimate the user's state frame by frame.

KW - Multi-modal information

KW - Spoken dialog system

KW - User modeling

UR - http://www.scopus.com/inward/record.url?scp=84886257935&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84886257935&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-39476-8_115

DO - 10.1007/978-3-642-39476-8_115

M3 - Conference contribution

AN - SCOPUS:84886257935

SN - 9783642394751

T3 - Communications in Computer and Information Science

SP - 572

EP - 576

BT - HCI International 2013 - Posters' Extended Abstracts - International Conference, HCI International 2013, Proceedings

PB - Springer-Verlag

T2 - 15th International Conference on Human-Computer Interaction, HCI International 2013

Y2 - 21 July 2013 through 26 July 2013

ER -

Estimation of User's State during a Dialog Turn with Sequential Multi-modal Features

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this