Construction and analysis of a multimodal chat-talk corpus for dialog systems considering interpersonal closeness

Yoshihiro Yamazaki, Yuya Chiba, Takashi Nose, Akinori Ito

研究成果: Conference contribution

2 被引用数 (Scopus)

抄録

There are high expectations for multimodal dialog systems that can make natural small talk with facial expressions, gestures, and gaze actions as next-generation dialog-based systems. Two important roles of the chat-talk system are keeping the user engaged and establishing rapport. Many studies have conducted user evaluations of such systems, some of which reported that considering the relationship with the user is an effective way to improve the subjective evaluation. To facilitate research of such dialog systems, we are currently constructing a large-scale multimodal dialog corpus focusing on the relationship between speakers. In this paper, we describe the data collection and annotation process, and analysis of the corpus collected in the early stage of the project. This corpus contains 19,303 utterances (10 hours) from 19 pairs of participants. A dialog act tag is annotated to each utterance by two annotators. We compare the frequency and the transition probability of the tags between different closeness levels to help construct a dialog system for establishing a relationship with the user.

本文言語English
ホスト出版物のタイトルLREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings
編集者Nicoletta Calzolari, Frederic Bechet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
出版社European Language Resources Association (ELRA)
ページ443-448
ページ数6
ISBN(電子版)9791095546344
出版ステータスPublished - 2020
イベント12th International Conference on Language Resources and Evaluation, LREC 2020 - Marseille, France
継続期間: 2020 5 112020 5 16

出版物シリーズ

名前LREC 2020 - 12th International Conference on Language Resources and Evaluation, Conference Proceedings

Conference

Conference12th International Conference on Language Resources and Evaluation, LREC 2020
国/地域France
CityMarseille
Period20/5/1120/5/16

ASJC Scopus subject areas

  • 言語および言語学
  • 教育
  • 図書館情報学
  • 言語学および言語

フィンガープリント

「Construction and analysis of a multimodal chat-talk corpus for dialog systems considering interpersonal closeness」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル