Dialogue System Live Competition: Identifying Problems with Dialogue Systems Through Live Event

Ryuichiro Higashinaka, Kotaro Funakoshi, Michimasa Inaba, Yuiko Tsunomori, Tetsuro Takahashi, Reina Akama

研究成果: Chapter

抄録

We organized a competition entitled “the dialogue system live competition” in which the audience, consisting mainly of researchers in the dialogue community, watched and evaluated a live dialogue conducted between users and dialogue systems. The motivation behind the event was to cultivate state-of-the-art techniques in dialogue systems and enable the dialogue community to share the problems with current dialogue systems. There are two parts to the competition: preliminary selection and live event. In the preliminary selection, eleven systems were evaluated by crowd-sourcing. Three systems proceeded to the live event to perform dialogues with designated speakers and to be evaluated by the audience. This paper describes the design and procedure of the competition, the results of the preliminary selection and live event of the competition, and the problems we identified from the event.

本文言語English
ホスト出版物のタイトルLecture Notes in Electrical Engineering
出版社Springer Science and Business Media Deutschland GmbH
ページ185-199
ページ数15
DOI
出版ステータスPublished - 2021

出版物シリーズ

名前Lecture Notes in Electrical Engineering
714
ISSN(印刷版)1876-1100
ISSN(電子版)1876-1119

ASJC Scopus subject areas

  • 産業および生産工学

引用スタイル