Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers

Shuhei Imai; Takashi Nose; Aoi Kanagaki; Satoshi Watanabe; Akinori Ito

doi:10.1109/GCCE50665.2020.9292041

Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers

Shuhei Imai, Takashi Nose, Aoi Kanagaki, Satoshi Watanabe, Akinori Ito

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In this paper, we propose a method that improves pronunciation clarity of dysarthric speech using CycleGAN based non-parallel voice conversion. This method converts dysarthric speech into healthy speech using CycleGAN. We considered the use of single and multiple speakers as healthy speech. The subjective evaluations showed the effectiveness of using multiple speakers as healthy speech.

Original language	English
Title of host publication	2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	366-367
Number of pages	2
ISBN (Electronic)	9781728198026
DOIs	https://doi.org/10.1109/GCCE50665.2020.9292041
Publication status	Published - 2020 Oct 13
Externally published	Yes
Event	9th IEEE Global Conference on Consumer Electronics, GCCE 2020 - Kobe, Japan Duration: 2020 Oct 13 → 2020 Oct 16

Publication series

Name	2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020

Conference

Conference	9th IEEE Global Conference on Consumer Electronics, GCCE 2020
Country/Territory	Japan
City	Kobe
Period	20/10/13 → 20/10/16

Keywords

CycleGAN
Dysarthria
Pronunciation clarity
Voice conversion

ASJC Scopus subject areas

Signal Processing
Electrical and Electronic Engineering
Media Technology
Instrumentation
Computer Networks and Communications
Computer Vision and Pattern Recognition

Access to Document

10.1109/GCCE50665.2020.9292041

Cite this

Imai, S., Nose, T., Kanagaki, A., Watanabe, S., & Ito, A. (2020). Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers. In 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020 (pp. 366-367). [9292041] (2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/GCCE50665.2020.9292041

Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers. / Imai, Shuhei; Nose, Takashi; Kanagaki, Aoi; Watanabe, Satoshi; Ito, Akinori.

2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 366-367 9292041 (2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Imai, S, Nose, T, Kanagaki, A, Watanabe, S & Ito, A 2020, Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers. in 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020., 9292041, 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020, Institute of Electrical and Electronics Engineers Inc., pp. 366-367, 9th IEEE Global Conference on Consumer Electronics, GCCE 2020, Kobe, Japan, 20/10/13. https://doi.org/10.1109/GCCE50665.2020.9292041

Imai S, Nose T, Kanagaki A, Watanabe S, Ito A. Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers. In 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 366-367. 9292041. (2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020). https://doi.org/10.1109/GCCE50665.2020.9292041

Imai, Shuhei ; Nose, Takashi ; Kanagaki, Aoi ; Watanabe, Satoshi ; Ito, Akinori. / Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers. 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 366-367 (2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020).

@inproceedings{9d0577d6cbf749b4ac4a1e9a3218eb8a,

title = "Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers",

abstract = "In this paper, we propose a method that improves pronunciation clarity of dysarthric speech using CycleGAN based non-parallel voice conversion. This method converts dysarthric speech into healthy speech using CycleGAN. We considered the use of single and multiple speakers as healthy speech. The subjective evaluations showed the effectiveness of using multiple speakers as healthy speech. ",

keywords = "CycleGAN, Dysarthria, Pronunciation clarity, Voice conversion",

author = "Shuhei Imai and Takashi Nose and Aoi Kanagaki and Satoshi Watanabe and Akinori Ito",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 9th IEEE Global Conference on Consumer Electronics, GCCE 2020 ; Conference date: 13-10-2020 Through 16-10-2020",

year = "2020",

month = oct,

day = "13",

doi = "10.1109/GCCE50665.2020.9292041",

language = "English",

series = "2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "366--367",

booktitle = "2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020",

}

TY - GEN

T1 - Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers

AU - Imai, Shuhei

AU - Nose, Takashi

AU - Kanagaki, Aoi

AU - Watanabe, Satoshi

AU - Ito, Akinori

PY - 2020/10/13

Y1 - 2020/10/13

N2 - In this paper, we propose a method that improves pronunciation clarity of dysarthric speech using CycleGAN based non-parallel voice conversion. This method converts dysarthric speech into healthy speech using CycleGAN. We considered the use of single and multiple speakers as healthy speech. The subjective evaluations showed the effectiveness of using multiple speakers as healthy speech.

AB - In this paper, we propose a method that improves pronunciation clarity of dysarthric speech using CycleGAN based non-parallel voice conversion. This method converts dysarthric speech into healthy speech using CycleGAN. We considered the use of single and multiple speakers as healthy speech. The subjective evaluations showed the effectiveness of using multiple speakers as healthy speech.

KW - CycleGAN

KW - Dysarthria

KW - Pronunciation clarity

KW - Voice conversion

UR - http://www.scopus.com/inward/record.url?scp=85099386175&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85099386175&partnerID=8YFLogxK

U2 - 10.1109/GCCE50665.2020.9292041

DO - 10.1109/GCCE50665.2020.9292041

M3 - Conference contribution

AN - SCOPUS:85099386175

T3 - 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020

SP - 366

EP - 367

BT - 2020 IEEE 9th Global Conference on Consumer Electronics, GCCE 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 9th IEEE Global Conference on Consumer Electronics, GCCE 2020

Y2 - 13 October 2020 through 16 October 2020

ER -

Improving Pronunciation Clarity of Dysarthric Speech Using CycleGAN with Multiple Speakers

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this