Automatic clustering of part-of-speech for vocabulary divided PLSA language model

Motoyuki Suzuki, Naoto Kuriyama, Akinori Ito, Shozo Makino

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

PLSA is one of the most powerful language models for adaptation to a target speech. The vocabulary divided PLSA language model (VD-PLSA) shows higher performance than the conventional PLSA model because it can be adapted to the target topic and the target speaking style individually. However, all of the vocabulary must be manually divided into three categories (topic, speaking style, and general category). In this paper, an automatic method for clustering parts-of-speech (POS) is proposed for VD-PLSA. Several corpora with different styles are prepared, and the distance between corpora in terms of POS is calculated. The "general tendency score" and "style tendency score" for each POS are calculated based on the distance between corpora. All of the POS are divided into three categories using two scores and appropriate thresholds. Experimental results showed the proposed method formed appropriate clusters, and VD-PLSA with acquired categories gave the highest performance of all other models. We applied the VD-PLSA into large vocabulary continuous speech recognition system. VD-PLSA improved the recognition accuracy for documents with lower out-of-vocabulary ratio, while other documents were not improved or slightly descended the accuracy.

Original languageEnglish
Title of host publication2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008
DOIs
Publication statusPublished - 2008 Dec 1
Event2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008 - Beijing, China
Duration: 2008 Oct 192008 Oct 22

Publication series

Name2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008

Other

Other2008 International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2008
CountryChina
CityBeijing
Period08/10/1908/10/22

Keywords

  • General/style tendency score
  • Language model
  • Part-of-speech
  • Speech recognition
  • Vocabulary divided PLSA

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Fingerprint Dive into the research topics of 'Automatic clustering of part-of-speech for vocabulary divided PLSA language model'. Together they form a unique fingerprint.

Cite this