A discriminative sentence compression method as combinatorial optimization problem

Tsutomu Hirao, Jun Suzuki, Hideki Isczaki

Research output: Contribution to journalArticle

Abstract

In the study of automatic summarization, the main research topic was 'important sentence extraction' but nowadays 'sentence compression' is a hot research topic. Conventional sentence compression methods usually transform a given sentence into a parse tree or a dependency tree, and modify them to get a, shorter sentence. However, this method is sometimes too rigid. In this paper, we regard sentence compression as an combinatorial optimization problem that extracts an optimal subsequence of words. Hori et al. also proposed a similar method, but they used only a small number of features and their weights were tuned by hand. We introduce a large number of features such as part-of-speech bigrams and word position in the sentence. Furthermore, we train the system by discriminative learning. According to our experiments, our method obtained better score than other methods with statistical significance.

Original languageEnglish
Pages (from-to)574-583
Number of pages10
JournalTransactions of the Japanese Society for Artificial Intelligence
Volume22
Issue number6
Publication statusPublished - 2007 Dec 1
Externally publishedYes

Keywords

  • Combinatorial optimization
  • Discriminative learning
  • Dynamic programming
  • Sentence compression
  • Text summarization

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'A discriminative sentence compression method as combinatorial optimization problem'. Together they form a unique fingerprint.

Cite this