Music information retrieval from a singing voice based on verification of recognized hypotheses

Motoyuki Suzuki, Toru Hosoya, Akinori Ito, Shozo Makino

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Several music information retrieval (MIR) systems have been developed which retrieve musical pieces by the user's singing voice. All of these systems use only melody information for retrieval, although lyrics information is also useful for retrieval. In this paper, we propose an MIR system that uses both melody and lyrics information in the singing voice. The MIR system verifies hypotheses output by a lyrics recognizer from a melodic point of view. Each hypothesis has time alignment information between the singing voice and recognized text, and the boundaries of each note can be estimated using the information. As a result, melody information is extracted from the singing voice. On the other hand, the melody information can be calculated from the musical score of the song because the recognized text must be a part of the lyrics of the song. The hypothesis is verified by calculating the similarity between the two types of melody information. From the experimental results, the verification method increased the retrieval accuracy. Especially, it was very effective when the number of words in the user's singing voice was small. The proposed method increased the retrieval accuracy from 81.3% to 87.4% when the number of words was only three.

Original languageEnglish
Title of host publicationISMIR 2006 - 7th International Conference on Music Information Retrieval
Pages168-171
Number of pages4
Publication statusPublished - 2006 Dec 1
Event7th International Conference on Music Information Retrieval, ISMIR 2006 - Victoria, BC, Canada
Duration: 2006 Oct 82006 Oct 12

Publication series

NameISMIR 2006 - 7th International Conference on Music Information Retrieval

Other

Other7th International Conference on Music Information Retrieval, ISMIR 2006
CountryCanada
CityVictoria, BC
Period06/10/806/10/12

Keywords

  • Lyrics recognition
  • MIR from singing voice
  • Verification of recognized hypotheses

ASJC Scopus subject areas

  • Music
  • Information Systems

Fingerprint Dive into the research topics of 'Music information retrieval from a singing voice based on verification of recognized hypotheses'. Together they form a unique fingerprint.

Cite this