Adaptive scoring method based on freshness for fresh information retrieval

Minoru Uehara, Nobuyoshi Sato, Yoshifumi Sakai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Fresh information is important for real business. In order to realize fresh information retrieval, we need not only to collect documents in a short time, but also to rank the results in the suitable order. However, conventional ranking methods are not suited for fresh information retrieval because they ignore temporal value of information. So, we have proposed the novel ranking method FTFIDF for fresh information retrieval. FTF·IDF extends TF·IDF by means of using FTF(fresh term frequency) instead of TF(term frequency). FTF differs from TF because FTF decreases as time goes. The speed of decreasing FTF is determined by the dumping factor. The dumping factor is sensitive against small changes of documents. So, we use a threshold to ignore such small changes. In some papers we published, we detect the optimal threshold manually. In this paper, we proposed an adaptive calculating method in order to detect threshold automatically. In this method, the optimal value is determined by iterating to test generated thresholds. In this paper, we describe our method and its evaluation.

Original languageEnglish
Title of host publicationProceedings - International Workshop on Challenges in Web Information Retrieval and Integration, WIRI'05
Pages226-231
Number of pages6
DOIs
Publication statusPublished - 2005 Dec 1
EventInternational Workshop on Challenges in Web Information Retrieval and Integration, WIRI'05 - Tokyo, Japan
Duration: 2005 Apr 82005 Apr 9

Publication series

NameProceedings - International Workshop on Challenges in Web Information Retrieval and Integration, WIRI'05
Volume2005

Other

OtherInternational Workshop on Challenges in Web Information Retrieval and Integration, WIRI'05
Country/TerritoryJapan
CityTokyo
Period05/4/805/4/9

Keywords

  • Distributed search engine
  • Fresh information retrieval
  • Ranking

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint

Dive into the research topics of 'Adaptive scoring method based on freshness for fresh information retrieval'. Together they form a unique fingerprint.

Cite this