Reliability of a distributed search engine for fresh information retrieval in large-scale intranet

Nobuyoshi Sato, Minoru Udagawa, Minoru Uehara, Yoshifumi Sakai, Hideki Mori

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

We have developed distributed search engine, called Cooperative Search Engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. And, a meta search server integrates these local search engines in order to realize a global search engine. However, in such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search fast. However, we have developed several speedup techniques in order to realize real time retrieval. By the way, distributed search engines such as CSE are essentially fault tolerant. However, the meta server is single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper, we describe reliability of CSE and their evaluations.

Original languageEnglish
Title of host publicationNew Horizons of Parallel and Distributed Computing
PublisherSpringer US
Pages203-216
Number of pages14
ISBN (Print)0387244344, 9780387244341
DOIs
Publication statusPublished - 2005 Dec 1

Keywords

  • Cooperative Search Engine
  • Redundant Meta Search Servers
  • WWW

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Reliability of a distributed search engine for fresh information retrieval in large-scale intranet'. Together they form a unique fingerprint.

Cite this