Scalability and reliability in a distributed search engine

Nobuyoshi Sato, Minoru Udagawa, Minoru Uehara, Yoshifumi Sakai, Hideki Mori

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

We have developed a distributed search engine, called cooperative search engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. A meta search server integrates these local search engines in order to realize a global search engine. In such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search quickly. However we have developed several speedup techniques in order to realize real time retrieval. In addition, the meta server is a single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper we describe scalability and reliability of CSE and their evaluations.

Original languageEnglish
Title of host publicationProceedings - 9th International Conference on Parallel and Distributed Systems, ICPADS 2002
PublisherIEEE Computer Society
Pages57-62
Number of pages6
ISBN (Electronic)0769517609
DOIs
Publication statusPublished - 2002 Jan 1
Externally publishedYes
Event9th International Conference on Parallel and Distributed Systems, ICPADS 2002 - Taiwan, China
Duration: 2002 Dec 17 → 2002 Dec 20

Publication series

NameProceedings of the International Conference on Parallel and Distributed Systems - ICPADS
Volume2002-January
ISSN (Print)1521-9097

Other

Other9th International Conference on Parallel and Distributed Systems, ICPADS 2002
CountryChina
CityTaiwan
Period02/12/17 → 02/12/20

Keywords

  • Delay effects
  • Distributed computing
  • Information retrieval
  • Metasearch
  • Network servers
  • Redundancy
  • Scalability
  • Search engines
  • Web pages
  • Web server

ASJC Scopus subject areas

  • Hardware and Architecture

Access to Document

Fingerprint Dive into the research topics of 'Scalability and reliability in a distributed search engine'. Together they form a unique fingerprint.

    • Cite this

    Sato, N., Udagawa, M., Uehara, M., Sakai, Y., & Mori, H. (2002). Scalability and reliability in a distributed search engine. In Proceedings - 9th International Conference on Parallel and Distributed Systems, ICPADS 2002 (pp. 57-62). [1183378] (Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS; Vol. 2002-January). IEEE Computer Society. https://doi.org/10.1109/ICPADS.2002.1183378