TY - GEN
T1 - Scalability and reliability in a distributed search engine
AU - Sato, Nobuyoshi
AU - Udagawa, Minoru
AU - Uehara, Minoru
AU - Sakai, Yoshifumi
AU - Mori, Hideki
PY - 2002/1/1
Y1 - 2002/1/1
N2 - We have developed a distributed search engine, called cooperative search engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. A meta search server integrates these local search engines in order to realize a global search engine. In such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search quickly. However we have developed several speedup techniques in order to realize real time retrieval. In addition, the meta server is a single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper we describe scalability and reliability of CSE and their evaluations.
AB - We have developed a distributed search engine, called cooperative search engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. A meta search server integrates these local search engines in order to realize a global search engine. In such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search quickly. However we have developed several speedup techniques in order to realize real time retrieval. In addition, the meta server is a single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper we describe scalability and reliability of CSE and their evaluations.
KW - Delay effects
KW - Distributed computing
KW - Information retrieval
KW - Metasearch
KW - Network servers
KW - Redundancy
KW - Scalability
KW - Search engines
KW - Web pages
KW - Web server
UR - http://www.scopus.com/inward/record.url?scp=84948776944&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84948776944&partnerID=8YFLogxK
U2 - 10.1109/ICPADS.2002.1183378
DO - 10.1109/ICPADS.2002.1183378
M3 - Conference contribution
AN - SCOPUS:84948776944
T3 - Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS
SP - 57
EP - 62
BT - Proceedings - 9th International Conference on Parallel and Distributed Systems, ICPADS 2002
PB - IEEE Computer Society
T2 - 9th International Conference on Parallel and Distributed Systems, ICPADS 2002
Y2 - 17 December 2002 through 20 December 2002
ER -