Abstract
This study extends the current productivity models for a typical Web search engine system, which consists of a Web crawling system and an indexing system. Five different design schemata are characterized according to this model and are compared through power consumption, networking cost, system scale, and query efficiency. The half-WAN scheme, which consists of a WAN-based crawling system and a multi-cluster indexing system, is proved to be the best choice for a large-scale highly-efficient Web search engine.
| Original language | English |
|---|---|
| Pages (from-to) | 253-265 |
| Number of pages | 13 |
| Journal | Ruan Jian Xue Bao/Journal of Software |
| Volume | 23 |
| Issue number | 2 |
| DOIs | |
| State | Published - Feb 2012 |
| Externally published | Yes |
Keywords
- Distributed crawling
- Distributed indexing
- Distributed search engine
- Half- WAN-based search engine
- Productivity modeling
Fingerprint
Dive into the research topics of 'Distributed search engine system productivity modeling and evaluation'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver