title: Searching the Web
creator: Arasu, Arvind
creator: Cho, Junghoo
creator: Garcia-Molina, Hector
creator: Paepcke, Andreas
creator: Raghavan, Sriram
subject: Databases and the Web
description: We offer an overview of current Web search engine design. After introducing a generic search engine architecture, we examine each engine component in turn. We cover crawling, local Web page storage, indexing, and the use of link analysis for boosting search performance. The most common design and implementation techniques for each of these components are presented. We draw for this presentation from the literature, and from our own experimental search engine testbed. Emphasis is on introducing the fundamental concepts, and the results of several performance analyses we conducted to compare different designs. 
publisher: Stanford
date: 2000
type: Techreport
type: NonPeerReviewed
format: application/pdf
identifier: http://ilpubs.stanford.edu:8090/457/1/2000-37.pdf
identifier: Arasu, Arvind and Cho, Junghoo and Garcia-Molina, Hector and Paepcke, Andreas and Raghavan, Sriram (2000) Searching the Web. Technical Report. Stanford.
relation: http://ilpubs.stanford.edu:8090/457/