Search Engine Watch
SEO News

Go Back   Search Engine Watch Forums > General Search Issues > Search Technology & Relevancy
FAQ Members List Calendar Forum Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
Old 09-09-2004   #1
rustybrick
 
rustybrick's Avatar
 
Join Date: Jun 2004
Location: New York, USA
Posts: 2,810
rustybrick has much to be proud ofrustybrick has much to be proud ofrustybrick has much to be proud ofrustybrick has much to be proud ofrustybrick has much to be proud ofrustybrick has much to be proud ofrustybrick has much to be proud ofrustybrick has much to be proud of
How Do the Search Indexes Work?

There was a thread recently started where a member asks how can Google report "Searching 4,285,199,774 web pages", when in fact, if you do a search on the at Google, you get 5,800,000,000 results. That is a difference of 1,514,800,226, which seems high.

In addition the figure 5,800,000,000 seems a bit too round.

My question here is how do most search indexes work?

From my understanding, Google spiders, indexes a portion of those pages and then people do searches on the index. Now, I would imagine that Google has indexes for all sorts of data. Index for linkage, index for text, index for PageRank and other indexes.

An other question I have is: Does Google remove duplicate content from its index or does it just filter it out in the algorithm when a search is being done. I tend to believe that removing dup content from the index is more efficient, but then when you see how Google's search works, the results filter out dup content on the fly (do a site:www.domain.com search and you will find many duplicate pages on some sites).

Lets talk search index technology here.
rustybrick is offline   Reply With Quote
Old 09-10-2004   #2
seobook
I'm blogging this
 
Join Date: Jun 2004
Location: we are Penn State!
Posts: 1,943
seobook is a name known to allseobook is a name known to allseobook is a name known to allseobook is a name known to allseobook is a name known to allseobook is a name known to all
a while ago Chris Ridings did a brief overview
http://chriseo.com/modules.php?op=mo...rder=0&thold=0
__________________
The SEO Book
seobook is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off