PDA

View Full Version : Slurp requesting millions, Yahoo shows only a few...?


flex55
02-16-2005, 06:08 AM
At the beginning of October 2004 our site was excluded from Y! index. After contacting them, they explained the reason (when a certain error happened in the site, server replied 200 code with and an error page for every request, which led Y! to think there are tons of duplicate pages - the error page).

Yahoo then said that shortly the site will be included back in the index.
Time passed, and indeed, after 4 weeks Slurp started to visit us again.
Since November, Slurp fetched over 5 million pages. 60% of which were in January-
still, a site:domain query returns only 30 pages on yahoo.

Does anyone know what and why? It sounds so weired that Slurp would fetch so many pages and almost none would get into the index.
I'd really appreciate if anyone knows this and what's happening, or to refer to an email at yahoo. I just can't get them to respond to me.