PDA

View Full Version : Flight G48 - Departing from Googlebot Arriving on Google.com


Nacho
11-20-2004, 02:21 PM
I’ve seen that it's taking Google about 48 hrs from crawling -> repository -> analyzing -> indexing -> reporting it with the site:www.domain.com command in Google.com

NOTE: This domain.com is a BRAND NEW website. We are not talking about sandbox here, just time from crawling to appearing on the index.

One of the wierd things I saw was that there was a sudden drop of pages 24 hrs prior to reporting the new batch. Here is a quick diary for this new web site.

Day 15: Google.com reports 48 pages with "site:" command

Day 16: Googlebot hits 1,892 pages and Google.com continues to report 48 pages with "site:" command.

Day 17: Googlebot hits another 1,129 pages and Google.com reports 1 page (homepage) with "site:" command.

Day 18: Googlebot hits another 911 pages and Google.com reports 2,038 pages with "site:" command.

So, I'm curious to compare with you guys.

1) Is anyone else monitoring this that has different results for a new site?

2) How does the times differ to a faster processing time, say taking a different flight, when the site has multiple crawls during the day (for example a news site such as a press release distribution network that gets crawled every 5 minutes).

3) What can you do to hop on to a faster flight besides getting more external inbound links?

Nick W
11-20-2004, 02:26 PM
Not analyzing but that does generally gel with what i see with new sites: peekaboo with pages for a week then fairly steady..

>>faster flight

Well, a hunch and nothing more: Keep adding fresh stuff at a continous rate, my guess is that G calculates how often it needs to be coming back at this point.

If i didnt make it clear enough :eek: that's all educated guesswork at best :)