Search Engine Watch
SEO News

Go Back   Search Engine Watch Forums > Search Engines & Directories > Google > Google Web Search
FAQ Members List Calendar Forum Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
Old 09-25-2004   #1
creativecraig
Who said that..?
 
Join Date: Sep 2004
Location: London
Posts: 78
creativecraig is on a distinguished road
Google deep crawling

Having read a thread over at webmasterworld regarding deepcrawling by Google, I had a a good look at my logs for a few sites and noticed that I have been deepcrawled by Google three times on one site during the last week and the others have had at least one good crawl taking over 95% of the pages on all the sites.

There was also a new IP range: 66.249.65.x which came by in the midst of the action. Others have been fully crawled by the new IP.

If there is a new IP to be watching for could this be an attempt to target cloaked networks?
creativecraig is offline   Reply With Quote
Old 09-25-2004   #2
creativecraig
Who said that..?
 
Join Date: Sep 2004
Location: London
Posts: 78
creativecraig is on a distinguished road
http://www.webmasterworld.com/forum3/25897.htm

Here is the thread from Webmasterworld.
creativecraig is offline   Reply With Quote
Old 09-25-2004   #3
I, Brian
Whitehat on...Whitehat off...Whitehat on...Whitehat off...
 
Join Date: Jun 2004
Location: Scotland
Posts: 940
I, Brian is a glorious beacon of lightI, Brian is a glorious beacon of lightI, Brian is a glorious beacon of lightI, Brian is a glorious beacon of lightI, Brian is a glorious beacon of light
That's an interesting thread - whenever I visit WMW off-chance, the SEO forums are filled with newbie questions that invite zero level participation. Then every now and then information-rich threads like these will be linked to from external sites.

So to cap the discussion -

1. Is Google suddenly re-building it's index from scratch?
2. What is the purpose of the IP ranges?
I, Brian is offline   Reply With Quote
Old 09-25-2004   #4
I, Brian
Whitehat on...Whitehat off...Whitehat on...Whitehat off...
 
Join Date: Jun 2004
Location: Scotland
Posts: 940
I, Brian is a glorious beacon of lightI, Brian is a glorious beacon of lightI, Brian is a glorious beacon of lightI, Brian is a glorious beacon of lightI, Brian is a glorious beacon of light
ADDENDUM: Phoenix at SERoundtable points out the Digitalpoint thread here:
http://forums.digitalpoint.com/showthread.php?t=3190

which discusses the new IP more specifically, along with the indexing patterns observed (rather than a debate on how Google idnexes, as per the WMW thread)..
I, Brian is offline   Reply With Quote
Old 09-26-2004   #5
creativecraig
Who said that..?
 
Join Date: Sep 2004
Location: London
Posts: 78
creativecraig is on a distinguished road
Thats a good thread I,brian from digitalpoint.

I have not really noticed any pattern to this current spidering, it has literaly come in and taken random pages from my sites.

The only reason for the new IP that I can think of would be to combat the cloaking issue.

Interesting that you mentioned that about WMW, I wrote something very similar on my site yesterday.
creativecraig is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off