Google crawling my site every few days?

[spartan300]

Google has been crawling my home page at spartannutrition.com every few days. Is this good, bad or insignificant?

[Relevancy]

Your site is in the Google Fresh Index. This might help more

http://www.searchenginerelevancy.com/news/

[dannysullivan]

Relevancy's post that he's pointing at talks about two indexes beyond the "regular" third one. To summarize:

Fresh Index: Sites taht are seen as important for Google to spider on a daily or more frequent basis. You can't do anything to get in here, other than to have good links that make Google decide you should be there.

Regular Index: The way Google records most pages, finding them and revisiting them usually at least once per month.

Supplemental Index: Pages Google spiders and revisits infrequently, maybe only every few months. Pages in this index can and do rank, as is discussed by others in the forum. But generally, it's a sign that your pages aren't seen as that important. And there's no particular way out of that.

Note that while I say there are three different indexes, for the fresh and regular index, it's more a case of spidering. These pages to my knowledge still reside in the same index, they just are on different spidering schedules. But the supplemental index is a completely different index that Google users, as I recall.

[Marcia]

Actually, at one time there was a regular Googlebot and what was known as Freshbot. But to my understanding it was announced quite some time ago that there would no longer be "Freshbot" but that the functions would be amalgamated - with just the regular Googlebot.

dannysullivan
Note that while I say there are three different indexes, for the fresh and regular index, it's more a case of spidering. These pages to my knowledge still reside in the same index, they just are on different spidering schedules. Thanks! While there is definitely a difference in crawling (and unfortunately in the frequency of updating the cache date as well, which can be upsetting when it happens), I've never yet heard anything about there being a separate "fresh" index - so it's a comfort to have it confirmed, since it was a little confusing there for a minute.

But the supplemental index is a completely different index that Google users, as I recall. I believe there's even been some indication from Google that that's the case. That index is not a happy place for people's pages to be. :)

[Relevancy]

That index is not a happy place for people's pages to be.
Yes I have had sites be dragged into the vortex of the supp index. I tried everything in my power to get them out. I added new content, got new links pointing to them, pleaded to Google (we know they like the begging ;) ) 301'd them to a different url, etc. None of this removes them. The only thing Google would do when I emailed them was to remove the cache of the urls.

[AussieWebmaster]

Obviously there are a ton of these bots... the Googlebot is not like Santa getting to every website each day etc.
Yet even within that there is a list of sites that have 'fresh' content and get spidered almost daily.... I think and will try and get this confirmed that they have a sub-aglorithm that is of a predictive nature and works on the finding of new content... the larger the new content being one element, the time cycle with which it is updated....
Look at Google News - those spiders are crawling places every 30 minutes or less... now they can't do everyone that ofetn but the do make sure that certain ones do hit a quick path to more repeated spidering.