How often does googlebot come?

[cowren]

hello!

does anybody know how often the google crawler come to crawl my site?

cowren

[mick g]

only you will have access to the information via you sites log file or site statistics program

[cowren]

hm... does google sitemap tell? i find that it is not frequently updated :)

cowren

[bhartzer]

The higher your PR and the more often you update your page(s) the more often Googlebot will crawl your site.

[JEC]

Google Sitemaps does not seem to give any information about when the googlebot last crawled your site. They do tell you when they last downloaded the sitemap.xml and robots.txt file, but that seems to be about it.

Mick G is right. Only you have access to your sites log files and those files should give clear indications of all the bots that hit your site and when. I would suggest either using a hosted utility or some other purchased or even freebie software to check those stats.

JEC

[cowren]

what sitemap.xml is?

cowren

[JEC]

Sitemap.xml is a file that you provide to Google with information about your site in an effort to help them index your site better. You specify what files for them to crawl and how often to come back, etc. You can read more about it here:

https://www.google.com/webmasters/sitemaps/docs/en/about.html

Sign up is free and they have utilities to help with creating the file you need.

JEC

[cowren]

thanks for ur site.

cowren

[vikypatil]

My sites are crawlled daily by Google...

[hans51]

a yeaar or 2 ago - Googlebot made about 4-6 times the number of pages per months.
in recent months Googlebot has substantially increased its activity on my site and for April 2006
my access statistic shows
71859 Googlebot
and
8290 Mediapartners-Google (for adsense)
visits

that is substantially more visits per day for BOTH Google bots
and compared to the number of html files
more than 10x the nr of pages

[mick g]

and with this increased activity have you managed to get more pages indexed

[hans51]

since years i focus on SEO and HTML code validation ( except in my 5 forums which unfortunately have a totally messed up code by its forum software ) and thus i enjoy since years a near 100% indexing of all pages within days after publishing new pages

the increase of Google bot visits may just refresh pages faster to have better uptodate content if changes/modifications do occur

roughly a 100% traffic increase year by year since many years is plenty to be happy with Google and Yahoo

[ewc21]

The frequency of visits differ by site. The more activities your site have and the more entry points for crawlers (read: inbound links) the chances of more frequent visits is likely.