I run a very active subscription based website and note that Google will typically re-cache our website (for our "organic" listing) around once week. A competitor, who is less than one tenth our size is re-cached nearly every day.

I have inserted the "re-visit after" metatag which Google seems to ignore.

Does anyone have any idea what criteria are used by Google to re-cache so I can tailor my site to encourage this behaviour?

If you just leave them out they will start to develop visit times based on changes

Do you have a blog and resource section you update daily? And do you have those links from all your main pages with well internal links architecture? :)

Try these and see the changes :)

Wish you the best

Hello friends

I recently have got my website redesigned and during uploading my new design I kept all the crawlers disallowed to crawl any page of the website through robots.txt Now it has been two weeks and Googlebot has not crawled my website sitemap.

Is there any method through which I can call Googlebot to crawl my sitemap?

Thanks in advance!

Maneet Puri

Your query is not clear, hope the below answer meets it

If you have finished with your uploads and ready for the site index, just work on with your robots.txt file mentioning what pages to be indexed and what not. Create a xml sitemap and then visit Google webmaster tool and register / configure your site as per available instructions in the site. Rest will be taken care by G :)

Good luck,