google crawl

[timdp]

Can anyone tell me what happens between the googlebot "getting" a page from my site, and updating its index and cache, and typically how long it takes for something to happen?

I substantially updated our site on May 30 to optimze for certain keywords, and I've tracked the google crawler since. It has apparently crawled 20-70 pages per day (there are only about 100 on the site), but very few of those have actually been updated in its cache and so I have only seen a small improvement in rankings, for those pages it has actually updated. Should it take this long, or might it be ignoring my pages for some reason?

thank you for any help:confused:

[jimbeetle]

Welcome timdp.

For the past couple of years much of Google's crawling and indexing behavior has depended on the PageRank of individual pages. Basically, the higher the page's PR the more frequently the page is crawled, the quicker the updated page appears in the index.

Crawling is a good sign. Unless you suspect any other problems I'd recommend just sitting back and waiting for the moment.

[timdp]

many thanks - I had wondered if it was a function of pagerank. Our home page is 5/10, a couple of others are medium, and the rest are low. Of 26 pages updated 2 weeks ago, 6 have been updated in the cache, though as I said, the googlebot seems to obtain between 20 and 70 every day.

I'll just try and be patient.

[marketraise]

hi
but for getting index and crawler should get path i there is any broken link so crawler get confused and don't crawl the pages.that's why putting site map is very important .

[timdp]

yeah, the site map is there and up to date, and google has verified and read it. It still is reindexing at the rate of perhaps a page every other day.

[Dan01]

Welcome timdp.

For the past couple of years much of Google's crawling and indexing behavior has depended on the PageRank of individual pages. Basically, the higher the page's PR the more frequently the page is crawled, the quicker the updated page appears in the index.

Crawling is a good sign. Unless you suspect any other problems I'd recommend just sitting back and waiting for the moment.

Hey Jim, it seems like I remember reading that Google crawls sites according to how frequently the sites are updated. In other words, if a person adds a page a week, Goolge will get in the habit of crawling the site once a week. The quicker you add content, the quicker Google gets back to you.

[jimbeetle]

I'm sure freshness and updating frequency would be part of the algo used to determine frequency of spidering, makes sense. But when you read back through stuff Matt Cutts and other Googlers have said since G implemented the Big Daddy infrastructure in Spring ought six, PageRank *appears* to play a very important part.

[Dan01]

Well then there is still some importance to PR. LOL