Hi Gurus

Google is making my site get bigger and bigger. type: site:friars.co.nz and you get over 30,000 results, even though there are only a couple of thousand pages. Each page is indicated with index, follow tags (or noindex, nofollow in many cases) to show which pages should be indexed and which should not be indexed, yet, it just keeps growing and growing. What can I do?

Thanks in advance

> Nicolaas

Do you have robots.txt file at the root folder of your site..

should the index and follow instructions not be sufficient. How about files that do not exist anymore?

You must have and robots.txt file...
Regarding the pages that no longer exists google will remove them from the index but it will take time....

How often do you add pages on your site?

Hi Gurus
Google is making my site get bigger and bigger.
> Nicolaas

That means Google has successfully indexed your pages. Is this a big concern to you? Unless you find many such results are irrelevant and should not appear in the "site:www.yoursite.com" search, you can use this remove url link in Google:

http://services.google.com:8882/urlconsole/controller

or

You can submit your sitemap containing only the relevant pages to

http://www.google.com/webmasters/sitemaps/

Btw, I am not a guru. :)

How often do you add pages on your site?


often ...


http://services.google.com:8882/urlconsole/controller



I am scared to use that, because it appears it will take off your entire site for six months.... Is this true, or just that one page.


http://www.google.com/webmasters/sitemaps/


Used it - does not make any difference.