Jordan23
12-30-2004, 03:54 PM
I have one primary web site, and several international versions of the same site with some translated and local content (but 90% is the same content as the primary site). I have updated the robots.txt files on all of the international sites to prevent Google from indexing them going forward (User-agent: Googlebot Disallow: /). Basically, right now I only want search results for the primary domain to appear in Google, and not have Google show any search results from the international sites. After making this change to the robots.txt for the international sites, I am seeing a significant drop in referrals from Google to these sites (which is good), but the sites are still appearing in Google's index. The strange thing is that now the search results that point to the International sites only show the page URL, instead of the page title and Google's summary. Is there a better way to remove an entire site from Google's index? Thanks.