View Full Version : Subdomains getting indexed and creating duplicate content
benners
06-11-2008, 04:52 PM
I have affiliates promoting white label versions of a site via a subdomain. I've noticed that the subdomains are getting indexed and some are ranking higher than the main domain. I'm concerned this is duplicate content and damaging rankings of the main domain. I didn't think this would happen as all affiliates use affiliate tracking URLs to a separate domain. Anyway, it has. Any ideas on how best to clean this up would be much appreciated. I'm thinking via robots.txt or webmaster admin. Many thanks. Search Google for inurl:perfectdatingprofile
If there are identical versions (duplicates) of multiple independently interlinked pages (a website) at another domain/subdomain indexed by search engines their could be an issue.
Sticky situation perhaps but for testing you might ask your affiliate to block duplicate pages via robots.txt for a week or two while monitoring the impact on your site. Be sure they block the subdomain in question and not the root domain.
Hard to say without specifics but, maybe someone else has some ideas?
Either way, welcome to SEW!
jimbeetle
06-11-2008, 07:14 PM
beu, I read it as the subs being hooked off benners' domain, so benners will have to include a robots.txt in each subs' DocumentRoot.
Alternatively, Benners, depending on how you generate the subs' pages, you can include a meta noindex, follow in the head. (If so, don't use the robots.txt.)
beu, I read it as the subs being hooked off benners' domain
Ahhhh, good call!
benners
06-12-2008, 03:42 PM
Don't think I can do a robots.txt for each subdomain as they all point to the same file and folder just the CSS changes. A dynamically create META may do the trick. Thanks for your help.
jimbeetle
06-12-2008, 04:34 PM
The meta is probably the best bet anyway. Good luck.