highbids
11-13-2008, 01:17 PM
I have a directory I use with some php redirect scripts for cloaking my affiliate urls
I don't want indexed by the search engines.
I put a robots.txt file in the recomends directory
I dont want the bots to index like this.
User-agent: *
Disallow: /recommends/
Is that the place to put the robots.txt file & would a .htaccess.txt be better & where should
ether one be placed at in the root or the directory I don't want index.
I don't want indexed by the search engines.
I put a robots.txt file in the recomends directory
I dont want the bots to index like this.
User-agent: *
Disallow: /recommends/
Is that the place to put the robots.txt file & would a .htaccess.txt be better & where should
ether one be placed at in the root or the directory I don't want index.