Lillith
02-11-2005, 05:12 AM
Hello everyone,
I have a site with internal tracking links that contains special characters like "&" on the URL. I'd like to know what happens when a robot encounters this:
-do robots look for content in that URL up to the "&"?
-if there's no content on the URL with the string after the "&" cut out, does the robot keep crawling the site, until it finds another link to follow or does it go away to another site?
Thanks!
Noemi
I have a site with internal tracking links that contains special characters like "&" on the URL. I'd like to know what happens when a robot encounters this:
-do robots look for content in that URL up to the "&"?
-if there's no content on the URL with the string after the "&" cut out, does the robot keep crawling the site, until it finds another link to follow or does it go away to another site?
Thanks!
Noemi