PDA

View Full Version : Robots crawling URLs with "&"


Lillith
02-11-2005, 05:12 AM
Hello everyone,

I have a site with internal tracking links that contains special characters like "&" on the URL. I'd like to know what happens when a robot encounters this:

-do robots look for content in that URL up to the "&"?
-if there's no content on the URL with the string after the "&" cut out, does the robot keep crawling the site, until it finds another link to follow or does it go away to another site?

Thanks!

Noemi

Mikkel deMib Svendsen
02-11-2005, 07:20 AM
The sign & is in itself not a problem and search engine spider do read it. However, if your URLs end up being too long all in all or you use too many parameters then search engines may avoid those URLs alltogether.

I usally advise clients to move such tracking to a cookie based tracking as this will remove these issues completeley

Lillith
02-11-2005, 08:42 AM
Re. "if your URLs end up being too long all in all or you use too many parameters then search engines may avoid those URLs alltogether"

You mena that when they encoutner such URL, they leave the page?

Thanks!

Lillith