PDA

View Full Version : URL Depth and Crawling


emerkid
03-17-2006, 08:18 PM
Caution! Newbie question ahead :-)

I'm building a new site. I was wondering if a link that looks like this:

domain.com/productpage.html

would be crawled/indexed sooner than if the link looked like this:

domain.com/category/sub-category/productpage.html

I've read that deep indexing doesn't occur frequently until a site reaches a PR of 6. I'm using mod_rewrite so category and sub-category are not actual directories, just a way to create an organized link structure.

Any thoughts?

-emerkid

JohnW
03-17-2006, 10:09 PM
If you are rewriting everything, the best url is:

www.domain.com/productpage/

emerkid
03-17-2006, 10:35 PM
Thanks for the quick reply JohnW. :)

You confirmed my suspicion that it would be better to have URLs that are only one level deep.

Thanks again,
-emerkid

JohnW
03-18-2006, 11:39 AM
You might also notice that there is no file name, only a directory name.

bdnseo
03-20-2006, 02:51 PM
It's more important how this page is linked to... ie if you link to the page from your homepage it will get indexed faster than if you linked to the page from a tier 2 or tier 3 page of your site.

The way you link your site determines whether you will need a "deep crawl" to index it... not the naming convention of your pages.