Site Maps

[Daz Tarmey]

After running my site through Search Engine Spider Simulator at seems that many of our pages are not getting seen :p

How can i improve this, i know i can put a site map, but this is usually used for costumers, if i made one with all the pages of the site on in a list would this improve the visibility to spider, or would they just spider the top few.

I thought of making a page in frames, and placing all the domains in the bottom frame, them making the box small and then disabling scrolling, this way the customer would see the page.

Them writting a code to instruct the spider to follow into the next frame, would this achieve the desired affect:

Daz :confused:

[simons1321]

I think you had it with the site map.

First of all, spiders dont like frames at all.

Second, Search engines use links from your current pages to find new pages. If you include a site map to your site, this allows the spider to find all the pages in your site through the links you provide on the sitemap. In my opinion, site maps are more for search engines than customers these days, so it's a good idea to have one no matter what.

In addition to your .html sitemap, you can also create a Google site map (https://www.google.com/webmasters/sitemaps/login) which is an xml or .txt file that you submit to Google. This allows the spider to find your pages and also allows you access to some valuable Google stats, such as page errors and top queries.

Theres a lot of tools on the internet that can help you create this. GSiteCrawler (http://johannesmueller.com/gs/) is a good one.