Site not indexed however being crawled daily

[have1]

Greetings,

We designed a web site for a client over 8 months ago - the site is being crawled by googlebot on a daily basis - however doesn't appear in their index - not even by searching for the domain name address in Google... any clues on what could be happening or how to resolve this?

thanks

GABE

[glengara]

Sounds like it might be an insufficient links problem, but hard to say without an url, how's it doing in Y!/MSN?

[dakman]

did u try site: ?

or info: ?

also check all the datacenters...

i use yourcache.com

then site:www.domain.com

[have1]

Oops, here is the url www.maplewoodbb.com - the site is doing very well with lots of link backs and yahoo, msn etc.

thanks

gabe

[Marcia]

have1, always keep things clean and simple for bots. Put some plain, ordinary html links on the bottom that link to the site pages and see if it makes a difference. Put it on all the pages.

[farees]

Hi Gabe,
The site needs some work in terms of navigation. For example I tried generating a sitemap (BTW - you should be doing this and submit the sitemap to Google SiteMaps), the only thing it picked up were 6 images. I see that you are running this site from a d/b try Mod-Rewrite (http://forums.searchenginewatch.com/showthread.php?t=3925) for more search engine friendly URL's.

One thing you can implement right away is handcode a sitemap and submit it to google sitemaps and add text links at the footer of each page you have. I certainly hope you used templates to design this site.


- Farees

[dakman]

Yea i agree with marcia and fares...

also check your site on lynx (http://lynx.isc.org/)... google recommends it i do it alot and helps see whether or not google can see the texts/links and crawl ur site

http://www.google.com/intl/en/webmasters/guidelines.html

Use a text browser such as Lynx to examine your site, because most search engine spiders see your site much as Lynx would. If fancy features such as JavaScript, cookies, session IDs, frames, DHTML, or Flash keep you from seeing all of your site in a text browser, then search engine spiders may have trouble crawling your site.

Get more links too... write articles, press releases, yahoo directory, submit to dmoz...

also try submit to google and google sitemap..

There are some good directories out there that at the minimum help you get crawled fast .. but also can pass some Pagerank

http://www.strongestlinks.com/directories.php

[Relevancy]

also get rid of useless stuff in the head section of the code
no need for 2 robots tags
do you really want IE to not cache your page? If you dont care then get rid of <META http-equiv="Pragma" content="no-cache"> too
get rid of the <meta name="keyphrases" too. Keyword tags have little importance but you definatly dont need 2.

Also try Google Sitemaps for better indexing

Add <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"> or similar