Dynamic Dilemma

[lsredford]

I own an ebook store site written in Perl and MySQL that carries about 35,000 titles. Each title comes in three different formats (adobe, Palm, MS Reader) so essentially I have a database of 105,000 items. My host offers a "google optimization" service, which I use, that builds a static catalog. Initially, when I only had 4,000 titles it worked, but since I expanded about two months ago these static files don't appear in any search. Nothing.

Is 105,000 items just too big to put into a static folder or was it just luck in the beginning? Could an SEO guru (you guys) look at my configuration and spot what the issue is via a consulting arrangement or should I be exploring this dynamic caching I hear about? I'm not looking for free advice, I just need a direction.

Thanks

Scott

[telNform]

well, we will need the information (web site URL), etc ... to take a look

[lsredford]

woops. sorry, here you go: www.diesel-ebooks.com

[Mikkel deMib Svendsen]

Are the static pages you get build part of the regular navigation? In other words, do you lead users (and spiders) to the pages? If not, there is your problem! :)

[lsredford]

Yes, one could call "call up" every page that is in that static folder (http://www.diesel-ebooks.com/static) via navigating through categories or using search, but do I have any links on my site to the static folder? no.

Scott

[Mikkel deMib Svendsen]

OK, that is not going to work for you (as you have experienced) Search engine spiders are basically just trying to navigate your site like a simple user and if you "hide" pages like that they just won't pick them up - and if they do they probably won't rank. Google have some indexed but far from all and they don't seem to rank very well

You need a different strategy for this site to work. I would start out by finding out if you can uptimize the priginal pages. That is usually possible and produce far the best long term results for a site like that.

It is basically a question of:

A) Removing indexing barrier
B) Optimizing templates

Off course there are a bit more to it, but you'll be amazed how far you can get pretty easy :)

[lsredford]

Thank you for your feedback. If I understand correctly, I'll first need to identify the indexing barrier to the static folder and then remove it. A better long term solution is to re-configure my templates so the original pages are optimized (repetition of keywords, etc...) This is somewhat confusing because I thought the initial reason for making the static folder was to simplify the spiders task. It wouldn't have to traverse through the site to find each page. Everything in one spot.

Scott

[Mikkel deMib Svendsen]

No, what I mean is you should remove indexing bariers to your original pages. It dosn't work the way you think (or was told). Search engines are not looking for everything to be in "one spot" - they have no problem traversing most sites. Even dynamic ones. But, you have to remove indexing barriers first.

You need to get your engineers/devlopers involved and have someone help you and them identify all the indexing barriers your system creates today - and then remove them.

[lsredford]

Thank you.

Scott