Maxium number of pages?

[ad1das]

I want to post my companies inventory (actually relevant information) on our site and I want to make a page for each part. However that is 1.5 million pages, about 50Gb. :eek:

I figure if I do this google will not index my whole site, but a competitor has around 30,000 pages and they come up #1 everytime. So is there a number of pages or file size that google wont like?

[shor]

There is no maximum number of pages per site. A good place to start learning about indexing is at http://www.google.com/intl/en/webmasters/. For example's sake, we have sites that number 3+ million pages indexed and there are many other sites out there that have even more pages indexed. A dynamic site can have an almost infinite number of possible pages and as long as Googlebot can follow links (or you submit the URLs), they will be crawled, if not indexed.

[sootledir]

Disallow that section in robots.txt. You are doing the world no favors unleashing 1.5 million catalogue pages into Google.

As to a penalty, I think you have a better chance of flying to the Moon in a helium balloon than you do of getting these pages safely indexed without your site being penalized.

[ad1das]

Hey thanks for the input guys. I'm an admin and I know very little about web design...but I'm learning. I don't want to spam the search engines but check this out. http://www.google.com/search?hl=en&q=CY7C123-7VC&btnG=Google+Search

You'll see that quite a few companies in our industry are indexing millions of parts like these guys http://www.usbid.com/catalog7/page.cfm/12343

My pages have more content and actual information on these parts. I realize this is really more for the search engines than for people to look at. However I don't have 4 or 5 keywords I have millions and it looks to me like posting part numbers as text instead of in a searchable database is the only way for me to compete with everyone else.

[Rob]

I have found that getting those product pages indexed is a good thing.

Think of it from the users perspective. If I a customer shopping for a part (say an auto part) I will start with the most specific query I can - namely the part name and model number if I know it. I don't want to see other parts - just that one - so I know that I have indeed identified the right part. I also want to see how much it is.

By having the specific product page indexed your customers will be able to find exactly what they want in a quick and efficient manner.

[PhilC]

I completely disagree with sootledir. You will be doing the world a great favour by "unleashing" those pages into the Google index - or the part of the world that wants to find those parts.

Also, there is no penalty problem waiting for you just because you have a lot of pages in your site, but make sure that each page is unique - about a different part. Getting them index reasonably quickly will probably need Google's Sitemaps system (https://www.google.com/webmasters/sitemaps/docs/en/about.html).

[ohcho]

Rather than one part one page, organizing them into smaller number of pages may be a better approach. I sometimes look for electronic parts. I found those information is quite useful!

[sootledir]

You better have some serious PageRank to expect Google to index 1.5 million pages in a sub-directory. Does anyone have an example of a website with a sub-directory with 1.5 million pages indexed?

[PhilC]

Not getting them all indexed isn't a penalty, though. Has anyone ever tried to get that number indexed without a decent PR, and by using the Sitemaps system? That might be a better question.