View Full Version : Invisible Web
How many pages are on the "Invisible Web" - those that are not indexed by Google?
PhilC
06-06-2006, 10:11 PM
2731
:)
Mikkel deMib Svendsen
06-06-2006, 11:04 PM
The invisible web usually referes to the dyanmic part of the web that is, for a large part, inaccesible by spiders. Most of that content, however, don't really have a set number of pages - there are as many pages as you want there to be.
Let me give you a simple example: Google. How many pages do Google have? Well, you could count all the "normal" text pages they have but they have so much more content than that - the search result pages! Search result pages are part of that "Invisible Web" - pages only exsist if someone search for them. So how many search result pages do Google have? As many as you like - as many searches as you can think of - and then some. It's an infinite number. And this goes for a lot of sites.
So, it dosn't really make much sense to talk about how many pages there are on the web, but rather how much data is out there - and the sort of data.
PhilC-
Thank you for the reply. What am I looking for is the number of documents on the web that are not indexed by the search engines. About four years ago, it was estimated that the best search engines, Google and the like, only indexed about 5 billion of approximately 550 billion pages on the web. (I understand now Google claims to index about 8 billion). I am looking for updated information about how many pages search engines do not index. With the explosion of blogs, password protected databases, and real time news, I would imagine the number would be much higher than 550 billion pages.
aquiss
06-07-2006, 07:54 PM
PhilC-
I would imagine the number would be much higher than 550 billion pages.
It will be changing by the second surely ?
scrubs
06-08-2006, 01:04 PM
Its a kinda 'How long is a piece of string' question? :) Interesting thread starter though Robo, I honestly wouldn't know where to start guessing!
Mikkel deMib Svendsen
06-08-2006, 01:16 PM
I honestly wouldn't know where to start guessing!
You don't have to - because, just like your "how long is a string ..." question, the answer is anything you like - as long as you like, as many pages as you like. Thats the beauty of the "dynamic web" - or "invisible" if you'd like to call it that :)