PDA

View Full Version : Automated Deep Web Crawling


deepster
12-15-2004, 09:53 PM
I am interested to find out more about efforts and especially results in the area of automated deep web crawling.

First a disclaimer, I run a company, Omni-Explorer Technologies, and we have just soft-launched Yottacars.com, our beta of deep web search for the automotive marketplace.

Our fully automated deep web crawler is currently extracting and classifying about 2,5 million car listings from over 33,000 dealer sites. We believe this is a significant milestone in the area of automated deep web crawling and that it is also relevant to general search.

We would love to hear feedback from search fans, e.g. what would be other significant results and developments in this area? Would you agree that this is a significant milestone? Please feel free to give us your thoughts, comments, suggestions or any kind of feedback, thanks