PDA

View Full Version : How to download Yahoo dir content


Weglobenet
09-03-2007, 07:50 AM
Help, Please.

How to download Yahoo all dir content the same easy way
as DMOZ can be downloaded.
(see: www.dmoz.org/robots.txt)

Thanx

Dann404
09-03-2007, 04:39 PM
They don't offer it. Yahoo! owns the copyrights and to protect the investments of the paying customers($299.00 to $399.00 per year) who list their sites there.
They don't allow the contents to be scraped as easily as ODP (Free). That doesn't mean you can't scrape it, you just can't do it legally.
There a hundreds of thousands of crappy DMOZ wanna be directories out there many people don't want to be listed in DMOZ just because of that fact.

Weglobenet
09-24-2007, 11:45 AM
That point is very strange. They charge $300 to evaluate and list the site ($600 adult sites) and after that forbid for web users look at their listings!? I even can't dream somebody will ask me to evalute adult site for $600!!! It is one of great absurds produced by WEB. DMOZ nor should be scrapped, it proposes FREE download of their listing in xml format
see http://dmoz.org/robots.txt.
If one pays for site for listing one want pubslish the fact widely.
I've asked does somebody provides that scrapping service?