Hi, I'm in the process of evaluating the Nutch crawler - has anybody taken a close look at Nutch - I am trying to get some detailed information on how Nutch works - how to input parameters etc., does anybody have any documentation sources for Nutch - all I could find was the tutorial which is not very detailed - I'm willing to share my experiences and findings with anyone who is interested, thanks.

Although its one of the best available, but I did'nt find Nutch too good.

If you're into Java/JSP, Heritrix (http://crawler.archive.org/) is your best bet!