View Full Version : "LmCrawler" What type of crawler is this?
raaj81
07-20-2005, 02:53 AM
LmCrawler type of crawler is crawling my website from last day and reading every simple link of my web site IP is this crawler is 82.208.40.178. Could any body tell me what type of this crawler and from which search engine it is realated.. Or it is something danger for my website?
Please informa me about LmCrawler.
Thank You
littleman
07-20-2005, 03:10 AM
82.208.40.178 = ourlinks.org
There is a login on the page that reads:
"KADERA LINKS MANAGER"
Looks like it is being hosted in the Czech Republic.
Looks like a harvesting and spamming bot.
lists.debian.org/debian-www/2005/04/msg00071.html
lists.debian.org/debian-project/2005/05/msg00071.html
My question is, why make it so easy to find?
raaj81
07-20-2005, 05:28 AM
If it is looks like Spamming then what could be effects for my website in SE?
Tell me about something about SEO spamming what kind of harmfull effects will be for my site.
It could be looking for email addresses.
You could always try a disallow in the robots.txt, although I'd be surprised if this crawler obeyed.
The other option would be to use mod_rewrite and htaccess to disallow access to that crawler.
Or do a search for "spider trap" on google and set up a simple spider trap. I've had success with these in the past when you get bad bots crawling :)