View Full Version : Know anything about the "Yeti" bot/spider?
I'm looking for information on a bot/spider that identifies itself only as [Yeti] in the web logs (apache access_log). It seems to be hitting a site I support all day every day. It has malformed URLs, often appending the URL to itself multiple times or using | characters instead of /.
I suspect this might be adversely affecting the site. Does anyone have any information on this bot? Has anyone encountered it before?
Marcia
08-14-2006, 12:46 AM
It seems to be hitting a site I support all day every day. It has malformed URLs, often appending the URL to itself multiple times or using | characters instead of /.It's a nuisance and has no value - ban it altogether. Is it coming off the same IP?
BTW, I believe that Yeti was supposedly the name of the abominable snowman.
It's a nuisance and has no value - ban it altogether. Is it coming off the same IP?
BTW, I believe that Yeti was supposedly the name of the abominable snowman.
Thanks for your reply Marcia! So have you encountered this bot before as well?
It is coming off different IPs, but they all seem to be originating from Korea as far as I can tell. However, it's a little complicated because we have the site cached by Akamai as well - so we always have to look up their IP addresses to make sure we are really getting the bot's originating IP address.
Yes you're right - the Adominable Snowman... maybe that's why they call it Yeti, leaves a big footprint! ;)
Marcia
08-14-2006, 02:02 AM
xor, I haven't encountered it but bots with good manners don't behave like that when they visit, and they leave a respectable, identifiable calling card.
Incidentally, you might want to do a inurl: search to see if anyone has scraped pages and put them out there.
Welcome to the forums, BTW. :)