New Web Robot NaverBot very bad manners

A new Web Robot/Spider Out There Name NeverBoT, Version 1.0 from NHN Corp. / +82-2-3011-1954 / nhnbot AT naver.com

Have you check your web log in last few days? If yes, then you may notice a new Spider having footprint of "Mozilla/4.0 (compatible; NaverBot/1.0; " with a URL pointed to help.never.com and there is not a single English Word to read.

Never.Com is one of big search engine in Korea. This web spider/bot run by: NHN Corporation. Though they claim that this new Robot Maintain robot.txt file, I am not convinced.

For last few week, I keep an eye on this bot and found it normally ignore robot.txt file.

Summary of NeverBot:

Name: NaverBot
Current Version: 1.0
Current Agent_String: Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp)
Current IP Block where It Live: 202.179.176.0-202.179.183.255
Old Living IP Block Found in Different Site: 220.72.0.0 to 220.87.255.255, 61.78.61.192 61.78.61.193 61.78.61.206 61.78.61.220 61.78.61.221 61.78.61.222
Old Agent_String1: * Mozilla/4.0 (compatible; NaverBot/1.0; nhnbot@naver.com)
Old Agent_String2: * NaverBot-1.0 (NHN Corp. / +82-31-784-1989 / nhnbot@naver.com)

This robot, named NaverBot has many major error on it. No Rate Limit, Multiple Request at a time etc etc. When it find a host with hough bandwidth web server, you can see how first it sent request to web server. In Last 1 week, I found footprint of this bot more then 1000!

Suggestions: As This Web Spider Ignore robot.txt, you may ban it via source address block (202.179.176.0-202.179.183.255) from your Router or web server;)


Anyone Here to Comments?

I Found a BLOG http://www.cerkit.com/cerkitBlog/Naverbot+Bad+Korea+Banned.aspx, where author is really frustrated to found the mass on his log.

Comments Are Welcome..

With Thanks


Ahamed Bauani