Googlebot
Yahoo Slurp
Google AdSense
Alexa (IA Archiver)
MSNBot
WebCollage
Holmes Voila
GigaBot
Unknown robot (identified by hit on 'robots.txt')
Microsoft URL Control
MJ12bot
Grub.org
PHP version tracker
The web archive (IA Archiver)
Speedy Spider The World Wide Web Worm
ichiro
Unknown robot (identified by 'bot/' or 'bot-')
HTTrack off-line browser
BaiDuSpider
Ingrid
boitho.com-dc
SurveyBot
Exabot
MSNBot-media
Yahoo! Slurp China
Netcraft Unknown robot (identified by 'spider')
WordPress
MSIECrawler
Ask
StackRambler
larbin
Girafabot
Java (Often spam bot)
psbot
UP.Browser
Python-urllib
Jakarta commons-httpclient