Önemli Arama Motoru Robotları

Google Search Googlebot/2.1 ( [url=http://www.google.com/bot.html]How Google crawls my site[/media])
Google Search Googlebot/2.1 ( [url=http://www.googlebot.com/bot.html]How Google crawls my site[/media])
Google Image Search Googlebot-Image/1.0
Google Image Search Googlebot-Image/1.0 ( [url=http://www.googlebot.com/bot.html]How Google crawls my site[/media])
MSN Search msnbot/x.xx ( [url=http://search.msn.com/msnbot.htm]Windows Live Help[/media])
MSN Search MSNBOT/0.xx ([url=http://search.msn.com/msnbot.htm]Windows Live Help[/media])
MSN Media Search Robot msnbot-media/1.0 (+[url=http://search.msn.com/msnbot.htm]Windows Live Help[/media])
Windows Live Product Search msnbot-Products/1.0 (+[url=http://search.msn.com/msnbot.htm]Windows Live Help[/media])
Microsoft Search for Mobiles MSNBOT_Mobile MSMOBOT Mozilla/2.0 (compatible; MSIE 4.02; Windows CE; Default)
Alexa / The Internet Archive ia_archiver
Alexa / The Internet Archive ia_archiver-web.archive.org
Alexa / The Internet Archive ia_archiver/1.6
Yahoo Blog Search Yahoo-Blogs/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; http://help.yahoo.com/help/us/ysearch/crawling/
crawling-02.html )
Yahoo Multimedia Search Yahoo-MMAudVid/1.0 (mms dash mmaudvidcrawler dash support at yahoo dash inc dot com)
Yahoo Product Search YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; [url=http://help.yahoo.com/help/us/shop/merchant/]Shopping[/media])
Yahoo Product Search YahooSeeker/1.0 (compatible; Mozilla 4.0; MSIE 5.5; http://search.yahoo.com/yahooseeker.html
Yahoo Product Search YahooSeeker/1.1 (compatible; Mozilla 4.0; MSIE 5.5; [url=http://help.yahoo.com/help/us/shop/merchant/]Shopping[/media])
Ask/Teoma Search Mozilla/2.0 (compatible; Ask Jeeves)
Ask/Teoma Search Mozilla/2.0 (compatible; Ask Jeeves/Teoma)
Ask/Teoma Search Mozilla/2.0 (compatible; Ask Jeeves/Teoma; [url=http://about.ask.com/en/docs/about/webmasters.shtml]About Ask.com: Webmasters[/media])


Devamı Gelecek...