64 different robots | Hits | Bandwidth | Last visit |
Googlebot | 111265 | 3.55 GB | 31 Aug 2013 - 22:14 |
Unknown robot (identified by 'bot*') | 82283 | 2.45 GB | 31 Aug 2013 - 22:13 |
Unknown robot (identified by 'robot') | 79615 | 501.21 MB | 31 Aug 2013 - 21:23 |
MJ12bot | 53572 | 213.30 MB | 31 Aug 2013 - 21:57 |
lwp-request | 49166 | 0 | 31 Aug 2013 - 22:14 |
BaiDuSpider | 42495 | 430.76 MB | 31 Aug 2013 - 22:14 |
Python-urllib | 35608 | 563.82 MB | 31 Aug 2013 - 22:01 |
Unknown robot (identified by empty user agent string) | 34531 | 210.62 MB | 31 Aug 2013 - 22:13 |
Yandex bot | 23229 | 367.27 MB | 31 Aug 2013 - 22:13 |
Unknown robot (identified by 'crawl') | 17396 | 111.37 MB | 31 Aug 2013 - 22:05 |
Unknown robot (identified by '*bot') | 16583 | 169.41 MB | 31 Aug 2013 - 21:44 |
Feedfetcher-Google | 9144 | 70.27 MB | 31 Aug 2013 - 22:01 |
Yahoo Slurp | 8560 | 109.67 MB | 31 Aug 2013 - 21:40 |
MSNBot | 3679 | 47.28 MB | 31 Aug 2013 - 14:11 |
Unknown robot (identified by 'spider') | 2936 | 13.42 MB | 31 Aug 2013 - 22:14 |
WebFilter | 2864 | 55.39 MB | 31 Aug 2013 - 21:51 |
MSNBot-media | 2819 | 47.99 MB | 31 Aug 2013 - 22:14 |
WordPress | 2041 | 235.72 KB | 31 Aug 2013 - 22:00 |
Jakarta commons-httpclient | 2023 | 5.19 MB | 31 Aug 2013 - 21:42 |
BSpider | 1555 | 94.80 MB | 31 Aug 2013 - 21:40 |
Java (Often spam bot) | 1310 | 29.40 MB | 31 Aug 2013 - 18:06 |
Motor | 1238 | 6.64 MB | 31 Aug 2013 - 21:41 |
Mail.ru bot | 890 | 55.37 MB | 31 Aug 2013 - 19:29 |
Turn It In | 822 | 5.70 MB | 30 Aug 2013 - 08:42 |
Exabot | 800 | 5.13 MB | 31 Aug 2013 - 21:11 |
Nutch | 733 | 5.78 MB | 31 Aug 2013 - 21:10 |
Sogou Spider | 555 | 3.18 MB | 31 Aug 2013 - 08:49 |
Alexa (IA Archiver) | 347 | 7.66 MB | 30 Aug 2013 - 21:08 |
DoCoMo | 337 | 3.23 MB | 31 Aug 2013 - 20:53 |
LinkChecker | 299 | 1.21 MB | 24 Aug 2013 - 14:50 |
VORTEX | 271 | 5.23 MB | 26 Aug 2013 - 17:36 |
ichiro | 265 | 7.02 MB | 21 Aug 2013 - 09:26 |
SeznamBot | 214 | 3.46 MB | 31 Aug 2013 - 13:19 |
Phantom | 175 | 2.72 MB | 31 Aug 2013 - 08:37 |
Steeler | 168 | 381.17 KB | 19 Aug 2013 - 05:32 |
MagpieRSS | 152 | 169.07 KB | 31 Aug 2013 - 21:18 |
Netcraft | 144 | 720.81 KB | 19 Aug 2013 - 23:32 |
Findlinks | 116 | 1.38 MB | 31 Aug 2013 - 22:00 |
psbot | 94 | 889.40 KB | 19 Aug 2013 - 07:28 |
CFNetwork | 88 | 21.26 MB | 31 Aug 2013 - 05:07 |
VSE | 63 | 335.43 KB | 26 Aug 2013 - 09:44 |
Voila | 56 | 349.99 KB | 31 Aug 2013 - 04:12 |
Custo | 41 | 1.50 MB | 27 Aug 2013 - 18:07 |
Heritrix | 31 | 532.35 KB | 12 Aug 2013 - 14:50 |
Feedburner | 31 | 61.85 KB | 31 Aug 2013 - 14:15 |
HTMLParser | 30 | 170.24 KB | 10 Aug 2013 - 21:37 |
LinkScan | 22 | 0 | 31 Aug 2013 - 15:01 |
Google AdSense | 19 | 323.63 KB | 28 Aug 2013 - 18:47 |
legs | 18 | 49.03 KB | 25 Aug 2013 - 18:15 |
Powermarks | 17 | 0 | 27 Aug 2013 - 07:55 |
SurveyBot | 16 | 71.20 KB | 30 Aug 2013 - 23:13 |
W3C Validator | 12 | 691.26 KB | 23 Aug 2013 - 23:40 |
archive.org bot | 12 | 5.98 KB | 31 Aug 2013 - 21:35 |
MSIECrawler | 10 | 0 | 31 Aug 2013 - 13:30 |
FeedValidator | 9 | 98.00 KB | 26 Aug 2013 - 15:28 |
yacy | 8 | 18.61 KB | 26 Aug 2013 - 16:42 |
WebCollage | 7 | 955.02 KB | 29 Aug 2013 - 05:47 |
Fish search | 3 | 66.27 KB | 28 Aug 2013 - 20:56 |
LinkBot | 2 | 13.89 KB | 26 Aug 2013 - 11:36 |
Web Core / Roots | 2 | 23.77 KB | 28 Aug 2013 - 17:48 |
ExactSeek Crawler | 2 | 7.13 KB | 08 Aug 2013 - 08:17 |
Raven Search | 1 | 0 | 01 Aug 2013 - 05:04 |
WallPaper (alias crawlpaper) | 1 | 104.55 KB | 19 Aug 2013 - 04:33 |
ping.blo.gs | 1 | 76.15 KB | 15 Aug 2013 - 08:48 |