| 54 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'robot') | 593576 | 2.56 GB | 30 Sep 2015 - 23:59 |
| Unknown robot (identified by 'bot*') | 106573 | 2.91 GB | 30 Sep 2015 - 23:59 |
| Yahoo Slurp | 47789 | 160.46 MB | 30 Sep 2015 - 23:59 |
| Unknown robot (identified by 'crawl') | 34682 | 203.31 MB | 30 Sep 2015 - 01:31 |
| BaiDuSpider | 17918 | 245.49 MB | 30 Sep 2015 - 23:56 |
| Googlebot | 12672 | 74.51 MB | 30 Sep 2015 - 23:58 |
| Yandex bot | 7665 | 58.79 MB | 30 Sep 2015 - 23:48 |
| MJ12bot | 6713 | 88.23 MB | 30 Sep 2015 - 23:09 |
| Nutch | 6036 | 32.98 MB | 28 Sep 2015 - 14:36 |
| CFNetwork | 4295 | 4.44 MB | 30 Sep 2015 - 23:42 |
| Exabot | 3664 | 40.84 MB | 30 Sep 2015 - 23:48 |
| Unknown robot (identified by '*bot') | 2785 | 1.18 MB | 30 Sep 2015 - 23:44 |
| Unknown robot (identified by 'spider') | 1797 | 28.93 MB | 30 Sep 2015 - 22:36 |
| Java (Often spam bot) | 1520 | 27.43 MB | 30 Sep 2015 - 04:02 |
| Feedfetcher-Google | 1252 | 777.16 KB | 30 Sep 2015 - 23:57 |
| Unknown robot (identified by empty user agent string) | 878 | 27.51 MB | 30 Sep 2015 - 23:11 |
| Mail.ru bot | 837 | 7.20 MB | 22 Sep 2015 - 22:37 |
| SeznamBot | 710 | 5.93 MB | 29 Sep 2015 - 04:03 |
| Sogou Spider | 673 | 5.49 MB | 30 Sep 2015 - 16:25 |
| Y!J Yahoo Japan | 630 | 4.25 MB | 25 Sep 2015 - 17:26 |
| archive.org bot | 483 | 13.88 MB | 28 Sep 2015 - 16:57 |
| Alexa (IA Archiver) | 325 | 9.24 MB | 30 Sep 2015 - 19:27 |
| WordPress | 324 | 1.64 MB | 30 Sep 2015 - 10:27 |
| Phantom | 265 | 2.62 MB | 30 Sep 2015 - 07:06 |
| Orbiter | 256 | 1.99 MB | 27 Sep 2015 - 13:05 |
| MagpieRSS | 223 | 988.03 KB | 30 Sep 2015 - 22:55 |
| HTTrack off-line browser | 158 | 2.16 MB | 30 Sep 2015 - 12:41 |
| yacy | 75 | 1.06 MB | 30 Sep 2015 - 01:09 |
| Fish search | 57 | 4.09 MB | 15 Sep 2015 - 00:02 |
| Heritrix | 52 | 2.08 MB | 17 Sep 2015 - 09:01 |
| WebFilter | 52 | 326.66 KB | 28 Sep 2015 - 19:05 |
| MSNBot-media | 47 | 1.53 MB | 29 Sep 2015 - 23:41 |
| SpiderBot | 30 | 169.75 KB | 09 Sep 2015 - 09:55 |
| Sift | 22 | 1.31 MB | 29 Sep 2015 - 13:07 |
| Python-urllib | 21 | 289.80 KB | 28 Sep 2015 - 23:02 |
| ichiro | 21 | 537.50 KB | 23 Sep 2015 - 02:42 |
| Jakarta commons-httpclient | 14 | 2.95 MB | 29 Sep 2015 - 16:24 |
| LinkBot | 12 | 198.56 KB | 24 Sep 2015 - 12:49 |
| MojeekBot | 11 | 60.00 KB | 29 Sep 2015 - 12:59 |
| UniversalFeedParser | 10 | 6.62 KB | 30 Sep 2015 - 20:14 |
| Custo | 8 | 89.44 KB | 25 Sep 2015 - 12:02 |
| StackRambler | 8 | 122.69 KB | 03 Sep 2015 - 19:24 |
| Web Core / Roots | 6 | 54.00 KB | 30 Sep 2015 - 20:44 |
| psbot | 5 | 49.53 KB | 07 Sep 2015 - 21:11 |
| W3C Link Checker | 4 | 0 | 21 Sep 2015 - 21:07 |
| LinkChecker | 2 | 16.58 KB | 26 Sep 2015 - 02:19 |
| W3C Validator | 2 | 25.05 KB | 09 Sep 2015 - 13:56 |
| arks | 2 | 169.93 KB | 12 Sep 2015 - 17:31 |
| Raven Search | 2 | 0 | 27 Sep 2015 - 12:52 |
| MSNBot | 1 | 6.41 KB | 30 Sep 2015 - 19:37 |
| WebCollage | 1 | 133.48 KB | 04 Sep 2015 - 02:20 |
| CsCrawler | 1 | 8.29 KB | 23 Sep 2015 - 08:04 |
| NG 2.x (Exalead) | 1 | 27.78 KB | 15 Sep 2015 - 02:14 |
| Netcraft | 1 | 29.78 KB | 08 Sep 2015 - 15:49 |