| 54 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 1690258 | 4524.95 GB | 31 Dec 2013 - 23:59 |
| Yandex bot | 14206 | 38.98 GB | 31 Dec 2013 - 23:55 |
| Googlebot | 25990 | 57.80 GB | 31 Dec 2013 - 23:52 |
| Unknown robot (identified by 'bot*') | 7907 | 96.78 GB | 31 Dec 2013 - 23:48 |
| BaiDuSpider | 2968 | 8.58 GB | 31 Dec 2013 - 23:47 |
| Unknown robot (identified by 'spider') | 476 | 27.36 GB | 31 Dec 2013 - 23:41 |
| Unknown robot (identified by 'robot') | 3303 | 18.24 GB | 31 Dec 2013 - 23:24 |
| Voila | 53 | 1.57 MB | 31 Dec 2013 - 22:56 |
| Alexa (IA Archiver) | 50 | 6.88 MB | 31 Dec 2013 - 22:07 |
| SeznamBot | 175 | 948.34 MB | 31 Dec 2013 - 21:41 |
| Unknown robot (identified by empty user agent string) | 4445 | 69.27 GB | 31 Dec 2013 - 20:07 |
| MSNBot | 481 | 10.98 MB | 31 Dec 2013 - 18:14 |
| Unknown robot (identified by 'crawl') | 1950 | 7.86 GB | 31 Dec 2013 - 17:19 |
| yacy | 60 | 346.66 MB | 31 Dec 2013 - 13:31 |
| Exabot | 269 | 3.45 GB | 31 Dec 2013 - 10:29 |
| MJ12bot | 225 | 6.37 GB | 31 Dec 2013 - 10:19 |
| Sogou Spider | 204 | 63.65 MB | 31 Dec 2013 - 05:49 |
| archive.org bot | 6 | 1.26 KB | 31 Dec 2013 - 05:28 |
| Mail.ru bot | 80 | 127.92 MB | 31 Dec 2013 - 02:16 |
| CFNetwork | 70 | 19.46 GB | 31 Dec 2013 - 01:35 |
| Vagabondo | 4 | 14.30 KB | 30 Dec 2013 - 22:11 |
| Java (Often spam bot) | 188 | 20.34 GB | 30 Dec 2013 - 19:55 |
| WordPress | 55 | 207.94 MB | 29 Dec 2013 - 10:20 |
| MagpieRSS | 7 | 65.05 MB | 29 Dec 2013 - 10:16 |
| MojeekBot | 5 | 15.79 KB | 29 Dec 2013 - 05:08 |
| Nutch | 13 | 43.10 KB | 28 Dec 2013 - 13:30 |
| Yahoo Slurp | 21 | 2.62 MB | 28 Dec 2013 - 13:29 |
| Netluchs | 72 | 56.92 MB | 28 Dec 2013 - 10:54 |
| psbot | 5 | 86.95 KB | 28 Dec 2013 - 08:30 |
| Google AdSense | 4 | 14.24 KB | 27 Dec 2013 - 17:10 |
| Unknown robot (identified by '*bot') | 40 | 4.04 GB | 27 Dec 2013 - 14:13 |
| Web Core / Roots | 111 | 3.19 GB | 26 Dec 2013 - 06:11 |
| Phantom | 37 | 29.97 MB | 26 Dec 2013 - 02:02 |
| HTTrack off-line browser | 3 | 1.81 MB | 25 Dec 2013 - 23:57 |
| FeedValidator | 4 | 22.52 KB | 25 Dec 2013 - 18:14 |
| W3C Validator | 6 | 89.08 KB | 25 Dec 2013 - 18:14 |
| NG 2.x (Exalead) | 32 | 142.97 KB | 25 Dec 2013 - 11:11 |
| ichiro | 5 | 1003.54 KB | 25 Dec 2013 - 00:33 |
| Emacs-w3 Search Engine | 28 | 1.04 GB | 24 Dec 2013 - 18:06 |
| DoCoMo | 4 | 942.74 KB | 24 Dec 2013 - 01:54 |
| Jakarta commons-httpclient | 3 | 653.00 MB | 23 Dec 2013 - 09:45 |
| MSIECrawler | 1 | 3.21 KB | 19 Dec 2013 - 07:31 |
| Turn It In | 5 | 3.42 MB | 18 Dec 2013 - 03:44 |
| legs | 4 | 12.58 KB | 14 Dec 2013 - 09:50 |
| lwp-request | 4 | 0 | 13 Dec 2013 - 17:36 |
| LinkChecker | 26 | 69.52 KB | 11 Dec 2013 - 08:39 |
| Netcraft | 4 | 9.38 KB | 10 Dec 2013 - 23:32 |
| NG 1.x (Exalead) | 2 | 8.26 KB | 10 Dec 2013 - 21:00 |
| WebFilter | 5 | 16.92 KB | 10 Dec 2013 - 19:15 |
| churl | 76 | 1.67 GB | 10 Dec 2013 - 09:07 |
| VSE | 4 | 228.01 MB | 07 Dec 2013 - 08:33 |
| StackRambler | 9 | 16.73 KB | 06 Dec 2013 - 08:18 |
| larbin | 1 | 3.21 KB | 04 Dec 2013 - 21:20 |
| Y!J Yahoo Japan | 2 | 2.29 KB | 04 Dec 2013 - 10:37 |