| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 66738 | 7.34 GB | 31 Mar 2017 - 23:50 |
| Unknown robot (identified by 'bot*') | 13977 | 173.37 GB | 31 Mar 2017 - 23:53 |
| Googlebot | 13506 | 28.72 GB | 31 Mar 2017 - 23:31 |
| BaiDuSpider | 12365 | 89.99 GB | 31 Mar 2017 - 23:58 |
| Yandex bot | 11519 | 112.09 GB | 31 Mar 2017 - 23:53 |
| Yahoo Slurp | 9564 | 207.71 GB | 31 Mar 2017 - 23:39 |
| Unknown robot (identified by 'crawl') | 8642 | 187.38 GB | 31 Mar 2017 - 22:58 |
| Unknown robot (identified by empty user agent string) | 6416 | 42.27 GB | 31 Mar 2017 - 23:36 |
| Unknown robot (identified by 'robot') | 1443 | 25.04 GB | 31 Mar 2017 - 23:24 |
| Sogou Spider | 630 | 271.12 MB | 31 Mar 2017 - 22:22 |
| Nutch | 549 | 30.35 GB | 30 Mar 2017 - 15:14 |
| MJ12bot | 427 | 2.30 GB | 31 Mar 2017 - 15:10 |
| Java (Often spam bot) | 402 | 38.17 GB | 31 Mar 2017 - 23:39 |
| SeznamBot | 242 | 8.23 GB | 31 Mar 2017 - 23:13 |
| Exabot | 211 | 982.49 MB | 31 Mar 2017 - 17:15 |
| yacy | 188 | 2.59 GB | 31 Mar 2017 - 10:34 |
| Unknown robot (identified by 'spider') | 169 | 30.68 GB | 31 Mar 2017 - 23:56 |
| Web Core / Roots | 145 | 126.16 GB | 28 Mar 2017 - 02:40 |
| MSNBot-media | 125 | 951.85 KB | 31 Mar 2017 - 21:05 |
| Mail.ru bot | 110 | 462.30 MB | 30 Mar 2017 - 21:54 |
| Phantom | 60 | 171.61 KB | 27 Mar 2017 - 22:31 |
| MagpieRSS | 56 | 10.02 GB | 31 Mar 2017 - 23:12 |
| Alexa (IA Archiver) | 48 | 38.52 MB | 23 Mar 2017 - 16:49 |
| Emacs-w3 Search Engine | 39 | 633.35 MB | 21 Mar 2017 - 23:41 |
| WordPress | 31 | 1.61 GB | 31 Mar 2017 - 15:23 |
| CFNetwork | 17 | 1.61 GB | 30 Mar 2017 - 11:46 |
| Heritrix | 17 | 115.78 KB | 05 Mar 2017 - 09:45 |
| arks | 12 | 2.52 GB | 22 Mar 2017 - 18:58 |
| archive.org bot | 11 | 3.27 GB | 17 Mar 2017 - 17:51 |
| MojeekBot | 10 | 19.48 MB | 25 Mar 2017 - 16:59 |
| Unknown robot (identified by '*bot') | 9 | 29.23 KB | 31 Mar 2017 - 08:10 |
| psbot | 8 | 2.25 MB | 21 Mar 2017 - 05:22 |
| UniversalFeedParser | 5 | 22.53 KB | 26 Mar 2017 - 06:57 |
| Jakarta commons-httpclient | 4 | 1.01 GB | 09 Mar 2017 - 08:14 |
| Netcraft | 3 | 10.28 KB | 09 Mar 2017 - 12:18 |
| Monster | 2 | 14.83 MB | 08 Mar 2017 - 01:36 |
| lwp-request | 2 | 0 | 26 Mar 2017 - 22:41 |
| Google AdSense | 1 | 6.00 KB | 22 Mar 2017 - 23:17 |
| W3C Link Checker | 1 | 0 | 17 Mar 2017 - 20:40 |
| GigaBot | 1 | 3.43 KB | 08 Mar 2017 - 11:30 |
| MSIECrawler | 1 | 215.08 MB | 14 Mar 2017 - 03:15 |