| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 2231715 | 6271.09 GB | 30 Nov 2016 - 23:50 |
| Googlebot | 27478 | 66.79 GB | 30 Nov 2016 - 23:43 |
| Unknown robot (identified by 'bot*') | 20311 | 322.57 GB | 30 Nov 2016 - 23:57 |
| Yahoo Slurp | 11463 | 231.88 GB | 30 Nov 2016 - 22:50 |
| Unknown robot (identified by 'crawl') | 9365 | 216.47 GB | 30 Nov 2016 - 23:26 |
| Yandex bot | 7481 | 360.38 GB | 30 Nov 2016 - 23:42 |
| Unknown robot (identified by empty user agent string) | 4790 | 46.68 GB | 30 Nov 2016 - 23:04 |
| BaiDuSpider | 3830 | 85.53 GB | 30 Nov 2016 - 23:44 |
| Unknown robot (identified by 'robot') | 1759 | 23.76 GB | 30 Nov 2016 - 22:57 |
| Sogou Spider | 495 | 427.74 MB | 30 Nov 2016 - 23:12 |
| Mail.ru bot | 483 | 1.03 GB | 26 Nov 2016 - 01:52 |
| MJ12bot | 435 | 30.06 GB | 30 Nov 2016 - 20:38 |
| Web Core / Roots | 384 | 26.44 GB | 29 Nov 2016 - 00:24 |
| Java (Often spam bot) | 300 | 26.83 GB | 30 Nov 2016 - 07:22 |
| Steeler | 158 | 1.04 MB | 30 Nov 2016 - 18:02 |
| Exabot | 158 | 601.51 KB | 25 Nov 2016 - 11:58 |
| Unknown robot (identified by 'spider') | 152 | 18.66 GB | 30 Nov 2016 - 16:49 |
| SeznamBot | 135 | 7.62 GB | 30 Nov 2016 - 18:28 |
| Alexa (IA Archiver) | 105 | 290.94 MB | 27 Nov 2016 - 05:40 |
| archive.org bot | 92 | 17.90 MB | 22 Nov 2016 - 13:05 |
| MagpieRSS | 57 | 10.83 GB | 30 Nov 2016 - 15:09 |
| MojeekBot | 50 | 38.18 MB | 25 Nov 2016 - 15:54 |
| yacy | 45 | 2.56 GB | 28 Nov 2016 - 08:44 |
| WordPress | 14 | 328.23 MB | 24 Nov 2016 - 00:05 |
| psbot | 12 | 2.42 MB | 28 Nov 2016 - 05:56 |
| Google AdSense | 12 | 64.87 KB | 30 Nov 2016 - 08:31 |
| CFNetwork | 8 | 4.03 GB | 28 Nov 2016 - 21:36 |
| HTTrack off-line browser | 8 | 35.73 MB | 08 Nov 2016 - 03:02 |
| Jakarta commons-httpclient | 6 | 54.72 KB | 29 Nov 2016 - 13:43 |
| Nutch | 6 | 3.91 GB | 29 Nov 2016 - 04:29 |
| Powermarks | 5 | 716.49 KB | 03 Nov 2016 - 20:00 |
| Turn It In | 5 | 34.93 MB | 27 Nov 2016 - 01:32 |
| mnoGoSearch search engine software | 5 | 4.26 MB | 10 Nov 2016 - 19:03 |
| Vagabondo | 2 | 8.21 KB | 18 Nov 2016 - 01:30 |
| Spiderman | 1 | 3.43 KB | 02 Nov 2016 - 22:32 |
| Netcraft | 1 | 3.43 KB | 17 Nov 2016 - 21:45 |