| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 174551 | 477.01 GB | 28 Feb 2017 - 23:50 |
| Googlebot | 58111 | 360.67 GB | 28 Feb 2017 - 23:59 |
| Unknown robot (identified by empty user agent string) | 17386 | 133.76 GB | 28 Feb 2017 - 23:29 |
| Yandex bot | 11419 | 181.65 GB | 28 Feb 2017 - 20:54 |
| Yahoo Slurp | 10311 | 202.29 GB | 28 Feb 2017 - 23:59 |
| BaiDuSpider | 10154 | 72.31 GB | 28 Feb 2017 - 23:59 |
| Unknown robot (identified by 'bot*') | 7563 | 78.51 GB | 28 Feb 2017 - 23:53 |
| Unknown robot (identified by 'crawl') | 5874 | 181.21 GB | 28 Feb 2017 - 07:20 |
| Unknown robot (identified by 'robot') | 1148 | 7.71 GB | 28 Feb 2017 - 23:49 |
| Sogou Spider | 537 | 1.32 GB | 28 Feb 2017 - 20:34 |
| MJ12bot | 242 | 3.05 GB | 28 Feb 2017 - 07:20 |
| Java (Often spam bot) | 217 | 57.29 GB | 28 Feb 2017 - 18:06 |
| SeznamBot | 210 | 59.05 MB | 28 Feb 2017 - 23:05 |
| Mail.ru bot | 205 | 667.54 MB | 26 Feb 2017 - 19:52 |
| Unknown robot (identified by 'spider') | 147 | 42.00 GB | 28 Feb 2017 - 21:53 |
| Exabot | 106 | 1.42 GB | 28 Feb 2017 - 22:59 |
| CFNetwork | 62 | 3.50 GB | 28 Feb 2017 - 09:26 |
| Web Core / Roots | 62 | 10.53 GB | 27 Feb 2017 - 09:19 |
| MagpieRSS | 40 | 5.61 GB | 25 Feb 2017 - 16:33 |
| MSNBot-media | 39 | 22.04 MB | 26 Feb 2017 - 17:31 |
| WordPress | 34 | 6.67 GB | 25 Feb 2017 - 23:56 |
| archive.org bot | 33 | 3.03 GB | 20 Feb 2017 - 05:48 |
| HTTrack off-line browser | 23 | 5.21 GB | 19 Feb 2017 - 13:13 |
| Speedy Spider | 20 | 49.99 MB | 01 Feb 2017 - 13:52 |
| yacy | 17 | 839.60 MB | 21 Feb 2017 - 00:43 |
| Nutch | 12 | 403.30 MB | 28 Feb 2017 - 18:50 |
| MojeekBot | 11 | 65.39 KB | 24 Feb 2017 - 21:06 |
| Netcraft | 9 | 27.41 KB | 09 Feb 2017 - 04:53 |
| Alexa (IA Archiver) | 7 | 84.77 KB | 23 Feb 2017 - 15:20 |
| Jakarta commons-httpclient | 4 | 260.00 MB | 16 Feb 2017 - 02:24 |
| UniversalFeedParser | 4 | 15.97 KB | 20 Feb 2017 - 22:37 |
| psbot | 4 | 20.30 KB | 22 Feb 2017 - 20:14 |
| Unknown robot (identified by '*bot') | 2 | 3.04 GB | 24 Feb 2017 - 13:21 |
| Custo | 2 | 486.36 MB | 09 Feb 2017 - 14:32 |
| Sift | 2 | 7.17 KB | 22 Feb 2017 - 11:00 |
| Emacs-w3 Search Engine | 2 | 520.00 MB | 16 Feb 2017 - 00:11 |
| JoBo Java Web Robot | 2 | 2.28 GB | 20 Feb 2017 - 08:28 |
| MSIECrawler | 2 | 10.43 KB | 20 Feb 2017 - 08:28 |
| Turn It In | 1 | 3.30 KB | 03 Feb 2017 - 07:00 |
| LinkBot | 1 | 19.50 KB | 06 Feb 2017 - 05:22 |
| Google AdSense | 1 | 4.11 KB | 23 Feb 2017 - 12:15 |
| Heritrix | 1 | 3.30 KB | 28 Feb 2017 - 10:25 |
| larbin | 1 | 3.30 KB | 12 Feb 2017 - 21:38 |