| 34 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 45,126 | 267.57 GB | 31 Mar 2018 - 23:51 |
| Yandex Bot | 35,073 | 2071.80 GB | 31 Mar 2018 - 23:58 |
| bot[+:,\.\;\/\\-] | 26,179 | 1244.48 GB | 31 Mar 2018 - 23:56 |
| Unknown robot (identified by 'crawl') | 20,129 | 216.91 GB | 31 Mar 2018 - 23:59 |
| Unknown robot (identified by empty user agent string) | 8,318 | 79.54 GB | 31 Mar 2018 - 23:19 |
| Googlebot | 6,858 | 34.81 GB | 31 Mar 2018 - 23:54 |
| BaiDuSpider | 6,303 | 93.76 GB | 31 Mar 2018 - 23:56 |
| MJ12bot | 1,392 | 19.77 GB | 31 Mar 2018 - 10:32 |
| MagpieRSS | 1,016 | 195.71 GB | 31 Mar 2018 - 20:39 |
| java | 946 | 9.58 GB | 31 Mar 2018 - 19:17 |
| Unknown robot (identified by 'robot') | 740 | 6.09 GB | 31 Mar 2018 - 22:09 |
| Sogou Spider | 310 | 1.51 GB | 31 Mar 2018 - 21:48 |
| Unknown robot (identified by 'spider') | 295 | 54.24 GB | 31 Mar 2018 - 21:17 |
| SeznamBot | 182 | 1.27 GB | 31 Mar 2018 - 23:33 |
| Alexa (IA Archiver) | 135 | 191.07 MB | 31 Mar 2018 - 15:32 |
| Web Core / Roots | 131 | 19.43 GB | 30 Mar 2018 - 14:30 |
| Exabot | 110 | 1.11 MB | 31 Mar 2018 - 22:59 |
| CFNetwork | 108 | 14.74 GB | 28 Mar 2018 - 14:25 |
| Mail.ru bot | 57 | 458.40 MB | 26 Mar 2018 - 02:13 |
| Phantom | 35 | 180.23 MB | 20 Mar 2018 - 17:03 |
| Motor | 34 | 173.54 MB | 24 Mar 2018 - 08:31 |
| [+:,\.\;\/\\-]bot | 23 | 54.05 KB | 19 Mar 2018 - 08:46 |
| Nutch | 20 | 1.97 GB | 31 Mar 2018 - 23:58 |
| MojeekBot | 20 | 85.78 KB | 23 Mar 2018 - 15:03 |
| Google AdSense | 13 | 22.43 GB | 28 Mar 2018 - 03:42 |
| YaCy | 13 | 42.63 KB | 23 Mar 2018 - 11:41 |
| WordPress | 6 | 0 | 25 Mar 2018 - 14:52 |
| Netcraft | 5 | 16.88 KB | 09 Mar 2018 - 15:47 |
| Jakarta commons-httpclient | 3 | 915.00 MB | 31 Mar 2018 - 11:54 |
| archive.org bot | 2 | 6.85 KB | 23 Mar 2018 - 19:58 |
| Emacs-w3 Search Engine | 2 | 561.44 MB | 04 Mar 2018 - 11:17 |
| W3C Link Checker | 2 | 0 | 16 Mar 2018 - 10:10 |
| Sift | 1 | 3.81 KB | 20 Mar 2018 - 01:47 |
| MSNBot | 1 | 6.77 KB | 12 Mar 2018 - 08:17 |
|