| 37 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by empty user agent string) | 7,402 | 183.12 GB | 31 Jul 2018 - 23:59 |
| Unknown robot (identified by 'robot') | 577 | 4.15 GB | 31 Jul 2018 - 23:57 |
| Yandex Bot | 44,419 | 1548.68 GB | 31 Jul 2018 - 23:57 |
| bot[+:,\.\;\/\\-] | 10,661 | 223.84 GB | 31 Jul 2018 - 23:53 |
| Python-urllib | 21,305 | 22.53 GB | 31 Jul 2018 - 23:50 |
| Sogou Spider | 465 | 370.58 MB | 31 Jul 2018 - 23:48 |
| Unknown robot (identified by 'crawl') | 33,570 | 276.21 GB | 31 Jul 2018 - 23:44 |
| BaiDuSpider | 4,900 | 71.09 GB | 31 Jul 2018 - 23:05 |
| Googlebot | 9,268 | 55.91 GB | 31 Jul 2018 - 22:28 |
| Mail.ru bot | 122 | 203.49 MB | 31 Jul 2018 - 22:27 |
| java | 13,689 | 3.44 GB | 31 Jul 2018 - 21:40 |
| Web Core / Roots | 34 | 3.09 GB | 31 Jul 2018 - 12:27 |
| Nutch | 21 | 1.49 GB | 31 Jul 2018 - 11:47 |
| MagpieRSS | 560 | 113.04 GB | 31 Jul 2018 - 11:42 |
| MojeekBot | 17 | 84.05 KB | 31 Jul 2018 - 10:15 |
| Alexa (IA Archiver) | 65 | 449.55 MB | 31 Jul 2018 - 06:45 |
| Unknown robot (identified by 'spider') | 125 | 20.15 GB | 31 Jul 2018 - 06:17 |
| MJ12bot | 24 | 500.38 MB | 29 Jul 2018 - 14:17 |
| Sift | 12 | 64.81 KB | 29 Jul 2018 - 13:59 |
| Phantom | 17 | 46.79 KB | 29 Jul 2018 - 11:45 |
| SeznamBot | 111 | 777.98 MB | 29 Jul 2018 - 06:32 |
| CFNetwork | 22 | 3.59 GB | 28 Jul 2018 - 13:13 |
| LinkChecker | 4 | 0 | 27 Jul 2018 - 23:47 |
| WordPress | 2 | 0 | 27 Jul 2018 - 09:43 |
| YaCy | 8 | 50.98 KB | 26 Jul 2018 - 11:41 |
| InternetArchive | 1 | 0 | 24 Jul 2018 - 07:06 |
| Google AdSense | 3 | 2.80 GB | 22 Jul 2018 - 14:21 |
| Jakarta commons-httpclient | 39 | 5.85 GB | 20 Jul 2018 - 07:48 |
| W3C Link Checker | 1 | 0 | 19 Jul 2018 - 14:17 |
| Yahoo Slurp | 4 | 11.53 MB | 19 Jul 2018 - 14:08 |
| WebCopy | 4 | 15.14 MB | 18 Jul 2018 - 07:49 |
| archive.org bot | 4 | 12.67 KB | 15 Jul 2018 - 21:09 |
| LinkBot | 5 | 3.43 KB | 11 Jul 2018 - 00:23 |
| Netcraft | 4 | 13.46 KB | 09 Jul 2018 - 09:40 |
| MSNBot | 1 | 490.40 KB | 09 Jul 2018 - 03:53 |
| Emacs-w3 Search Engine | 2 | 7.23 KB | 05 Jul 2018 - 11:55 |
| Custo | 1 | 3.43 KB | 04 Jul 2018 - 11:33 |
|