| 69 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 6,017,426 | 36918.38 GB | 31 Oct 2020 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 195,712 | 1278.97 GB | 31 Oct 2020 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 153,535 | 291.65 GB | 31 Oct 2020 - 23:57 |
| Unknown robot (identified by 'crawl') | 134,252 | 987.07 GB | 31 Oct 2020 - 23:38 |
| Bingbot | 57,417 | 377.79 GB | 31 Oct 2020 - 23:57 |
| SemrushBot | 46,686 | 287.83 GB | 31 Oct 2020 - 23:54 |
| Unknown robot (identified by empty user agent string) | 15,732 | 91.22 GB | 31 Oct 2020 - 23:36 |
| AhrefsBot | 10,115 | 209.64 GB | 31 Oct 2020 - 23:35 |
| Googlebot | 9,580 | 63.16 GB | 31 Oct 2020 - 23:05 |
| check_http (nagios) | 8,732 | 28.22 MB | 31 Oct 2020 - 23:53 |
| Yandex Bot | 6,871 | 204.13 GB | 31 Oct 2020 - 23:48 |
| Python-urllib | 6,655 | 18.82 GB | 31 Oct 2020 - 23:50 |
| Java (Often spam bot) | 1,348 | 17.71 GB | 31 Oct 2020 - 23:46 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,340 | 291.07 MB | 31 Oct 2020 - 06:57 |
| DotBot, Open Site Explorer | 913 | 11.44 GB | 31 Oct 2020 - 22:35 |
| MagpieRSS | 873 | 172.02 GB | 31 Oct 2020 - 22:47 |
| ltx71 | 571 | 57.30 GB | 31 Oct 2020 - 21:23 |
| Unknown robot (identified by 'spider') | 542 | 789.78 MB | 31 Oct 2020 - 22:24 |
| Common Crawl | 519 | 7.57 GB | 30 Oct 2020 - 14:48 |
| Perl tool | 446 | 5.28 GB | 31 Oct 2020 - 07:10 |
| MJ12bot | 433 | 13.69 GB | 31 Oct 2020 - 18:37 |
| SEOkicks Webcrawler | 413 | 8.37 GB | 31 Oct 2020 - 23:50 |
| Web Core / Roots | 348 | 4.60 GB | 31 Oct 2020 - 08:34 |
| Mail.ru bot | 241 | 146.73 MB | 31 Oct 2020 - 22:10 |
| FavIconizer | 240 | 420.86 MB | 31 Oct 2020 - 20:02 |
| BaiDuSpider | 169 | 12.96 GB | 31 Oct 2020 - 10:11 |
| SeznamBot | 132 | 2.30 GB | 31 Oct 2020 - 19:02 |
| Alexa (IA Archiver) | 129 | 2.16 GB | 31 Oct 2020 - 12:34 |
| Suspected bot masqurading as Mozilla | 123 | 32.11 KB | 31 Oct 2020 - 10:08 |
| 360spider | 119 | 202.44 MB | 31 Oct 2020 - 12:46 |
| FaceBook bot | 100 | 756.26 MB | 31 Oct 2020 - 17:15 |
| LinkChecker | 98 | 0 | 31 Oct 2020 - 17:22 |
| Googlebot-Image | 90 | 20.42 MB | 31 Oct 2020 - 18:20 |
| yie8 | 88 | 696.77 MB | 26 Oct 2020 - 22:02 |
| Cfetch | 57 | 4.76 GB | 30 Oct 2020 - 13:44 |
| MojeekBot | 55 | 1.99 MB | 31 Oct 2020 - 23:57 |
| Suspected bot masqurading as Mozilla | 52 | 1.62 GB | 31 Oct 2020 - 17:10 |
| Sift | 48 | 48.52 MB | 31 Oct 2020 - 17:58 |
| Phantom | 40 | 191.28 MB | 18 Oct 2020 - 13:19 |
| Netcraft | 32 | 105.55 KB | 31 Oct 2020 - 11:24 |
| YaCy | 32 | 1.48 GB | 30 Oct 2020 - 03:41 |
| WordPress | 23 | 48.87 MB | 21 Oct 2020 - 20:23 |
| Bing Preview bot | 22 | 3.41 GB | 29 Oct 2020 - 15:12 |
| ning | 21 | 224.70 MB | 16 Oct 2020 - 11:02 |
| Sogou Spider | 20 | 85.34 MB | 30 Oct 2020 - 19:12 |
| twitterbot | 20 | 2.07 GB | 31 Oct 2020 - 19:43 |
| Jakarta commons-httpclient | 19 | 287.70 MB | 29 Oct 2020 - 10:50 |
| Anthill | 16 | 64.24 KB | 29 Oct 2020 - 15:21 |
| Unknown robot (identified by 'discovery') | 15 | 49.24 KB | 26 Oct 2020 - 14:48 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 13 | 1.23 MB | 27 Oct 2020 - 22:09 |
| Motor | 10 | 98.30 KB | 22 Oct 2020 - 17:30 |
| Unknown robot (identified by 'robot') | 10 | 566.03 MB | 28 Oct 2020 - 06:24 |
| VSE | 9 | 1001.56 MB | 20 Oct 2020 - 16:58 |
| MSIECrawler | 9 | 29.77 KB | 29 Oct 2020 - 18:48 |
| Yahoo Slurp | 7 | 613.84 MB | 20 Oct 2020 - 10:39 |
| yeti | 6 | 15.34 KB | 25 Oct 2020 - 18:38 |
| CFNetwork | 5 | 666.88 MB | 31 Oct 2020 - 17:31 |
| CMS Crawler | 3 | 10.05 KB | 29 Oct 2020 - 19:01 |
| Powermarks | 3 | 10.05 KB | 16 Oct 2020 - 20:56 |
| Emacs-w3 Search Engine | 2 | 425.60 MB | 26 Oct 2020 - 13:50 |
| Monster | 2 | 8.97 KB | 16 Oct 2020 - 19:24 |
| MS Search 6.0 Robot (MS SharePoint Portal Server?) | 2 | 6.45 KB | 25 Oct 2020 - 09:55 |
| Custo | 2 | 6.57 KB | 29 Oct 2020 - 13:27 |
| Nutch | 1 | 3.35 KB | 16 Oct 2020 - 16:34 |
| archive.org bot | 1 | 4.70 KB | 04 Oct 2020 - 14:13 |
| GigablastOpenSource, an Open Source Search Engine(Wiki) | 1 | 3.35 KB | 14 Oct 2020 - 16:11 |
| MSNBot | 1 | 407.96 KB | 27 Oct 2020 - 14:42 |
| Unknown robot (identified by 'scanner') | 1 | 76.23 KB | 26 Oct 2020 - 12:25 |
| SuperBot | 1 | 10.15 MB | 01 Oct 2020 - 17:36 |
|