| 61 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 3,899,110 | 8555.45 GB | 30 Apr 2021 - 23:59 |
| Unknown robot (identified by 'crawl') | 137,913 | 692.86 GB | 30 Apr 2021 - 23:54 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 88,173 | 270.99 GB | 30 Apr 2021 - 23:49 |
| Bingbot | 65,711 | 507.12 GB | 30 Apr 2021 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 28,084 | 126.52 GB | 30 Apr 2021 - 23:59 |
| SemrushBot | 17,037 | 90.35 GB | 30 Apr 2021 - 23:56 |
| AhrefsBot | 10,422 | 181.50 GB | 30 Apr 2021 - 23:58 |
| check_http (nagios) | 8,534 | 27.57 MB | 30 Apr 2021 - 23:55 |
| Unknown robot (identified by empty user agent string) | 5,649 | 72.61 GB | 30 Apr 2021 - 23:35 |
| Googlebot | 5,285 | 25.83 GB | 30 Apr 2021 - 23:57 |
| Unknown robot (identified by 'robot') | 3,689 | 9.50 GB | 09 Apr 2021 - 14:41 |
| Python-urllib | 2,804 | 24.70 GB | 30 Apr 2021 - 19:50 |
| FaceBook bot | 2,743 | 18.62 GB | 30 Apr 2021 - 01:18 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 2,264 | 426.13 MB | 30 Apr 2021 - 15:42 |
| DotBot, Open Site Explorer | 2,210 | 12.41 GB | 30 Apr 2021 - 23:59 |
| Grub.org | 1,200 | 20.21 GB | 11 Apr 2021 - 07:38 |
| Unknown robot (identified by 'spider') | 1,010 | 19.08 GB | 30 Apr 2021 - 23:43 |
| SEOkicks Webcrawler | 923 | 18.37 GB | 30 Apr 2021 - 23:08 |
| Yandex Bot | 645 | 12.32 GB | 30 Apr 2021 - 23:01 |
| Perl tool | 464 | 7.03 GB | 30 Apr 2021 - 21:02 |
| Java (Often spam bot) | 385 | 197.53 MB | 30 Apr 2021 - 12:33 |
| Common Crawl | 374 | 336.25 MB | 22 Apr 2021 - 15:13 |
| MJ12bot | 350 | 19.10 GB | 30 Apr 2021 - 14:59 |
| Mail.ru bot | 239 | 418.32 MB | 30 Apr 2021 - 19:57 |
| YaCy | 226 | 10.43 GB | 29 Apr 2021 - 20:06 |
| FavIconizer | 188 | 418.63 MB | 30 Apr 2021 - 22:19 |
| ltx71 | 170 | 26.31 GB | 29 Apr 2021 - 17:19 |
| SeznamBot | 145 | 789.59 MB | 30 Apr 2021 - 12:41 |
| BaiDuSpider | 103 | 3.89 GB | 30 Apr 2021 - 09:33 |
| LinkChecker | 94 | 138.54 MB | 29 Apr 2021 - 19:04 |
| Googlebot-Image | 85 | 78.65 MB | 29 Apr 2021 - 19:03 |
| Suspected bot masqurading as Mozilla | 81 | 29.00 MB | 30 Apr 2021 - 11:41 |
| GetURL | 72 | 2.22 GB | 26 Apr 2021 - 22:19 |
| Bing Preview bot | 65 | 838.34 MB | 30 Apr 2021 - 22:21 |
| Google Web Preview | 64 | 142.37 KB | 25 Apr 2021 - 20:07 |
| 360spider | 57 | 83.45 MB | 30 Apr 2021 - 10:56 |
| Custo | 56 | 185.31 KB | 30 Apr 2021 - 16:05 |
| Emacs-w3 Search Engine | 56 | 35.66 KB | 15 Apr 2021 - 15:09 |
| Suspected bot masqurading as Mozilla | 38 | 43.78 MB | 30 Apr 2021 - 07:08 |
| Web Core / Roots | 32 | 452.46 MB | 25 Apr 2021 - 10:23 |
| Sift | 28 | 349.18 MB | 30 Apr 2021 - 06:04 |
| MojeekBot | 27 | 183.51 KB | 30 Apr 2021 - 05:26 |
| Sogou Spider | 27 | 89.55 KB | 30 Apr 2021 - 19:29 |
| ichiro | 26 | 1.14 MB | 13 Apr 2021 - 09:09 |
| GigablastOpenSource, an Open Source Search Engine(Wiki) | 24 | 2.79 GB | 18 Apr 2021 - 11:16 |
| Nutch | 24 | 2.16 GB | 04 Apr 2021 - 06:32 |
| Exabot | 19 | 17.52 MB | 08 Apr 2021 - 14:02 |
| BUbiNG | 18 | 45.87 KB | 24 Apr 2021 - 17:04 |
| Anthill | 17 | 1.26 MB | 29 Apr 2021 - 11:25 |
| twitterbot | 15 | 2.67 GB | 29 Apr 2021 - 14:56 |
| Motor | 15 | 1.87 GB | 29 Apr 2021 - 11:46 |
| Netcraft | 13 | 42.92 KB | 17 Apr 2021 - 20:19 |
| IDMARCH | 12 | 177.90 MB | 13 Apr 2021 - 20:16 |
| Unknown robot (identified by 'discovery') | 11 | 19.72 KB | 28 Apr 2021 - 03:15 |
| HTTrack off-line browser | 9 | 746.38 MB | 11 Apr 2021 - 01:42 |
| ning | 5 | 17.70 KB | 10 Apr 2021 - 04:04 |
| MSIECrawler | 3 | 9.67 KB | 01 Apr 2021 - 14:17 |
| yeti | 3 | 8.91 KB | 14 Apr 2021 - 15:52 |
| CFNetwork | 1 | 174.01 MB | 19 Apr 2021 - 07:08 |
| LinkBot | 1 | 426.00 KB | 18 Apr 2021 - 08:47 |
| AdsBot-Google | 1 | 3.35 KB | 13 Apr 2021 - 05:35 |
|