| 57 different robots | Hits | Bandwidth | Last visit |
|---|
| Bingbot | 91,572 | 539.40 GB | 31 Jul 2021 - 23:59 |
| WGet tools | 3,352,498 | 7695.66 GB | 31 Jul 2021 - 23:59 |
| Common Crawl | 2,165 | 15.10 GB | 31 Jul 2021 - 23:59 |
| Unknown robot (identified by 'crawl') | 61,541 | 257.66 GB | 31 Jul 2021 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 31,847 | 221.92 GB | 31 Jul 2021 - 23:59 |
| SemrushBot | 19,950 | 86.20 GB | 31 Jul 2021 - 23:58 |
| check_http (nagios) | 8,619 | 27.86 MB | 31 Jul 2021 - 23:55 |
| Googlebot | 5,142 | 57.06 GB | 31 Jul 2021 - 23:53 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 21,164 | 122.96 GB | 31 Jul 2021 - 23:53 |
| Unknown robot (identified by 'spider') | 5,923 | 32.83 GB | 31 Jul 2021 - 23:41 |
| Unknown robot (identified by empty user agent string) | 14,035 | 70.99 GB | 31 Jul 2021 - 23:35 |
| SeznamBot | 119 | 633.15 MB | 31 Jul 2021 - 23:24 |
| Python-urllib | 2,993 | 9.51 GB | 31 Jul 2021 - 23:16 |
| twitterbot | 15 | 2.77 GB | 31 Jul 2021 - 22:10 |
| AhrefsBot | 6,677 | 112.21 GB | 31 Jul 2021 - 21:59 |
| FavIconizer | 171 | 566.11 KB | 31 Jul 2021 - 20:56 |
| Bing Preview bot | 214 | 31.33 GB | 31 Jul 2021 - 20:43 |
| Yandex Bot | 388 | 12.29 GB | 31 Jul 2021 - 20:30 |
| ltx71 | 258 | 29.38 GB | 31 Jul 2021 - 19:44 |
| DotBot, Open Site Explorer | 1,636 | 13.08 GB | 31 Jul 2021 - 19:06 |
| Suspected bot masqurading as Mozilla | 177 | 0 | 31 Jul 2021 - 18:27 |
| LinkChecker | 113 | 264.99 MB | 31 Jul 2021 - 18:09 |
| MJ12bot | 1,419 | 47.96 GB | 31 Jul 2021 - 18:06 |
| BaiDuSpider | 163 | 20.99 GB | 31 Jul 2021 - 12:03 |
| Custo | 265 | 879.02 KB | 31 Jul 2021 - 09:26 |
| Web Core / Roots | 103 | 5.99 GB | 31 Jul 2021 - 09:22 |
| MojeekBot | 99 | 43.08 MB | 31 Jul 2021 - 09:02 |
| Googlebot-Image | 110 | 63.49 MB | 31 Jul 2021 - 07:35 |
| Perl tool | 418 | 7.81 GB | 31 Jul 2021 - 07:10 |
| Nutch | 14 | 224.64 KB | 31 Jul 2021 - 05:20 |
| Netcraft | 7 | 23.32 KB | 31 Jul 2021 - 01:35 |
| FaceBook bot | 37 | 1.54 GB | 31 Jul 2021 - 01:10 |
| Java (Often spam bot) | 555 | 205.86 MB | 31 Jul 2021 - 00:57 |
| SMTBot | 44 | 81.08 MB | 30 Jul 2021 - 22:09 |
| Sogou Spider | 23 | 76.16 KB | 30 Jul 2021 - 19:35 |
| Suspected bot masqurading as Mozilla | 123 | 1.21 GB | 30 Jul 2021 - 09:41 |
| Simmany Robot Ver1.0 | 10 | 90.87 KB | 30 Jul 2021 - 02:02 |
| Unknown robot (identified by 'discovery') | 12 | 39.57 KB | 28 Jul 2021 - 18:12 |
| 360spider | 14 | 27.87 MB | 28 Jul 2021 - 03:38 |
| YaCy | 23 | 823.63 KB | 28 Jul 2021 - 00:22 |
| Mail.ru bot | 226 | 609.90 MB | 26 Jul 2021 - 21:06 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 46 | 9.98 GB | 26 Jul 2021 - 19:47 |
| ning | 5 | 196.16 MB | 25 Jul 2021 - 22:06 |
| Motor | 13 | 25.25 KB | 24 Jul 2021 - 17:08 |
| HTTrack off-line browser | 3 | 5.62 KB | 24 Jul 2021 - 11:26 |
| yeti | 6 | 19.46 KB | 21 Jul 2021 - 15:52 |
| MSIECrawler | 3 | 9.67 KB | 19 Jul 2021 - 23:13 |
| Unknown robot (identified by 'robot') | 2 | 19.47 KB | 17 Jul 2021 - 14:10 |
| archive.org bot | 1 | 60.46 KB | 17 Jul 2021 - 12:06 |
| Phantom | 13 | 18.49 KB | 15 Jul 2021 - 12:23 |
| Powermarks | 1 | 3.35 KB | 14 Jul 2021 - 16:54 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 3 | 11.58 KB | 14 Jul 2021 - 00:04 |
| Rogerbot | 2 | 6.57 KB | 13 Jul 2021 - 13:24 |
| Unknown robot (identified by 'checker') | 1 | 195.69 MB | 10 Jul 2021 - 17:33 |
| InfoBot | 2 | 8.59 KB | 10 Jul 2021 - 12:01 |
| SEOkicks Webcrawler | 352 | 4.27 GB | 04 Jul 2021 - 02:07 |
| Anthill | 1 | 3.35 KB | 01 Jul 2021 - 03:27 |
|