| 63 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 2,738,096 | 12821.24 GB | 30 Nov 2018 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 203,673 | 604.73 GB | 30 Nov 2018 - 23:58 |
| Yandex Bot | 26,059 | 1207.77 GB | 30 Nov 2018 - 23:50 |
| Python-urllib | 23,345 | 189.76 GB | 30 Nov 2018 - 23:50 |
| SemrushBot | 12,216 | 75.24 GB | 30 Nov 2018 - 23:57 |
| Bingbot | 10,617 | 156.57 GB | 30 Nov 2018 - 23:55 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 10,195 | 379.16 GB | 30 Nov 2018 - 22:58 |
| Unknown robot (identified by 'crawl') | 8,877 | 174.77 GB | 30 Nov 2018 - 13:25 |
| check_http (nagios) | 8,291 | 27.43 MB | 30 Nov 2018 - 23:58 |
| Unknown robot (identified by empty user agent string) | 7,495 | 131.97 GB | 30 Nov 2018 - 23:28 |
| BaiDuSpider | 5,934 | 108.48 GB | 30 Nov 2018 - 23:55 |
| Java (Often spam bot) | 4,314 | 6.54 GB | 30 Nov 2018 - 13:12 |
| Googlebot | 1,443 | 9.49 GB | 30 Nov 2018 - 23:56 |
| 007ac9 Crawler, seems to belong to SISTRIX | 1,002 | 8.42 GB | 30 Nov 2018 - 10:35 |
| Suspected bot masqurading as Mozilla | 913 | 245.26 MB | 30 Nov 2018 - 23:08 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 627 | 29.13 GB | 30 Nov 2018 - 15:49 |
| Sogou Spider | 460 | 522.95 MB | 30 Nov 2018 - 19:13 |
| DotBot, Open Site Explorer | 367 | 5.38 GB | 18 Nov 2018 - 03:53 |
| Perl tool | 353 | 8.30 GB | 30 Nov 2018 - 08:10 |
| MagpieRSS | 314 | 62.61 GB | 19 Nov 2018 - 22:49 |
| AhrefsBot | 297 | 3.11 GB | 30 Nov 2018 - 11:13 |
| Exabot | 251 | 6.00 MB | 30 Nov 2018 - 22:18 |
| ltx71 | 231 | 29.67 GB | 30 Nov 2018 - 09:46 |
| Mail.ru bot | 223 | 425.82 MB | 30 Nov 2018 - 21:10 |
| FavIconizer | 200 | 83.61 MB | 30 Nov 2018 - 23:22 |
| Common Crawl | 199 | 2.19 GB | 21 Nov 2018 - 00:03 |
| FaceBook bot | 192 | 11.09 MB | 30 Nov 2018 - 01:30 |
| SMTBot | 179 | 659.38 MB | 16 Nov 2018 - 08:12 |
| Bing Preview bot | 175 | 53.00 GB | 30 Nov 2018 - 17:22 |
| SEOkicks Webcrawler | 120 | 191.06 MB | 29 Nov 2018 - 22:57 |
| Alexa (IA Archiver) | 117 | 11.25 MB | 30 Nov 2018 - 23:51 |
| Unknown robot (identified by 'spider') | 106 | 51.38 GB | 29 Nov 2018 - 18:49 |
| Web Core / Roots | 100 | 21.10 GB | 30 Nov 2018 - 15:38 |
| 360spider | 81 | 511.47 MB | 26 Nov 2018 - 02:04 |
| SeznamBot | 77 | 12.63 GB | 29 Nov 2018 - 19:27 |
| Suspected bot masqurading as Mozilla | 76 | 3.76 GB | 25 Nov 2018 - 14:39 |
| Unknown robot (identified by 'robot') | 64 | 8.15 GB | 30 Nov 2018 - 21:05 |
| YaCy | 51 | 1.62 GB | 29 Nov 2018 - 07:58 |
| MJ12bot | 38 | 218.64 KB | 19 Nov 2018 - 00:13 |
| Googlebot-Image | 32 | 42.25 KB | 25 Nov 2018 - 16:52 |
| ning | 27 | 1.84 GB | 30 Nov 2018 - 15:16 |
| MojeekBot | 22 | 161.14 KB | 29 Nov 2018 - 23:51 |
| WordPress | 15 | 49.19 MB | 23 Nov 2018 - 15:11 |
| twitterbot | 13 | 1.69 GB | 30 Nov 2018 - 17:44 |
| Nutch | 13 | 1.14 GB | 30 Nov 2018 - 19:00 |
| Cliqzbot | 13 | 4.36 MB | 28 Nov 2018 - 19:59 |
| yeti | 12 | 29.32 KB | 26 Nov 2018 - 10:21 |
| Phantom | 6 | 1.97 MB | 26 Nov 2018 - 23:53 |
| Netcraft | 6 | 20.31 KB | 07 Nov 2018 - 22:23 |
| Google AdSense | 6 | 2.81 GB | 28 Nov 2018 - 00:27 |
| Sift | 5 | 16.88 KB | 29 Nov 2018 - 10:22 |
| Emacs-w3 Search Engine | 5 | 187.26 MB | 17 Nov 2018 - 00:34 |
| Linkdex | 3 | 377.87 KB | 20 Nov 2018 - 16:09 |
| Xenu's Link Sleuth (TM), see Wikipedia | 3 | 0 | 05 Nov 2018 - 02:22 |
| LinkChecker | 3 | 0 | 24 Nov 2018 - 00:49 |
| Suspected bot masqurading as Mozilla | 1 | 89.84 KB | 01 Nov 2018 - 19:01 |
| CFNetwork | 1 | 234.00 MB | 06 Nov 2018 - 22:43 |
| lwp-trivial | 1 | 272.45 MB | 20 Nov 2018 - 14:04 |
| CMS Crawler | 1 | 3.43 KB | 21 Nov 2018 - 14:05 |
| The Tweeted Times | 1 | 7.92 KB | 19 Nov 2018 - 03:17 |
| InternetArchive | 1 | 0 | 25 Nov 2018 - 14:11 |
| Fish search | 1 | 43.54 MB | 03 Nov 2018 - 21:59 |
| IstellaBot | 1 | 3.30 KB | 28 Nov 2018 - 01:03 |
|