| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Yandex Bot | 59,715 | 146.75 GB | 30 Sep 2018 - 23:59 |
| Suspected bot masqurading as Mozilla | 20,237 | 124.19 MB | 30 Sep 2018 - 23:56 |
| WGet tools | 594,095 | 310.85 GB | 30 Sep 2018 - 23:54 |
| Unknown robot (identified by empty user agent string) | 2,010 | 433.78 MB | 30 Sep 2018 - 23:54 |
| Perl tool | 35,168 | 18.16 GB | 30 Sep 2018 - 23:50 |
| Java (Often spam bot) | 2,544 | 114.52 MB | 30 Sep 2018 - 23:45 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 5,315 | 405.04 MB | 30 Sep 2018 - 23:32 |
| Bingbot | 2,233 | 587.84 MB | 30 Sep 2018 - 22:54 |
| Googlebot | 1,879 | 887.17 MB | 30 Sep 2018 - 22:52 |
| SemrushBot | 83 | 2.19 MB | 30 Sep 2018 - 22:50 |
| Sogou Spider | 98 | 19.64 MB | 30 Sep 2018 - 20:30 |
| BaiDuSpider | 421 | 52.75 MB | 30 Sep 2018 - 20:04 |
| Alexa (IA Archiver) | 79 | 12.81 MB | 30 Sep 2018 - 17:27 |
| Python-urllib | 2,737 | 3.36 GB | 30 Sep 2018 - 16:41 |
| Web Core / Roots | 119 | 45.80 MB | 30 Sep 2018 - 15:31 |
| DotBot, Open Site Explorer | 385 | 610.85 MB | 30 Sep 2018 - 14:45 |
| SEOkicks Webcrawler | 5,973 | 56.66 MB | 30 Sep 2018 - 08:16 |
| Jakarta commons-httpclient | 23 | 97.44 KB | 29 Sep 2018 - 05:34 |
| Google Web Preview | 1 | 4.18 KB | 28 Sep 2018 - 17:11 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 8,998 | 3.83 GB | 28 Sep 2018 - 12:52 |
| FavIconizer | 14 | 58.62 KB | 28 Sep 2018 - 09:18 |
| BUbiNG | 1 | 4.31 KB | 28 Sep 2018 - 05:38 |
| Unknown robot (identified by 'robot') | 17 | 78.96 KB | 28 Sep 2018 - 02:22 |
| SMTBot | 69 | 13.88 MB | 27 Sep 2018 - 22:37 |
| Mail.ru bot | 7 | 49.99 KB | 27 Sep 2018 - 19:40 |
| Unknown robot (identified by 'crawl') | 5 | 21.29 KB | 27 Sep 2018 - 15:25 |
| WordPress | 20 | 53.21 KB | 26 Sep 2018 - 05:05 |
| Turn It In | 3 | 12.67 KB | 25 Sep 2018 - 23:34 |
| MJ12bot | 7 | 201.59 KB | 25 Sep 2018 - 21:17 |
| 360spider | 1 | 2.62 MB | 25 Sep 2018 - 01:28 |
| MSNBot | 3 | 242.73 KB | 24 Sep 2018 - 16:09 |
| FaceBook bot | 10 | 39.83 KB | 24 Sep 2018 - 14:45 |
| Common Crawl | 14 | 40.04 KB | 21 Sep 2018 - 14:24 |
| Unknown robot (identified by 'spider') | 1 | 4.31 KB | 19 Sep 2018 - 08:30 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 16,789 | 158.84 MB | 18 Sep 2018 - 06:18 |
| ltx71 | 7 | 17.03 KB | 17 Sep 2018 - 19:49 |
| Cliqzbot | 2 | 12.47 KB | 06 Sep 2018 - 23:31 |
| Heritrix | 1 | 4.18 KB | 06 Sep 2018 - 19:50 |
| Phantom | 2 | 1009.51 KB | 06 Sep 2018 - 15:28 |
| Sift | 2 | 8.62 KB | 06 Sep 2018 - 08:54 |
| Grabber (SDSC) | 3,066 | 1.56 GB | 04 Sep 2018 - 16:20 |
| Bing Preview bot | 3 | 13.15 MB | 03 Sep 2018 - 13:01 |
|