44 different robots | Hits | Bandwidth | Last visit |
WGet tools | 324,014+4 | 1276.05 GB | 30 Apr 2021 - 17:24 |
AhrefsBot | 20,724 | 771.60 GB | 30 Apr 2021 - 23:05 |
Bingbot | 17,693+1 | 179.28 GB | 30 Apr 2021 - 23:10 |
Unknown robot (identified by 'crawl') | 14,292 | 75.17 GB | 30 Apr 2021 - 18:49 |
SemrushBot | 8,252 | 22.46 GB | 30 Apr 2021 - 23:00 |
Common *nix tool for automating web document retireval. Most likely a bot. | 6,937 | 810.77 GB | 30 Apr 2021 - 23:09 |
Suspected bot masqurading as Mozilla | 1,668 | 47.39 GB | 30 Apr 2021 - 23:06 |
Java (Often spam bot) | 1,553 | 34.20 GB | 30 Apr 2021 - 20:35 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,347 | 103.79 GB | 30 Apr 2021 - 23:02 |
DotBot, Open Site Explorer | 957 | 734.19 MB | 30 Apr 2021 - 22:43 |
CFNetwork | 909 | 29.94 GB | 30 Apr 2021 - 21:16 |
Common Crawl | 876 | 369.27 MB | 23 Apr 2021 - 03:15 |
Unknown robot (identified by empty user agent string) | 721 | 48.00 GB | 30 Apr 2021 - 21:46 |
Python-urllib | 620 | 243.24 GB | 30 Apr 2021 - 14:00 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 573 | 94.56 MB | 30 Apr 2021 - 19:13 |
Googlebot | 350 | 113.47 MB | 30 Apr 2021 - 21:56 |
LinkChecker | 311 | 0 | 30 Apr 2021 - 01:20 |
Unknown robot (identified by 'spider') | 284 | 358.46 MB | 30 Apr 2021 - 21:44 |
Perl tool | 282 | 12.98 MB | 30 Apr 2021 - 23:02 |
MJ12bot | 196 | 406.92 MB | 30 Apr 2021 - 18:56 |
FaceBook bot | 188 | 5.34 GB | 29 Apr 2021 - 11:46 |
Yandex Bot | 131 | 781.06 MB | 30 Apr 2021 - 21:44 |
GetURL | 95 | 979.70 MB | 25 Apr 2021 - 03:59 |
Web Core / Roots | 86 | 2.19 GB | 30 Apr 2021 - 18:21 |
ltx71 | 73 | 107.65 GB | 30 Apr 2021 - 12:16 |
Unknown robot (identified by 'robot') | 55 | 80.39 MB | 09 Apr 2021 - 17:40 |
WordPress | 48 | 316.68 MB | 28 Apr 2021 - 04:16 |
Jakarta commons-httpclient | 32 | 512 Bytes | 30 Apr 2021 - 14:01 |
SeznamBot | 13 | 82.21 KB | 29 Apr 2021 - 08:43 |
archive.org bot | 8 | 251.22 MB | 29 Apr 2021 - 04:19 |
FavIconizer | 6 | 174.56 MB | 26 Apr 2021 - 12:48 |
Unknown robot (identified by hit on 'robots.txt') | 0+6 | 37.44 KB | 22 Apr 2021 - 00:52 |
Google AdSense | 5 | 163.61 MB | 27 Apr 2021 - 23:12 |
HTTrack off-line browser | 5 | 10.20 MB | 01 Apr 2021 - 09:09 |
BaiDuSpider | 4 | 148.11 MB | 07 Apr 2021 - 01:26 |
Xenu's Link Sleuth (TM), see Wikipedia | 4 | 0 | 27 Apr 2021 - 13:09 |
Bing Preview bot | 4 | 96.56 MB | 16 Apr 2021 - 11:28 |
ning | 4 | 80.47 MB | 03 Apr 2021 - 08:16 |
Suspected bot masqurading as Mozilla | 4 | 29.87 MB | 28 Apr 2021 - 22:10 |
SEOkicks Webcrawler | 4 | 19.23 KB | 16 Apr 2021 - 05:01 |
ichiro | 3 | 16.37 KB | 15 Apr 2021 - 02:27 |
360spider | 1 | 2.61 KB | 15 Apr 2021 - 03:41 |
Mail.ru bot | 1 | 6.88 KB | 15 Apr 2021 - 20:16 |
MSNBot | 1 | 8.92 MB | 19 Apr 2021 - 19:40 |