43 different robots | Hits | Bandwidth | Last visit |
WGet tools | 4,060 | 802.13 GB | 31 May 2020 - 23:59 |
SemrushBot | 9,603 | 38.60 GB | 31 May 2020 - 23:57 |
Yandex Bot | 545 | 15.54 GB | 31 May 2020 - 23:54 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,662+1 | 3.59 GB | 31 May 2020 - 23:52 |
AhrefsBot | 12,600 | 465.04 GB | 31 May 2020 - 23:40 |
LinkChecker | 295 | 0 | 31 May 2020 - 23:37 |
DotBot, Open Site Explorer | 6,828+1 | 46.78 GB | 31 May 2020 - 23:36 |
Unknown robot (identified by empty user agent string) | 2,732 | 144.94 GB | 31 May 2020 - 23:05 |
Perl tool | 299 | 8.82 MB | 31 May 2020 - 23:02 |
Python-urllib | 667 | 272.30 GB | 31 May 2020 - 23:02 |
Bingbot | 242 | 150.79 MB | 31 May 2020 - 22:47 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4,783 | 813.18 GB | 31 May 2020 - 22:13 |
CFNetwork | 383 | 17.36 GB | 31 May 2020 - 22:11 |
FaceBook bot | 27 | 32.15 MB | 31 May 2020 - 21:52 |
Java (Often spam bot) | 1,100 | 26.35 GB | 31 May 2020 - 20:38 |
BaiDuSpider | 31 | 15.76 MB | 31 May 2020 - 19:50 |
Googlebot | 278 | 243.46 MB | 31 May 2020 - 17:28 |
Unknown robot (identified by 'crawl') | 3,856 | 73.66 GB | 31 May 2020 - 15:55 |
Jakarta commons-httpclient | 41 | 656 Bytes | 31 May 2020 - 14:01 |
SEOkicks Webcrawler | 6 | 28.98 KB | 30 May 2020 - 08:17 |
MJ12bot | 72 | 131.62 MB | 29 May 2020 - 15:54 |
yie8 | 16 | 18.97 MB | 29 May 2020 - 12:58 |
Motor | 5 | 3.65 MB | 29 May 2020 - 06:00 |
Web Core / Roots | 31 | 811.61 MB | 29 May 2020 - 03:33 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 742 | 158.70 MB | 28 May 2020 - 11:21 |
SeznamBot | 11 | 50.91 KB | 28 May 2020 - 03:13 |
Phantom | 1 | 28.69 MB | 27 May 2020 - 20:00 |
FavIconizer | 3 | 57.39 MB | 27 May 2020 - 02:32 |
WordPress | 11 | 3.58 KB | 26 May 2020 - 13:02 |
Sift | 1 | 28.69 MB | 26 May 2020 - 12:59 |
Alexa (IA Archiver) | 96 | 26.85 MB | 26 May 2020 - 10:54 |
360spider | 1 | 3.60 KB | 25 May 2020 - 04:48 |
Bing Preview bot | 2 | 59.47 MB | 24 May 2020 - 01:32 |
Turn It In | 48,060 | 1.17 GB | 23 May 2020 - 15:11 |
archive.org bot | 6 | 178.41 MB | 22 May 2020 - 22:49 |
Unknown robot (identified by hit on 'robots.txt') | 0+4 | 24.96 KB | 22 May 2020 - 13:16 |
YaCy | 1 | 357.81 KB | 21 May 2020 - 04:20 |
Google AdSense | 6 | 171.19 MB | 20 May 2020 - 01:02 |
twitterbot | 1 | 3.19 KB | 15 May 2020 - 11:12 |
ltx71 | 3 | 30.56 MB | 13 May 2020 - 11:09 |
Unknown robot (identified by 'robot') | 2 | 8.74 KB | 13 May 2020 - 03:46 |
Suspected bot masqurading as Mozilla | 1 | 0 | 10 May 2020 - 02:11 |
ning | 1 | 42.36 MB | 05 May 2020 - 15:07 |
|