42 different robots | Hits | Bandwidth | Last visit |
WGet tools | 21,868 | 65.66 GB | 30 Nov 2022 - 23:59 |
LinkChecker | 101 | 0 | 30 Nov 2022 - 23:45 |
Python-urllib | 524 | 57.01 MB | 30 Nov 2022 - 23:35 |
DotBot, Open Site Explorer | 436 | 327.93 MB | 30 Nov 2022 - 23:32 |
Perl tool | 238 | 17.06 MB | 30 Nov 2022 - 23:25 |
Common *nix tool for automating web document retireval. Most likely a bot. | 3,355 | 6.52 GB | 30 Nov 2022 - 23:17 |
BaiDuSpider | 190 | 209.54 KB | 30 Nov 2022 - 21:49 |
Yandex Bot | 145 | 106.66 MB | 30 Nov 2022 - 20:34 |
AhrefsBot | 160 | 16.86 MB | 30 Nov 2022 - 19:06 |
Sogou Spider | 277 | 13.45 MB | 30 Nov 2022 - 18:55 |
Unknown robot (identified by empty user agent string) | 77 | 7.61 MB | 30 Nov 2022 - 18:01 |
Googlebot | 106 | 11.52 MB | 30 Nov 2022 - 17:50 |
YaCy | 2 | 6.40 MB | 30 Nov 2022 - 14:30 |
MJ12bot | 39 | 1.80 MB | 30 Nov 2022 - 08:13 |
Bingbot | 98 | 39.98 MB | 30 Nov 2022 - 07:17 |
FavIconizer | 16 | 795.28 KB | 30 Nov 2022 - 06:55 |
Custo | 54 | 2.62 MB | 30 Nov 2022 - 01:38 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,238 | 1.64 GB | 30 Nov 2022 - 00:52 |
SemrushBot | 67 | 11.76 MB | 29 Nov 2022 - 18:40 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 30 | 1.46 MB | 29 Nov 2022 - 18:14 |
Googlebot-Image | 3 | 0 | 29 Nov 2022 - 13:06 |
Unknown robot (identified by 'crawl') | 117 | 52.48 MB | 29 Nov 2022 - 12:34 |
Java (Often spam bot) | 61 | 110.71 MB | 28 Nov 2022 - 19:42 |
Common Crawl | 5 | 248.44 KB | 27 Nov 2022 - 19:02 |
Mail.ru bot | 14 | 14.01 MB | 27 Nov 2022 - 15:00 |
Unknown robot (identified by 'spider') | 11 | 9.90 MB | 26 Nov 2022 - 02:43 |
SEOkicks Webcrawler | 106 | 132.07 MB | 25 Nov 2022 - 23:48 |
Web Core / Roots | 20 | 2.50 MB | 23 Nov 2022 - 01:55 |
Drupal Site | 1 | 0 | 22 Nov 2022 - 15:07 |
Grapeshot Crawler | 1 | 49.64 KB | 22 Nov 2022 - 11:15 |
WebCopy | 5 | 2.22 MB | 20 Nov 2022 - 10:56 |
Suspected bot masqurading as Mozilla | 3 | 6.35 MB | 17 Nov 2022 - 23:19 |
SeznamBot | 2 | 99.53 KB | 16 Nov 2022 - 06:12 |
MojeekBot | 1 | 49.76 KB | 15 Nov 2022 - 01:57 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 49.76 KB | 14 Nov 2022 - 21:16 |
FaceBook bot | 3 | 50.05 KB | 14 Nov 2022 - 17:20 |
Bing Preview bot | 1 | 2.20 KB | 13 Nov 2022 - 21:15 |
twitterbot | 1 | 49.76 KB | 08 Nov 2022 - 22:57 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 49.76 KB | 08 Nov 2022 - 04:46 |
Netcraft | 3 | 149.16 KB | 07 Nov 2022 - 21:53 |
Suspected bot masqurading as Mozilla | 1 | 49.76 KB | 03 Nov 2022 - 03:07 |
WordPress | 1 | 0 | 01 Nov 2022 - 01:57 |