47 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 32,909 | 219.69 GB | 30 Nov 2020 - 22:05 |
SemrushBot | 6,391 | 361.58 GB | 30 Nov 2020 - 22:02 |
AhrefsBot | 4,789 | 88.82 GB | 30 Nov 2020 - 22:08 |
Bingbot | 2,516 | 16.58 GB | 30 Nov 2020 - 21:58 |
Googlebot | 1,813 | 27.46 GB | 30 Nov 2020 - 22:09 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,778 | 66.22 GB | 30 Nov 2020 - 21:50 |
Yandex Bot | 1,598 | 70.76 GB | 30 Nov 2020 - 21:21 |
Unknown robot (identified by 'crawl') | 1,520 | 49.45 GB | 30 Nov 2020 - 17:00 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,067 | 35.55 MB | 24 Nov 2020 - 21:04 |
DotBot, Open Site Explorer | 466 | 2.60 GB | 30 Nov 2020 - 20:13 |
Perl tool | 366 | 1.47 MB | 30 Nov 2020 - 03:53 |
Web Core / Roots | 344 | 2.09 GB | 30 Nov 2020 - 22:06 |
MJ12bot | 339 | 16.66 GB | 30 Nov 2020 - 17:14 |
LinkChecker | 124 | 0 | 29 Nov 2020 - 17:44 |
WordPress | 118 | 129.64 MB | 28 Nov 2020 - 02:20 |
Google Web Preview | 99 | 736.74 MB | 30 Nov 2020 - 17:43 |
Unknown robot (identified by empty user agent string) | 92 | 5.72 GB | 30 Nov 2020 - 19:43 |
FaceBook bot | 84 | 427.19 MB | 30 Nov 2020 - 18:14 |
WGet tools | 67 | 2.13 GB | 30 Nov 2020 - 03:53 |
Unknown robot (identified by 'spider') | 63 | 2.38 GB | 30 Nov 2020 - 17:57 |
Java (Often spam bot) | 63 | 222.07 MB | 26 Nov 2020 - 22:45 |
rpt-httpclient | 56 | 228.32 MB | 30 Nov 2020 - 18:47 |
yeti | 43 | 319.46 MB | 30 Nov 2020 - 13:49 |
Bing Preview bot | 37 | 1.64 GB | 30 Nov 2020 - 04:01 |
ltx71 | 36 | 1.72 GB | 29 Nov 2020 - 16:19 |
Common Crawl | 32 | 21.24 MB | 29 Nov 2020 - 20:44 |
SeznamBot | 29 | 30.49 MB | 30 Nov 2020 - 08:15 |
Suspected bot masqurading as Mozilla | 25 | 7.61 MB | 30 Nov 2020 - 22:01 |
Alexa (IA Archiver) | 21 | 114.33 KB | 11 Nov 2020 - 01:44 |
Sogou Spider | 20 | 31.03 MB | 29 Nov 2020 - 13:24 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 14 | 76.22 MB | 24 Nov 2020 - 19:54 |
Mail.ru bot | 12 | 52.41 MB | 21 Nov 2020 - 14:36 |
CFNetwork | 10 | 337.46 MB | 26 Nov 2020 - 23:46 |
BaiDuSpider | 10 | 215.87 MB | 30 Nov 2020 - 02:03 |
Python-urllib | 4 | 22.43 MB | 28 Nov 2020 - 10:03 |
Suspected bot masqurading as Mozilla | 4 | 0 | 25 Nov 2020 - 01:30 |
FavIconizer | 3 | 116.30 MB | 17 Nov 2020 - 16:45 |
Cfetch | 3 | 70.03 MB | 30 Nov 2020 - 19:15 |
ning | 3 | 14.80 MB | 29 Nov 2020 - 17:29 |
Motor | 2 | 83.56 MB | 09 Nov 2020 - 14:24 |
archive.org bot | 2 | 27.96 KB | 17 Nov 2020 - 11:55 |
twitterbot | 2 | 26.59 KB | 30 Nov 2020 - 11:57 |
YaCy | 2 | 54.59 MB | 13 Nov 2020 - 07:40 |
SEOkicks Webcrawler | 2 | 6.17 KB | 02 Nov 2020 - 04:31 |
Google AdSense | 2 | 62.47 MB | 28 Nov 2020 - 00:04 |
Y!J Yahoo Japan | 2 | 15.32 MB | 12 Nov 2020 - 10:16 |
MojeekBot | 1 | 2.47 KB | 23 Nov 2020 - 08:50 |
|