55 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 18,896 | 122.00 GB | 30 Sep 2020 - 23:53 |
SemrushBot | 8,339 | 542.12 GB | 30 Sep 2020 - 23:57 |
AhrefsBot | 6,416 | 258.17 GB | 30 Sep 2020 - 23:53 |
CFNetwork | 5,029 | 1.01 GB | 30 Sep 2020 - 11:15 |
Unknown robot (identified by 'crawl') | 1,991 | 65.53 GB | 30 Sep 2020 - 17:53 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,541 | 33.01 GB | 30 Sep 2020 - 23:50 |
Googlebot | 1,157 | 15.05 GB | 30 Sep 2020 - 23:57 |
Bingbot | 1,095 | 9.65 GB | 30 Sep 2020 - 23:49 |
Yandex Bot | 799 | 22.13 GB | 30 Sep 2020 - 23:33 |
DotBot, Open Site Explorer | 700 | 12.47 GB | 30 Sep 2020 - 20:12 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 494 | 133.96 MB | 30 Sep 2020 - 23:45 |
WordPress | 380 | 6.99 GB | 29 Sep 2020 - 06:54 |
Perl tool | 338 | 1.73 MB | 30 Sep 2020 - 22:00 |
MJ12bot | 227 | 12.18 GB | 30 Sep 2020 - 11:25 |
Unknown robot (identified by empty user agent string) | 201 | 5.77 GB | 30 Sep 2020 - 19:05 |
LinkChecker | 182 | 0 | 30 Sep 2020 - 22:28 |
Unknown robot (identified by 'spider') | 99 | 971.75 MB | 30 Sep 2020 - 22:02 |
WGet tools | 89 | 1.84 GB | 30 Sep 2020 - 17:36 |
FaceBook bot | 81 | 2.44 GB | 30 Sep 2020 - 06:10 |
Web Core / Roots | 78 | 2.53 GB | 30 Sep 2020 - 00:20 |
Java (Often spam bot) | 68 | 14.86 MB | 30 Sep 2020 - 00:57 |
rpt-httpclient | 62 | 228.32 MB | 30 Sep 2020 - 18:31 |
FavIconizer | 58 | 305.13 MB | 30 Sep 2020 - 19:18 |
Google Web Preview | 55 | 397.47 MB | 30 Sep 2020 - 21:42 |
ltx71 | 47 | 5.99 GB | 28 Sep 2020 - 19:17 |
Feedfetcher-Google | 30 | 9.64 KB | 30 Sep 2020 - 19:57 |
Python-urllib | 30 | 1.57 GB | 30 Sep 2020 - 13:36 |
Suspected bot masqurading as Mozilla | 28 | 0 | 30 Sep 2020 - 14:09 |
Bing Preview bot | 26 | 1.78 GB | 30 Sep 2020 - 17:37 |
Alexa (IA Archiver) | 21 | 83.88 KB | 11 Sep 2020 - 18:20 |
BaiDuSpider | 19 | 493.31 MB | 26 Sep 2020 - 09:30 |
Common Crawl | 17 | 20.71 MB | 30 Sep 2020 - 22:51 |
SeznamBot | 16 | 37.49 MB | 30 Sep 2020 - 20:39 |
Mail.ru bot | 13 | 66.50 MB | 27 Sep 2020 - 19:44 |
360spider | 6 | 123.90 MB | 14 Sep 2020 - 23:20 |
Unknown robot (identified by 'robot') | 6 | 7.78 MB | 03 Sep 2020 - 03:19 |
Unknown robot (identified by 'discovery') | 6 | 0 | 19 Sep 2020 - 14:59 |
ning | 5 | 284.09 MB | 10 Sep 2020 - 04:00 |
yeti | 5 | 38.28 MB | 26 Sep 2020 - 04:11 |
Suspected bot masqurading as Mozilla | 5 | 0 | 30 Sep 2020 - 20:07 |
Sogou Spider | 5 | 3.76 MB | 30 Sep 2020 - 22:15 |
Google AdSense | 5 | 272.91 MB | 30 Sep 2020 - 08:04 |
twitterbot | 3 | 23.09 MB | 06 Sep 2020 - 11:39 |
Heritrix | 3 | 145.35 MB | 02 Sep 2020 - 14:44 |
SEOkicks Webcrawler | 2 | 11.75 KB | 27 Sep 2020 - 17:14 |
BUbiNG | 2 | 6.76 KB | 13 Sep 2020 - 23:24 |
Cfetch | 2 | 15.03 MB | 20 Sep 2020 - 14:11 |
A PHP script | 1 | 7.47 MB | 24 Sep 2020 - 19:01 |
MojeekBot | 1 | 9.81 KB | 14 Sep 2020 - 19:56 |
YaCy | 1 | 7.68 KB | 14 Sep 2020 - 18:07 |
Yahoo Slurp | 1 | 7.23 MB | 11 Sep 2020 - 04:15 |
Sift | 1 | 3.88 KB | 08 Sep 2020 - 00:35 |
HTTrack off-line browser | 1 | 398.31 MB | 03 Sep 2020 - 01:40 |
VSE | 1 | 7.68 MB | 12 Sep 2020 - 18:59 |
InternetArchive | 1 | 0 | 13 Sep 2020 - 22:17 |
|