53 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 22,052 | 139.82 GB | 30 Jun 2020 - 21:04 |
Unknown robot (identified by 'spider') | 58 | 182.57 MB | 30 Jun 2020 - 21:02 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 949 | 8.29 GB | 30 Jun 2020 - 21:01 |
Java (Often spam bot) | 196 | 4.81 GB | 30 Jun 2020 - 21:01 |
AhrefsBot | 7,910 | 276.85 GB | 30 Jun 2020 - 21:01 |
SemrushBot | 7,561 | 465.85 GB | 30 Jun 2020 - 20:58 |
Bingbot | 1,132 | 9.86 GB | 30 Jun 2020 - 20:55 |
FaceBook bot | 61 | 332.09 MB | 30 Jun 2020 - 20:52 |
Yandex Bot | 759 | 36.78 GB | 30 Jun 2020 - 20:50 |
Googlebot | 1,811 | 34.41 GB | 30 Jun 2020 - 20:13 |
DotBot, Open Site Explorer | 305 | 8.01 GB | 30 Jun 2020 - 20:13 |
Feedfetcher-Google | 30 | 9.64 KB | 30 Jun 2020 - 19:48 |
FavIconizer | 419 | 3.20 GB | 30 Jun 2020 - 19:37 |
rpt-httpclient | 59 | 380.53 MB | 30 Jun 2020 - 19:24 |
Python-urllib | 35 | 550.41 MB | 30 Jun 2020 - 18:52 |
Unknown robot (identified by 'crawl') | 3,490 | 97.17 GB | 30 Jun 2020 - 17:54 |
SEOkicks Webcrawler | 1,048 | 16.00 GB | 30 Jun 2020 - 17:28 |
BaiDuSpider | 38 | 1.19 GB | 30 Jun 2020 - 16:12 |
Suspected bot masqurading as Mozilla | 29 | 0 | 30 Jun 2020 - 16:11 |
SeznamBot | 25 | 488.00 MB | 30 Jun 2020 - 16:05 |
CFNetwork | 3,224 | 947.18 MB | 30 Jun 2020 - 15:20 |
MJ12bot | 267 | 4.06 GB | 30 Jun 2020 - 14:13 |
Unknown robot (identified by 'checker') | 2 | 7.39 KB | 30 Jun 2020 - 13:38 |
LinkChecker | 164 | 0 | 30 Jun 2020 - 13:16 |
Google Web Preview | 73 | 528.60 MB | 30 Jun 2020 - 13:03 |
Cliqzbot | 15 | 101.42 MB | 30 Jun 2020 - 11:00 |
WGet tools | 81 | 3.98 GB | 30 Jun 2020 - 10:08 |
Bing Preview bot | 38 | 1.55 GB | 30 Jun 2020 - 00:29 |
Web Core / Roots | 108 | 7.21 GB | 30 Jun 2020 - 00:20 |
Perl tool | 42 | 891.55 KB | 29 Jun 2020 - 22:00 |
Unknown robot (identified by empty user agent string) | 260 | 15.65 GB | 29 Jun 2020 - 11:20 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 484 | 39.10 MB | 29 Jun 2020 - 05:06 |
Sogou Spider | 18 | 82.14 MB | 28 Jun 2020 - 19:14 |
Motor | 11 | 141.78 MB | 28 Jun 2020 - 18:26 |
Alexa (IA Archiver) | 18 | 79.51 KB | 28 Jun 2020 - 06:22 |
Suspected bot masqurading as Mozilla | 6 | 0 | 28 Jun 2020 - 00:37 |
MojeekBot | 1 | 9.76 KB | 27 Jun 2020 - 03:47 |
WordPress | 17 | 277.76 MB | 25 Jun 2020 - 06:03 |
WWWC Ver 0.2.5 | 1 | 0 | 24 Jun 2020 - 17:42 |
ltx71 | 5 | 229.55 MB | 23 Jun 2020 - 21:06 |
HTTrack off-line browser | 2 | 405.43 MB | 22 Jun 2020 - 01:47 |
Mail.ru bot | 5 | 2.20 MB | 21 Jun 2020 - 02:39 |
twitterbot | 2 | 14.94 MB | 20 Jun 2020 - 18:00 |
Unknown robot (identified by 'robot') | 4 | 25.99 KB | 20 Jun 2020 - 02:48 |
Google AdSense | 1 | 3.50 KB | 12 Jun 2020 - 17:24 |
Unknown robot (identified by 'sucker') | 2 | 15.34 MB | 11 Jun 2020 - 03:34 |
yeti | 1 | 7.70 MB | 11 Jun 2020 - 01:56 |
ning | 2 | 138.88 MB | 09 Jun 2020 - 02:40 |
360spider | 1 | 117.06 MB | 08 Jun 2020 - 09:19 |
Common Crawl | 30 | 21.20 MB | 07 Jun 2020 - 10:27 |
SMTBot | 1 | 7.45 MB | 06 Jun 2020 - 21:44 |
Sift | 1 | 7.73 MB | 04 Jun 2020 - 07:29 |
Turn It In | 2 | 214.75 MB | 03 Jun 2020 - 12:27 |