52 different robots | Hits | Bandwidth | Last visit |
Web Core / Roots | 1,286 | 1.88 GB | 30 Jun 2021 - 23:06 |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,326 | 101.53 GB | 30 Jun 2021 - 23:05 |
SemrushBot | 4,242 | 327.63 GB | 30 Jun 2021 - 23:02 |
Googlebot | 1,044 | 10.57 GB | 30 Jun 2021 - 22:59 |
AhrefsBot | 5,577 | 132.52 GB | 30 Jun 2021 - 22:51 |
DotBot, Open Site Explorer | 556 | 2.12 GB | 30 Jun 2021 - 22:51 |
Bingbot | 4,630 | 90.88 GB | 30 Jun 2021 - 22:49 |
Yandex Bot | 232 | 5.49 GB | 30 Jun 2021 - 22:27 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,949 | 161.85 GB | 30 Jun 2021 - 22:21 |
yeti | 23 | 177.13 MB | 30 Jun 2021 - 22:08 |
MJ12bot | 274 | 10.56 GB | 30 Jun 2021 - 21:04 |
Unknown robot (identified by empty user agent string) | 812 | 19.26 GB | 30 Jun 2021 - 20:19 |
Google Web Preview | 121 | 5.06 GB | 30 Jun 2021 - 20:14 |
ltx71 | 88 | 9.94 GB | 30 Jun 2021 - 20:12 |
LinkChecker | 140 | 0 | 30 Jun 2021 - 19:45 |
BaiDuSpider | 14 | 162.20 MB | 30 Jun 2021 - 19:25 |
Python-urllib | 10 | 2.35 GB | 30 Jun 2021 - 19:23 |
Java (Often spam bot) | 90 | 1.81 GB | 30 Jun 2021 - 19:18 |
Unknown robot (identified by 'crawl') | 4,289 | 291.66 GB | 30 Jun 2021 - 17:52 |
Unknown robot (identified by 'spider') | 123 | 603.12 MB | 30 Jun 2021 - 13:21 |
WGet tools | 131 | 2.49 GB | 30 Jun 2021 - 09:57 |
FaceBook bot | 34 | 128.09 MB | 30 Jun 2021 - 05:12 |
Bing Preview bot | 17 | 1.03 GB | 30 Jun 2021 - 04:15 |
Perl tool | 533 | 2.14 MB | 30 Jun 2021 - 02:53 |
SeznamBot | 17 | 29.78 MB | 30 Jun 2021 - 02:21 |
Mail.ru bot | 16 | 84.03 MB | 30 Jun 2021 - 01:13 |
Motor | 7 | 55.45 MB | 29 Jun 2021 - 17:21 |
TestBot | 5 | 7.93 MB | 29 Jun 2021 - 15:11 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 913 | 268.71 MB | 29 Jun 2021 - 09:36 |
Y!J Yahoo Japan | 1 | 8.11 MB | 25 Jun 2021 - 10:38 |
Unknown robot (identified by 'robot') | 65 | 2.05 GB | 25 Jun 2021 - 06:51 |
Google AdSense | 3 | 174.23 MB | 24 Jun 2021 - 10:26 |
YaCy | 1 | 3.57 KB | 24 Jun 2021 - 01:50 |
rpt-httpclient | 3 | 228.32 MB | 23 Jun 2021 - 19:29 |
Common Crawl | 48 | 7.42 MB | 23 Jun 2021 - 11:14 |
WordPress | 3 | 747.38 KB | 23 Jun 2021 - 08:19 |
Suspected bot masqurading as Mozilla | 3 | 0 | 23 Jun 2021 - 02:44 |
twitterbot | 6 | 214.04 MB | 22 Jun 2021 - 12:45 |
Phantom | 1 | 70.06 MB | 22 Jun 2021 - 09:52 |
Sogou Spider | 6 | 4.64 MB | 21 Jun 2021 - 22:02 |
CFNetwork | 6 | 235.78 MB | 20 Jun 2021 - 11:52 |
HTTrack off-line browser | 8 | 452.01 MB | 17 Jun 2021 - 03:36 |
SEOkicks Webcrawler | 4 | 12.21 KB | 16 Jun 2021 - 16:32 |
360spider | 2 | 7.38 KB | 16 Jun 2021 - 07:53 |
AdsBot-Google | 2 | 15.06 MB | 14 Jun 2021 - 11:55 |
ichiro | 2 | 6.17 KB | 11 Jun 2021 - 00:08 |
MojeekBot | 1 | 3.17 KB | 09 Jun 2021 - 18:51 |
Fish search | 1 | 398.31 MB | 08 Jun 2021 - 02:01 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 106.61 MB | 07 Jun 2021 - 19:39 |
ning | 2 | 243.68 MB | 06 Jun 2021 - 19:05 |
Unknown robot (identified by 'checker') | 53 | 1.93 GB | 05 Jun 2021 - 11:15 |
archive.org bot | 1 | 3.30 KB | 03 Jun 2021 - 13:15 |
|