46 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 10,652 | 37.20 GB | 30 Apr 2022 - 22:17 |
AhrefsBot | 7,945 | 105.91 GB | 30 Apr 2022 - 22:48 |
SemrushBot | 4,214 | 343.86 GB | 30 Apr 2022 - 23:07 |
Unknown robot (identified by 'crawl') | 2,859 | 168.77 GB | 30 Apr 2022 - 15:52 |
Web Core / Roots | 2,631 | 7.42 GB | 30 Apr 2022 - 23:08 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,658 | 59.06 GB | 30 Apr 2022 - 22:48 |
Bingbot | 1,301 | 20.75 GB | 30 Apr 2022 - 23:02 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,111 | 226.60 MB | 30 Apr 2022 - 06:25 |
Googlebot | 1,057 | 14.07 GB | 30 Apr 2022 - 22:46 |
Yandex Bot | 952 | 43.80 GB | 30 Apr 2022 - 22:58 |
Perl tool | 739 | 296.46 MB | 30 Apr 2022 - 02:46 |
WGet tools | 635 | 9.72 GB | 30 Apr 2022 - 02:46 |
MJ12bot | 552 | 42.69 GB | 30 Apr 2022 - 04:48 |
DotBot, Open Site Explorer | 527 | 8.27 GB | 30 Apr 2022 - 22:08 |
Python-urllib | 418 | 2.01 GB | 27 Apr 2022 - 00:12 |
Unknown robot (identified by 'spider') | 224 | 10.65 GB | 30 Apr 2022 - 05:43 |
Unknown robot (identified by empty user agent string) | 152 | 12.12 GB | 30 Apr 2022 - 20:17 |
LinkChecker | 131 | 0 | 30 Apr 2022 - 16:57 |
Unknown robot (identified by 'robot') | 117 | 5.50 GB | 30 Apr 2022 - 17:01 |
Java (Often spam bot) | 115 | 1.22 GB | 30 Apr 2022 - 20:18 |
Google Web Preview | 90 | 956.68 MB | 30 Apr 2022 - 13:47 |
Sogou Spider | 79 | 591.99 MB | 24 Apr 2022 - 19:40 |
rpt-httpclient | 54 | 76.11 MB | 30 Apr 2022 - 18:12 |
FaceBook bot | 53 | 579.90 MB | 30 Apr 2022 - 12:21 |
BaiDuSpider | 43 | 1.39 GB | 30 Apr 2022 - 06:42 |
Bing Preview bot | 38 | 3.69 GB | 29 Apr 2022 - 15:43 |
Heritrix | 24 | 8.08 MB | 23 Apr 2022 - 18:52 |
WordPress | 15 | 0 | 29 Apr 2022 - 12:49 |
CFNetwork | 12 | 172.54 MB | 30 Apr 2022 - 05:31 |
SeznamBot | 10 | 50.10 KB | 30 Apr 2022 - 01:29 |
yeti | 9 | 64.01 MB | 28 Apr 2022 - 22:17 |
twitterbot | 5 | 7.47 MB | 25 Apr 2022 - 00:19 |
Nutch | 4 | 40.61 KB | 26 Apr 2022 - 00:38 |
YaCy | 3 | 8.64 KB | 16 Apr 2022 - 04:58 |
Suspected bot masqurading as Mozilla | 3 | 0 | 29 Apr 2022 - 04:33 |
archive.org bot | 3 | 17.71 KB | 24 Apr 2022 - 16:08 |
SEOkicks Webcrawler | 2 | 6.17 KB | 24 Apr 2022 - 22:13 |
MojeekBot | 2 | 29.85 KB | 26 Apr 2022 - 06:59 |
Suspected bot masqurading as Mozilla | 2 | 41.13 KB | 21 Apr 2022 - 09:42 |
MSNBot | 1 | 3.57 KB | 25 Apr 2022 - 23:56 |
W3C Validator | 1 | 2.47 KB | 15 Apr 2022 - 15:01 |
microsoft-webdav-miniredir | 1 | 0 | 07 Apr 2022 - 19:07 |
Mail.ru bot | 1 | 7.92 MB | 12 Apr 2022 - 04:41 |
Y!J Yahoo Japan | 1 | 8.11 MB | 04 Apr 2022 - 01:23 |
Motor | 1 | 7.46 MB | 03 Apr 2022 - 20:59 |
Yahoo Slurp | 1 | 7.56 KB | 11 Apr 2022 - 08:50 |
|