46 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 16,174 | 116.77 GB | 31 Jan 2022 - 23:48 |
AhrefsBot | 7,017 | 84.73 GB | 31 Jan 2022 - 23:39 |
SemrushBot | 4,570 | 382.60 GB | 31 Jan 2022 - 23:49 |
Unknown robot (identified by 'crawl') | 3,581 | 208.02 GB | 31 Jan 2022 - 17:46 |
Web Core / Roots | 2,447 | 10.46 GB | 31 Jan 2022 - 23:08 |
Googlebot | 1,633 | 20.76 GB | 31 Jan 2022 - 23:21 |
Bingbot | 1,325 | 24.67 GB | 31 Jan 2022 - 23:07 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 991 | 21.78 GB | 31 Jan 2022 - 23:58 |
Perl tool | 759 | 3.04 MB | 31 Jan 2022 - 03:48 |
Yandex Bot | 540 | 14.23 GB | 31 Jan 2022 - 16:39 |
WGet tools | 520 | 37.97 GB | 31 Jan 2022 - 03:48 |
DotBot, Open Site Explorer | 494 | 9.36 GB | 31 Jan 2022 - 23:54 |
Unknown robot (identified by empty user agent string) | 287 | 19.77 GB | 31 Jan 2022 - 23:10 |
Unknown robot (identified by 'spider') | 250 | 15.05 GB | 31 Jan 2022 - 00:04 |
MJ12bot | 248 | 3.41 GB | 31 Jan 2022 - 21:50 |
Common Crawl | 192 | 380.35 MB | 28 Jan 2022 - 17:35 |
FaceBook bot | 155 | 1.94 GB | 31 Jan 2022 - 20:49 |
LinkChecker | 140 | 0 | 31 Jan 2022 - 23:06 |
Unknown robot (identified by 'robot') | 134 | 139.40 MB | 30 Jan 2022 - 18:04 |
Google Web Preview | 104 | 1.44 GB | 31 Jan 2022 - 15:42 |
Java (Often spam bot) | 87 | 4.05 GB | 31 Jan 2022 - 22:34 |
ltx71 | 69 | 6.30 GB | 31 Jan 2022 - 11:52 |
Bing Preview bot | 57 | 4.49 GB | 31 Jan 2022 - 20:40 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 51 | 357.53 MB | 31 Jan 2022 - 23:21 |
rpt-httpclient | 49 | 152.21 MB | 31 Jan 2022 - 23:51 |
WordPress | 38 | 1.19 GB | 29 Jan 2022 - 03:04 |
Heritrix | 21 | 161.93 KB | 21 Jan 2022 - 02:17 |
Python-urllib | 18 | 1.24 GB | 27 Jan 2022 - 11:29 |
BaiDuSpider | 18 | 619.67 MB | 29 Jan 2022 - 21:18 |
Sogou Spider | 16 | 54.24 MB | 31 Jan 2022 - 17:29 |
Mail.ru bot | 15 | 102.27 MB | 20 Jan 2022 - 03:21 |
SeznamBot | 14 | 70.27 KB | 28 Jan 2022 - 12:40 |
FavIconizer | 13 | 454.15 MB | 15 Jan 2022 - 12:03 |
ning | 9 | 320.17 MB | 03 Jan 2022 - 17:34 |
Motor | 8 | 446.68 MB | 24 Jan 2022 - 08:57 |
CFNetwork | 7 | 40.33 MB | 30 Jan 2022 - 19:46 |
twitterbot | 6 | 505.81 MB | 29 Jan 2022 - 19:06 |
yeti | 5 | 39.92 MB | 30 Jan 2022 - 19:25 |
Nutch | 4 | 40.67 KB | 22 Jan 2022 - 11:25 |
Fish search | 3 | 236.38 MB | 24 Jan 2022 - 08:54 |
Suspected bot masqurading as Mozilla | 2 | 0 | 29 Jan 2022 - 04:01 |
Exabot | 2 | 16.76 MB | 02 Jan 2022 - 18:20 |
WWWC Ver 0.2.5 | 1 | 3.30 KB | 04 Jan 2022 - 05:01 |
archive.org bot | 1 | 13.83 KB | 20 Jan 2022 - 13:48 |
Cfetch | 1 | 8.65 MB | 07 Jan 2022 - 16:30 |
Phantom | 1 | 8.11 MB | 28 Jan 2022 - 08:47 |
|