33 different robots | Hits | Bandwidth | Last visit |
WGet tools | 2,477,993 | 921.69 GB | 31 May 2023 - 18:11 |
Python-urllib | 55,749 | 51.26 GB | 31 May 2023 - 17:42 |
Unknown robot (identified by 'crawl') | 55,308 | 2.79 GB | 30 May 2023 - 09:30 |
Bingbot | 49,612 | 8.02 GB | 31 May 2023 - 18:08 |
Unknown robot (identified by 'spider') | 43,878 | 37.68 GB | 31 May 2023 - 16:35 |
Perl tool | 33,723 | 58.70 GB | 31 May 2023 - 16:29 |
SemrushBot | 32,562 | 384.57 MB | 31 May 2023 - 17:55 |
Suspected bot masqurading as Mozilla | 30,114 | 18.46 MB | 31 May 2023 - 18:09 |
MJ12bot | 29,882 | 195.79 GB | 31 May 2023 - 18:11 |
DotBot, Open Site Explorer | 27,868 | 7.04 GB | 31 May 2023 - 18:07 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 24,639 | 2.53 GB | 31 May 2023 - 15:20 |
Common *nix tool for automating web document retireval. Most likely a bot. | 2,827 | 1.47 GB | 31 May 2023 - 17:40 |
Unknown robot (identified by empty user agent string) | 2,105 | 883.94 MB | 31 May 2023 - 16:31 |
Web Core / Roots | 935 | 338.27 MB | 31 May 2023 - 05:03 |
Common Crawl | 351 | 1.96 MB | 29 May 2023 - 19:59 |
Yandex Bot | 348 | 431.37 MB | 31 May 2023 - 18:03 |
Googlebot | 304 | 46.70 MB | 31 May 2023 - 17:25 |
Java (Often spam bot) | 209 | 4.51 MB | 30 May 2023 - 19:12 |
FaceBook bot | 181 | 7.89 MB | 31 May 2023 - 13:53 |
AhrefsBot | 97 | 2.80 MB | 31 May 2023 - 16:16 |
Unknown robot (identified by 'robot') | 80 | 360.46 KB | 31 May 2023 - 08:43 |
WordPress | 80 | 350.02 KB | 31 May 2023 - 12:24 |
BaiDuSpider | 60 | 202.69 KB | 31 May 2023 - 00:06 |
twitterbot | 11 | 49.73 KB | 31 May 2023 - 13:35 |
360spider | 3 | 13.49 KB | 26 May 2023 - 06:03 |
ning | 3 | 0 | 25 May 2023 - 08:32 |
Grapeshot Crawler | 3 | 13.49 KB | 23 May 2023 - 14:45 |
SeznamBot | 3 | 13.56 KB | 30 May 2023 - 17:22 |
Sogou Spider | 3 | 13.24 KB | 23 May 2023 - 16:17 |
YaCy | 2 | 5.51 KB | 07 May 2023 - 15:59 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 2 | 8.87 KB | 18 May 2023 - 20:38 |
yeti | 2 | 9.06 KB | 24 May 2023 - 15:43 |
NG 2.x (Exalead) | 1 | 4.57 KB | 22 May 2023 - 10:12 |
|