42 different robots | Hits | Bandwidth | Last visit |
WGet tools | 29,558 | 1062.53 GB | 30 Jun 2022 - 20:01 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 11,777 | 120.10 GB | 30 Jun 2022 - 23:48 |
AhrefsBot | 10,514 | 27.20 GB | 30 Jun 2022 - 23:57 |
Bingbot | 7,543 | 5.04 GB | 30 Jun 2022 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 6,710 | 826.35 GB | 30 Jun 2022 - 23:30 |
Java (Often spam bot) | 6,504 | 79.78 GB | 30 Jun 2022 - 18:26 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 4,450+1 | 232.01 MB | 30 Jun 2022 - 12:54 |
DotBot, Open Site Explorer | 3,705 | 28.49 GB | 30 Jun 2022 - 23:26 |
Unknown robot (identified by 'crawl') | 3,305 | 12.72 GB | 30 Jun 2022 - 06:19 |
SemrushBot | 2,311 | 12.63 GB | 30 Jun 2022 - 23:49 |
Suspected bot masqurading as Mozilla | 1,037 | 30.55 GB | 30 Jun 2022 - 22:00 |
Unknown robot (identified by empty user agent string) | 680 | 50.74 GB | 30 Jun 2022 - 22:14 |
MJ12bot | 657 | 1.62 GB | 30 Jun 2022 - 03:35 |
CFNetwork | 602 | 19.96 GB | 30 Jun 2022 - 20:28 |
Python-urllib | 599 | 393.45 GB | 30 Jun 2022 - 16:31 |
Googlebot | 389 | 420.52 MB | 30 Jun 2022 - 19:24 |
LinkChecker | 348 | 116.40 MB | 30 Jun 2022 - 23:44 |
Perl tool | 144 | 63.31 GB | 30 Jun 2022 - 20:28 |
Yandex Bot | 128 | 2.10 GB | 30 Jun 2022 - 22:37 |
Web Core / Roots | 119 | 2.30 GB | 30 Jun 2022 - 02:04 |
Common Crawl | 109 | 265.64 KB | 30 Jun 2022 - 07:06 |
Unknown robot (identified by 'robot') | 69 | 592.45 KB | 30 Jun 2022 - 12:40 |
BaiDuSpider | 46 | 408.88 MB | 29 Jun 2022 - 23:21 |
Unknown robot (identified by 'spider') | 46 | 41.64 MB | 21 Jun 2022 - 04:16 |
Jakarta commons-httpclient | 33 | 528 Bytes | 30 Jun 2022 - 14:04 |
WordPress | 21 | 74.05 MB | 16 Jun 2022 - 16:00 |
archive.org bot | 17 | 433.70 MB | 27 Jun 2022 - 00:36 |
Suspected bot masqurading as Mozilla | 10 | 662.23 KB | 13 Jun 2022 - 09:51 |
SeznamBot | 9 | 33.39 KB | 26 Jun 2022 - 01:28 |
FaceBook bot | 4 | 70.13 MB | 22 Jun 2022 - 11:27 |
twitterbot | 3 | 60.30 MB | 25 Jun 2022 - 19:03 |
MSNBot | 3 | 12.36 KB | 29 Jun 2022 - 23:50 |
Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 23 Jun 2022 - 14:16 |
Bing Preview bot | 2 | 13.48 MB | 09 Jun 2022 - 13:55 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 06 Jun 2022 - 07:24 |
yeti | 1 | 30.15 MB | 16 Jun 2022 - 03:31 |
Microsoft URL Control | 1 | 2.61 KB | 19 Jun 2022 - 07:02 |
MojeekBot | 1 | 1.24 MB | 08 Jun 2022 - 13:58 |
Google Web Preview | 1 | 7.00 KB | 25 Jun 2022 - 16:37 |
Feedburner | 1 | 0 | 03 Jun 2022 - 08:50 |
Yahoo Slurp | 1 | 7.00 KB | 13 Jun 2022 - 08:06 |
Suspected bot masqurading as Mozilla | 1 | 8.04 KB | 13 Jun 2022 - 05:34 |
|