42 different robots | Hits | Bandwidth | Last visit |
WGet tools | 360,891+4 | 1004.78 GB | 31 Oct 2021 - 20:01 |
AhrefsBot | 24,024 | 379.68 GB | 31 Oct 2021 - 21:10 |
Bingbot | 11,873 | 21.74 GB | 31 Oct 2021 - 21:06 |
DotBot, Open Site Explorer | 8,755 | 19.94 GB | 31 Oct 2021 - 20:39 |
SemrushBot | 7,498 | 79.10 GB | 31 Oct 2021 - 21:10 |
Common *nix tool for automating web document retireval. Most likely a bot. | 5,318 | 569.70 GB | 31 Oct 2021 - 21:05 |
Unknown robot (identified by 'crawl') | 3,991 | 13.76 GB | 31 Oct 2021 - 20:12 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,709 | 107.70 GB | 31 Oct 2021 - 19:25 |
Common Crawl | 2,113 | 9.01 MB | 28 Oct 2021 - 21:59 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,660 | 206.26 MB | 31 Oct 2021 - 19:51 |
Unknown robot (identified by empty user agent string) | 888 | 80.72 GB | 31 Oct 2021 - 20:37 |
Python-urllib | 857 | 265.69 GB | 31 Oct 2021 - 14:00 |
Suspected bot masqurading as Mozilla | 789 | 22.42 GB | 31 Oct 2021 - 21:02 |
Yandex Bot | 660 | 3.96 GB | 31 Oct 2021 - 20:58 |
MJ12bot | 574 | 603.32 MB | 31 Oct 2021 - 10:03 |
CFNetwork | 466 | 15.24 GB | 31 Oct 2021 - 19:40 |
LinkChecker | 329 | 203.70 MB | 31 Oct 2021 - 17:35 |
Perl tool | 313 | 42.37 GB | 31 Oct 2021 - 18:10 |
Googlebot | 297 | 129.79 MB | 31 Oct 2021 - 03:52 |
Java (Often spam bot) | 116 | 49.27 GB | 31 Oct 2021 - 11:00 |
Unknown robot (identified by 'spider') | 107 | 192.05 MB | 31 Oct 2021 - 20:31 |
Web Core / Roots | 49 | 1.32 GB | 30 Oct 2021 - 18:38 |
Google AdSense | 39 | 42.93 MB | 06 Oct 2021 - 17:56 |
Jakarta commons-httpclient | 32 | 512 Bytes | 31 Oct 2021 - 14:03 |
Alexa (IA Archiver) | 27 | 19.18 MB | 01 Oct 2021 - 17:34 |
SeznamBot | 16 | 71.58 KB | 31 Oct 2021 - 19:39 |
BaiDuSpider | 15 | 246.88 MB | 31 Oct 2021 - 04:58 |
WordPress | 8 | 3.46 KB | 17 Oct 2021 - 09:50 |
archive.org bot | 8 | 251.13 MB | 25 Oct 2021 - 05:54 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 7 | 22.42 MB | 30 Oct 2021 - 01:24 |
YaCy | 4 | 1.77 MB | 05 Oct 2021 - 16:23 |
Xenu's Link Sleuth (TM), see Wikipedia | 4 | 0 | 27 Oct 2021 - 11:56 |
Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 22 Oct 2021 - 09:41 |
ltx71 | 2 | 78.72 KB | 31 Oct 2021 - 15:00 |
Suspected bot masqurading as Mozilla | 2 | 0 | 28 Oct 2021 - 18:09 |
Bing Preview bot | 2 | 38.55 MB | 15 Oct 2021 - 03:17 |
HTTrack off-line browser | 2 | 904.00 KB | 21 Oct 2021 - 16:50 |
Nutch | 2 | 30.78 MB | 05 Oct 2021 - 18:13 |
SEOkicks Webcrawler | 1 | 7.00 KB | 05 Oct 2021 - 02:47 |
Simmany Robot Ver1.0 | 1 | 3.46 KB | 08 Oct 2021 - 13:28 |
twitterbot | 1 | 29.10 MB | 07 Oct 2021 - 08:47 |
Unknown robot (identified by 'robot') | 1 | 7.96 KB | 12 Oct 2021 - 18:50 |
|