43 different robots | Hits | Bandwidth | Last visit |
AhrefsBot | 18,965 | 109.18 GB | 31 Jan 2022 - 23:33 |
DotBot, Open Site Explorer | 8,765 | 20.08 GB | 31 Jan 2022 - 23:45 |
Common *nix tool for automating web document retireval. Most likely a bot. | 8,334 | 1009.58 GB | 31 Jan 2022 - 23:59 |
SemrushBot | 6,317 | 69.33 GB | 31 Jan 2022 - 23:55 |
WGet tools | 5,819 | 971.20 GB | 31 Jan 2022 - 20:05 |
Java (Often spam bot) | 4,286 | 92.66 GB | 31 Jan 2022 - 22:41 |
Unknown robot (identified by 'crawl') | 4,186 | 15.65 GB | 30 Jan 2022 - 06:36 |
Bingbot | 3,240 | 8.71 GB | 31 Jan 2022 - 22:43 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,257 | 14.40 GB | 31 Jan 2022 - 23:55 |
Unknown robot (identified by empty user agent string) | 1,390 | 93.54 GB | 31 Jan 2022 - 21:41 |
Suspected bot masqurading as Mozilla | 1,332 | 43.81 GB | 31 Jan 2022 - 22:14 |
MJ12bot | 776 | 666.33 MB | 31 Jan 2022 - 21:51 |
Python-urllib | 727 | 383.60 GB | 31 Jan 2022 - 22:29 |
CFNetwork | 720 | 27.37 GB | 31 Jan 2022 - 23:11 |
Common Crawl | 579 | 114.58 MB | 29 Jan 2022 - 08:55 |
Yandex Bot | 540 | 6.61 GB | 31 Jan 2022 - 23:07 |
LinkChecker | 382 | 0 | 31 Jan 2022 - 22:16 |
Perl tool | 282 | 17.24 MB | 31 Jan 2022 - 23:51 |
Googlebot | 220 | 135.50 MB | 31 Jan 2022 - 21:04 |
Web Core / Roots | 151 | 3.38 GB | 31 Jan 2022 - 06:51 |
ltx71 | 136 | 1.16 GB | 31 Jan 2022 - 22:34 |
Unknown robot (identified by 'spider') | 66 | 23.64 MB | 27 Jan 2022 - 03:58 |
Unknown robot (identified by 'robot') | 34 | 277.89 MB | 29 Jan 2022 - 14:04 |
Heritrix | 32 | 73.18 MB | 31 Jan 2022 - 03:53 |
Jakarta commons-httpclient | 29 | 464 Bytes | 31 Jan 2022 - 15:05 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 28 | 106.19 MB | 25 Jan 2022 - 10:41 |
WordPress | 22 | 32.97 MB | 16 Jan 2022 - 00:43 |
BaiDuSpider | 12 | 23.35 MB | 30 Jan 2022 - 04:22 |
FaceBook bot | 11 | 87.73 KB | 13 Jan 2022 - 19:27 |
SeznamBot | 9 | 420.67 KB | 20 Jan 2022 - 21:12 |
archive.org bot | 9 | 218.26 MB | 30 Jan 2022 - 12:52 |
MojeekBot | 6 | 654.04 KB | 01 Jan 2022 - 14:06 |
Xenu's Link Sleuth (TM), see Wikipedia | 6 | 67.48 MB | 25 Jan 2022 - 14:02 |
Suspected bot masqurading as Mozilla | 5 | 116.56 MB | 31 Jan 2022 - 08:00 |
Google AdSense | 4 | 78.88 MB | 14 Jan 2022 - 14:16 |
Alexa (IA Archiver) | 4 | 97.60 MB | 20 Jan 2022 - 09:58 |
Bing Preview bot | 3 | 28.34 MB | 14 Jan 2022 - 16:42 |
YaCy | 3 | 1.23 MB | 29 Jan 2022 - 22:25 |
Feedburner | 2 | 0 | 23 Jan 2022 - 16:13 |
twitterbot | 1 | 33.74 MB | 24 Jan 2022 - 04:06 |
Mail.ru bot | 1 | 134.94 KB | 24 Jan 2022 - 05:13 |
HTTrack off-line browser | 1 | 1.60 MB | 31 Jan 2022 - 17:09 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 14 Jan 2022 - 00:54 |
|