48 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 51,709+4 | 606.78 GB | 31 Jul 2019 - 06:01 |
Unknown robot (identified by empty user agent string) | 8,464 | 296.91 GB | 31 Jul 2019 - 22:52 |
WGet tools | 6,234 | 738.93 GB | 31 Jul 2019 - 20:00 |
Yandex Bot | 6,168 | 1355.58 GB | 31 Jul 2019 - 22:50 |
SemrushBot | 4,684 | 19.47 GB | 31 Jul 2019 - 23:09 |
AhrefsBot | 3,096 | 1090.49 GB | 31 Jul 2019 - 22:09 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,741 | 347.87 MB | 31 Jul 2019 - 11:04 |
BaiDuSpider | 1,136 | 1.74 GB | 31 Jul 2019 - 23:04 |
Common *nix tool for automating web document retireval. Most likely a bot. | 1,078 | 90.68 GB | 31 Jul 2019 - 22:00 |
Java (Often spam bot) | 438 | 55.71 GB | 31 Jul 2019 - 16:02 |
Bingbot | 303 | 4.66 GB | 31 Jul 2019 - 19:54 |
Python-urllib | 274 | 119.72 GB | 31 Jul 2019 - 14:00 |
Googlebot | 239 | 17.24 GB | 31 Jul 2019 - 19:39 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 225 | 22.98 MB | 31 Jul 2019 - 20:57 |
MJ12bot | 195 | 29.17 MB | 31 Jul 2019 - 21:36 |
Perl tool | 179 | 4.23 MB | 31 Jul 2019 - 17:50 |
LinkChecker | 118 | 0 | 31 Jul 2019 - 22:14 |
DotBot, Open Site Explorer | 103 | 1.24 GB | 31 Jul 2019 - 17:24 |
ltx71 | 55 | 17.42 GB | 29 Jul 2019 - 15:33 |
Unknown robot (identified by 'spider') | 48 | 141.99 MB | 31 Jul 2019 - 17:20 |
Jakarta commons-httpclient | 35 | 560 Bytes | 31 Jul 2019 - 08:01 |
Exabot | 33 | 345.89 KB | 31 Jul 2019 - 00:11 |
CFNetwork | 27 | 581.35 MB | 31 Jul 2019 - 12:48 |
Alexa (IA Archiver) | 18 | 196.67 KB | 29 Jul 2019 - 09:40 |
Common Crawl | 16 | 187.13 KB | 24 Jul 2019 - 08:26 |
Suspected bot masqurading as Mozilla | 12 | 207.01 MB | 28 Jul 2019 - 12:22 |
archive.org bot | 10 | 243.27 MB | 31 Jul 2019 - 09:50 |
Web Core / Roots | 7 | 189.85 MB | 30 Jul 2019 - 18:50 |
Sogou Spider | 7 | 12.14 MB | 18 Jul 2019 - 18:07 |
Mail.ru bot | 6 | 20.75 KB | 31 Jul 2019 - 12:07 |
SeznamBot | 5 | 19.12 KB | 26 Jul 2019 - 06:45 |
Cliqzbot | 4 | 13.70 KB | 01 Jul 2019 - 09:47 |
GigaBot | 3 | 10.45 KB | 27 Jul 2019 - 01:09 |
FaceBook bot | 3 | 21.73 MB | 28 Jul 2019 - 08:28 |
Unknown robot (identified by hit on 'robots.txt') | 0+3 | 12.48 KB | 28 Jul 2019 - 15:58 |
FavIconizer | 2 | 54.24 MB | 28 Jul 2019 - 02:20 |
Suspected bot masqurading as Mozilla | 2 | 11.38 KB | 24 Jul 2019 - 08:50 |
YaCy | 2 | 804.21 KB | 02 Jul 2019 - 07:21 |
Bing Preview bot | 2 | 54.24 MB | 25 Jul 2019 - 11:01 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 3.28 KB | 25 Jul 2019 - 07:37 |
oBot | 1 | 16.49 MB | 05 Jul 2019 - 19:22 |
ning | 1 | 27.12 MB | 30 Jul 2019 - 19:48 |
Unknown robot (identified by 'robot') | 1 | 8.04 KB | 08 Jul 2019 - 14:28 |
DragonBot | 1 | 3.46 KB | 26 Jul 2019 - 18:24 |
Google AdSense | 1 | 1.45 MB | 16 Jul 2019 - 13:08 |
360spider | 1 | 16.75 MB | 09 Jul 2019 - 22:28 |
Nutch | 1 | 3.17 MB | 20 Jul 2019 - 12:25 |
twitterbot | 1 | 27.12 MB | 29 Jul 2019 - 20:53 |