41 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 38,023+5 | 255.95 GB | 30 Apr 2019 - 23:56 |
Unknown robot (identified by empty user agent string) | 7,340 | 227.52 GB | 30 Apr 2019 - 20:18 |
AhrefsBot | 3,141+1 | 708.34 GB | 30 Apr 2019 - 22:45 |
Yandex Bot | 2,346+1 | 305.66 GB | 30 Apr 2019 - 23:23 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,670+2 | 453.72 MB | 30 Apr 2019 - 13:31 |
BaiDuSpider | 1,609 | 2.43 GB | 30 Apr 2019 - 18:04 |
Bingbot | 1,403 | 28.83 GB | 30 Apr 2019 - 21:43 |
WGet tools | 1,285 | 668.83 GB | 30 Apr 2019 - 23:30 |
Common *nix tool for automating web document retireval. Most likely a bot. | 1,141 | 147.02 GB | 30 Apr 2019 - 23:58 |
SemrushBot | 717 | 535.73 MB | 30 Apr 2019 - 23:33 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 456 | 2.51 GB | 30 Apr 2019 - 13:58 |
Googlebot | 308 | 28.99 GB | 30 Apr 2019 - 03:32 |
Python-urllib | 283 | 102.18 GB | 30 Apr 2019 - 17:29 |
Perl tool | 208 | 4.66 MB | 30 Apr 2019 - 23:55 |
Java (Often spam bot) | 174 | 28.90 GB | 30 Apr 2019 - 23:27 |
DotBot, Open Site Explorer | 100 | 1.21 GB | 30 Apr 2019 - 21:53 |
Y!J Yahoo Japan | 94 | 20.70 GB | 11 Apr 2019 - 13:42 |
ltx71 | 87 | 678.58 MB | 29 Apr 2019 - 22:13 |
Common Crawl | 71 | 7.97 GB | 25 Apr 2019 - 17:47 |
LinkChecker | 47 | 0 | 28 Apr 2019 - 15:36 |
Jakarta commons-httpclient | 37 | 5.69 GB | 29 Apr 2019 - 12:25 |
Exabot | 35 | 185.09 KB | 30 Apr 2019 - 23:48 |
CFNetwork | 31 | 322.97 MB | 28 Apr 2019 - 17:22 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 17 | 211.60 MB | 25 Apr 2019 - 20:14 |
Alexa (IA Archiver) | 15 | 155.00 KB | 30 Apr 2019 - 08:49 |
Web Core / Roots | 12 | 271.22 MB | 28 Apr 2019 - 02:56 |
YaCy | 8 | 56.71 MB | 27 Apr 2019 - 01:28 |
Sogou Spider | 8 | 12.22 MB | 24 Apr 2019 - 19:23 |
archive.org bot | 2 | 48.65 MB | 10 Apr 2019 - 01:01 |
yeti | 2 | 54.24 MB | 21 Apr 2019 - 20:32 |
SeznamBot | 2 | 6.71 KB | 28 Apr 2019 - 01:56 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 2 | 7.17 KB | 22 Apr 2019 - 07:49 |
360spider | 2 | 33.51 MB | 22 Apr 2019 - 08:06 |
Suspected bot masqurading as Mozilla | 2 | 27.13 MB | 24 Apr 2019 - 20:58 |
MSNBot | 1 | 9.49 MB | 21 Apr 2019 - 09:44 |
Cliqzbot | 1 | 3.58 KB | 03 Apr 2019 - 08:33 |
Unknown robot (identified by 'robot') | 1 | 3.46 KB | 03 Apr 2019 - 12:26 |
pingdom | 1 | 7.56 KB | 30 Apr 2019 - 12:06 |
Suspected bot masqurading as Mozilla | 1 | 16 Bytes | 28 Apr 2019 - 21:34 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 26 Apr 2019 - 21:51 |
MJ12bot | 1 | 9.40 MB | 26 Apr 2019 - 03:41 |