44 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 32,009+2 | 759.52 GB | 30 Jun 2019 - 23:47 |
AhrefsBot | 15,208 | 819.85 GB | 30 Jun 2019 - 23:40 |
SemrushBot | 4,944 | 18.42 GB | 30 Jun 2019 - 23:57 |
Yandex Bot | 4,443 | 742.28 GB | 30 Jun 2019 - 23:41 |
Java (Often spam bot) | 1,945 | 33.82 GB | 30 Jun 2019 - 23:34 |
WGet tools | 1,625 | 766.01 GB | 30 Jun 2019 - 23:30 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,362 | 168.39 MB | 29 Jun 2019 - 18:02 |
Common *nix tool for automating web document retireval. Most likely a bot. | 1,201 | 89.50 GB | 30 Jun 2019 - 22:00 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 635 | 191.36 MB | 27 Jun 2019 - 09:44 |
Unknown robot (identified by empty user agent string) | 570 | 69.40 GB | 30 Jun 2019 - 22:03 |
Bingbot | 507 | 9.49 GB | 30 Jun 2019 - 23:11 |
BaiDuSpider | 323 | 350.85 MB | 26 Jun 2019 - 15:55 |
DotBot, Open Site Explorer | 316 | 8.70 GB | 30 Jun 2019 - 23:59 |
Python-urllib | 275 | 124.29 GB | 30 Jun 2019 - 17:31 |
Perl tool | 200 | 4.39 MB | 30 Jun 2019 - 23:47 |
Googlebot | 167 | 3.97 GB | 30 Jun 2019 - 18:54 |
LinkChecker | 71 | 0 | 30 Jun 2019 - 11:44 |
ltx71 | 68 | 1.08 GB | 25 Jun 2019 - 02:14 |
Exabot | 59 | 1.06 MB | 30 Jun 2019 - 15:32 |
Unknown robot (identified by 'spider') | 57 | 203.06 MB | 29 Jun 2019 - 08:34 |
GigaBot | 53 | 14.88 GB | 21 Jun 2019 - 08:55 |
Common Crawl | 42 | 12.20 MB | 27 Jun 2019 - 12:02 |
Jakarta commons-httpclient | 29 | 464 Bytes | 30 Jun 2019 - 07:06 |
CFNetwork | 28 | 602.88 MB | 30 Jun 2019 - 09:06 |
Alexa (IA Archiver) | 25 | 188.40 KB | 30 Jun 2019 - 21:00 |
Cliqzbot | 19 | 8.57 MB | 30 Jun 2019 - 23:31 |
Sogou Spider | 9 | 12.22 MB | 15 Jun 2019 - 00:37 |
SeznamBot | 6 | 19.02 KB | 30 Jun 2019 - 13:18 |
Web Core / Roots | 4 | 108.49 MB | 23 Jun 2019 - 00:45 |
archive.org bot | 4 | 97.31 MB | 19 Jun 2019 - 06:32 |
yeti | 3 | 81.37 MB | 30 Jun 2019 - 19:45 |
Suspected bot masqurading as Mozilla | 2 | 15.96 KB | 27 Jun 2019 - 12:57 |
Unknown robot (identified by 'robot') | 2 | 15.96 KB | 30 Jun 2019 - 22:37 |
FaceBook bot | 2 | 6.92 KB | 27 Jun 2019 - 16:11 |
Bing Preview bot | 2 | 17.84 MB | 06 Jun 2019 - 05:23 |
Google AdSense | 2 | 2.90 MB | 30 Jun 2019 - 05:47 |
Mail.ru bot | 1 | 7.16 KB | 28 Jun 2019 - 10:14 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 3.25 KB | 12 Jun 2019 - 00:59 |
360spider | 1 | 16.75 MB | 17 Jun 2019 - 01:49 |
twitterbot | 1 | 27.12 MB | 09 Jun 2019 - 09:37 |
A PHP script | 1 | 21.53 MB | 10 Jun 2019 - 14:22 |
Sift | 1 | 392.05 KB | 02 Jun 2019 - 05:58 |
microsoft-webdav-miniredir | 1 | 0 | 08 Jun 2019 - 01:57 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 18 Jun 2019 - 12:56 |