58 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 10,558 | 66.23 GB | 31 Oct 2019 - 22:59 |
SemrushBot | 6,996 | 378.04 GB | 31 Oct 2019 - 23:06 |
Googlebot | 2,113 | 32.67 GB | 31 Oct 2019 - 23:09 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,106 | 85.54 GB | 31 Oct 2019 - 22:57 |
Yandex Bot | 2,012 | 174.46 GB | 31 Oct 2019 - 23:02 |
Bingbot | 1,479 | 10.14 GB | 31 Oct 2019 - 22:41 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,205 | 181.60 MB | 30 Oct 2019 - 08:13 |
AhrefsBot | 1,143 | 52.94 GB | 31 Oct 2019 - 22:14 |
Unknown robot (identified by 'crawl') | 798 | 4.75 GB | 31 Oct 2019 - 21:24 |
CFNetwork | 742 | 1.04 GB | 31 Oct 2019 - 14:27 |
Web Core / Roots | 381 | 30.01 GB | 31 Oct 2019 - 21:29 |
Java (Often spam bot) | 317 | 10.75 GB | 31 Oct 2019 - 22:59 |
Bing Preview bot | 268 | 4.10 GB | 31 Oct 2019 - 22:41 |
DotBot, Open Site Explorer | 179 | 2.89 GB | 31 Oct 2019 - 22:46 |
Alexa (IA Archiver) | 149 | 13.84 GB | 30 Oct 2019 - 02:08 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 138 | 2.13 GB | 23 Oct 2019 - 20:30 |
Unknown robot (identified by empty user agent string) | 128 | 6.32 GB | 31 Oct 2019 - 23:08 |
LinkChecker | 122 | 0 | 31 Oct 2019 - 11:45 |
rpt-httpclient | 99 | 608.84 MB | 31 Oct 2019 - 20:17 |
FavIconizer | 96 | 680.06 MB | 31 Oct 2019 - 20:03 |
WGet tools | 55 | 2.06 GB | 31 Oct 2019 - 23:00 |
Unknown robot (identified by 'spider') | 42 | 2.11 GB | 30 Oct 2019 - 09:24 |
Sogou Spider | 40 | 473.40 MB | 31 Oct 2019 - 14:00 |
Suspected bot masqurading as Mozilla | 38 | 0 | 31 Oct 2019 - 12:11 |
FaceBook bot | 37 | 437.89 MB | 31 Oct 2019 - 10:39 |
Common Crawl | 34 | 145.08 MB | 24 Oct 2019 - 05:52 |
ltx71 | 28 | 2.54 GB | 11 Oct 2019 - 00:36 |
MSNBot | 25 | 371.68 MB | 24 Oct 2019 - 20:12 |
SeznamBot | 23 | 426.72 MB | 30 Oct 2019 - 16:07 |
MJ12bot | 22 | 256.40 MB | 30 Oct 2019 - 03:27 |
Suspected bot masqurading as Mozilla | 20 | 7.19 MB | 31 Oct 2019 - 00:01 |
Python-urllib | 19 | 2.42 GB | 28 Oct 2019 - 13:55 |
Perl tool | 19 | 370.88 KB | 31 Oct 2019 - 23:00 |
WordPress | 17 | 72.34 MB | 31 Oct 2019 - 16:17 |
BaiDuSpider | 15 | 176.85 MB | 26 Oct 2019 - 07:12 |
HTTrack off-line browser | 10 | 448.97 MB | 20 Oct 2019 - 21:26 |
Nutch | 10 | 90.94 MB | 29 Oct 2019 - 05:23 |
Feedfetcher-Google | 9 | 8.93 KB | 31 Oct 2019 - 18:09 |
ning | 6 | 164.52 MB | 21 Oct 2019 - 00:35 |
Cliqzbot | 6 | 43.07 MB | 08 Oct 2019 - 05:16 |
Mail.ru bot | 5 | 21.69 MB | 15 Oct 2019 - 00:50 |
Motor | 5 | 207.68 MB | 23 Oct 2019 - 21:12 |
Exabot | 2 | 21.09 KB | 09 Oct 2019 - 17:17 |
A PHP script | 2 | 7.04 MB | 08 Oct 2019 - 10:21 |
Yahoo Slurp | 2 | 14.05 KB | 05 Oct 2019 - 03:21 |
360spider | 2 | 21.09 KB | 18 Oct 2019 - 03:38 |
Turn It In | 2 | 7.14 KB | 20 Oct 2019 - 11:53 |
YaCy | 2 | 7.14 KB | 28 Oct 2019 - 13:02 |
yeti | 2 | 14.24 MB | 24 Oct 2019 - 02:55 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 16 Oct 2019 - 12:05 |
WWWC Ver 0.2.5 | 1 | 0 | 29 Oct 2019 - 05:51 |
LinkBot | 1 | 0 | 24 Oct 2019 - 15:46 |
InternetArchive | 1 | 0 | 06 Oct 2019 - 05:47 |
Heritrix | 1 | 75.98 MB | 18 Oct 2019 - 10:45 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 28 Oct 2019 - 09:44 |
Unknown robot (identified by 'robot') | 1 | 4.97 KB | 04 Oct 2019 - 09:26 |
twitterbot | 1 | 4.33 KB | 15 Oct 2019 - 06:52 |
SMTBot | 1 | 7.04 MB | 19 Oct 2019 - 03:00 |