54 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 654 | 21.54 GB | 28 Feb 2019 - 23:58 |
Common *nix tool for automating web document retireval. Most likely a bot. | 8,419 | 50.91 GB | 28 Feb 2019 - 23:54 |
DotBot, Open Site Explorer | 78 | 1.65 GB | 28 Feb 2019 - 23:48 |
Googlebot | 1,091 | 32.53 GB | 28 Feb 2019 - 23:46 |
Sogou Spider | 29 | 59.66 MB | 28 Feb 2019 - 23:38 |
AhrefsBot | 718 | 23.56 GB | 28 Feb 2019 - 23:37 |
FaceBook bot | 10 | 20.97 MB | 28 Feb 2019 - 23:15 |
Bingbot | 601 | 6.70 GB | 28 Feb 2019 - 23:09 |
SemrushBot | 1,797 | 39.69 GB | 28 Feb 2019 - 22:57 |
SeznamBot | 23 | 850.35 MB | 28 Feb 2019 - 22:46 |
Yandex Bot | 1,280 | 126.49 GB | 28 Feb 2019 - 21:47 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 126 | 5.01 GB | 28 Feb 2019 - 20:23 |
Java (Often spam bot) | 131 | 535.22 MB | 28 Feb 2019 - 20:19 |
rpt-httpclient | 53 | 456.63 MB | 28 Feb 2019 - 19:57 |
BaiDuSpider | 402 | 13.08 GB | 28 Feb 2019 - 19:36 |
WGet tools | 48 | 2.97 GB | 28 Feb 2019 - 18:51 |
ning | 41 | 215.19 KB | 28 Feb 2019 - 18:36 |
Web Core / Roots | 239 | 20.50 GB | 28 Feb 2019 - 17:14 |
Suspected bot masqurading as Mozilla | 21 | 93.63 MB | 28 Feb 2019 - 16:18 |
CFNetwork | 1,574 | 5.47 GB | 28 Feb 2019 - 15:37 |
twitterbot | 2 | 141.45 MB | 28 Feb 2019 - 12:19 |
Unknown robot (identified by empty user agent string) | 61 | 3.76 GB | 28 Feb 2019 - 09:28 |
Perl tool | 313 | 1.22 MB | 28 Feb 2019 - 09:02 |
Bing Preview bot | 112 | 2.71 GB | 28 Feb 2019 - 07:58 |
Google Web Preview | 56 | 4.32 GB | 28 Feb 2019 - 07:49 |
FavIconizer | 78 | 201.80 MB | 28 Feb 2019 - 06:06 |
MJ12bot | 110 | 189.05 MB | 28 Feb 2019 - 05:51 |
Python-urllib | 70 | 8.14 GB | 27 Feb 2019 - 13:30 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,036 | 30.96 MB | 27 Feb 2019 - 09:46 |
Phantom | 2 | 83.45 MB | 26 Feb 2019 - 08:54 |
Suspected bot masqurading as Mozilla | 28 | 0 | 26 Feb 2019 - 04:12 |
Cliqzbot | 2 | 19.36 KB | 25 Feb 2019 - 23:09 |
Alexa (IA Archiver) | 19 | 142.15 KB | 25 Feb 2019 - 22:32 |
Yahoo Slurp | 2 | 7.43 KB | 25 Feb 2019 - 08:14 |
LinkChecker | 7 | 0 | 24 Feb 2019 - 16:43 |
Common Crawl | 28 | 608.63 MB | 23 Feb 2019 - 23:18 |
SMTBot | 3 | 19.52 MB | 23 Feb 2019 - 14:36 |
WordPress | 3 | 747.38 KB | 23 Feb 2019 - 06:54 |
Motor | 1 | 3.95 KB | 22 Feb 2019 - 14:39 |
Exabot | 16 | 49.41 KB | 21 Feb 2019 - 18:46 |
ltx71 | 7 | 240.94 MB | 21 Feb 2019 - 17:04 |
360spider | 2 | 20.84 KB | 20 Feb 2019 - 23:37 |
Google AdSense | 3 | 211.34 MB | 20 Feb 2019 - 16:27 |
InternetArchive | 1 | 0 | 16 Feb 2019 - 21:59 |
Mail.ru bot | 5 | 182.67 MB | 16 Feb 2019 - 14:50 |
Feedfetcher-Google | 68 | 276.39 KB | 14 Feb 2019 - 06:51 |
LinkBot | 1 | 0 | 13 Feb 2019 - 18:05 |
arks | 1 | 54.58 MB | 12 Feb 2019 - 17:18 |
Xenu's Link Sleuth (TM), see Wikipedia | 4 | 0 | 10 Feb 2019 - 16:51 |
yeti | 1 | 6.57 MB | 09 Feb 2019 - 06:25 |
MSNBot | 1 | 36.89 MB | 08 Feb 2019 - 06:57 |
Googlebot-Image | 1 | 7.13 MB | 07 Feb 2019 - 23:05 |
GigaBot | 1 | 3.50 KB | 07 Feb 2019 - 09:11 |
Nutch | 1 | 3.95 KB | 01 Feb 2019 - 20:42 |
|