61 different robots | Hits | Bandwidth | Last visit |
WGet tools | 2,763,199 | 12322.47 GB | 30 Jun 2019 - 23:59 |
Unknown robot (identified by 'crawl') | 88,629 | 683.34 GB | 30 Jun 2019 - 23:58 |
Yandex Bot | 41,399 | 5051.44 GB | 30 Jun 2019 - 23:59 |
Python-urllib | 22,769 | 39.25 GB | 30 Jun 2019 - 23:40 |
SemrushBot | 22,599 | 105.56 GB | 30 Jun 2019 - 23:37 |
Unknown robot (identified by empty user agent string) | 19,894 | 1546.90 GB | 30 Jun 2019 - 22:40 |
Common *nix tool for automating web document retireval. Most likely a bot. | 17,569 | 111.62 GB | 30 Jun 2019 - 23:58 |
GigaBot | 11,772 | 37.94 GB | 26 Jun 2019 - 22:57 |
Bingbot | 7,961 | 112.00 GB | 30 Jun 2019 - 23:58 |
check_http (nagios) | 5,733 | 18.40 MB | 30 Jun 2019 - 23:59 |
Googlebot | 5,333 | 65.98 GB | 30 Jun 2019 - 23:57 |
AhrefsBot | 3,933 | 15.77 GB | 30 Jun 2019 - 23:56 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,235 | 90.76 GB | 30 Jun 2019 - 23:53 |
BaiDuSpider | 1,603 | 110.06 GB | 30 Jun 2019 - 23:45 |
Java (Often spam bot) | 1,351 | 1.37 GB | 30 Jun 2019 - 23:34 |
MagpieRSS | 685 | 160.58 GB | 30 Jun 2019 - 23:01 |
Perl tool | 672 | 9.81 GB | 30 Jun 2019 - 10:22 |
SEOkicks Webcrawler | 376 | 633.84 MB | 30 Jun 2019 - 16:05 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 326 | 10.95 GB | 30 Jun 2019 - 14:13 |
Exabot | 265 | 2.42 MB | 30 Jun 2019 - 19:18 |
Wotbox | 218 | 1.85 GB | 18 Jun 2019 - 12:58 |
Suspected bot masqurading as Mozilla | 185 | 9.51 GB | 30 Jun 2019 - 01:45 |
Common Crawl | 178 | 327.97 MB | 26 Jun 2019 - 08:49 |
Sogou Spider | 175 | 144.14 MB | 29 Jun 2019 - 16:36 |
FavIconizer | 154 | 52.80 MB | 30 Jun 2019 - 22:22 |
Alexa (IA Archiver) | 133 | 52.18 MB | 30 Jun 2019 - 19:18 |
Suspected bot masqurading as Mozilla | 131 | 20.22 MB | 30 Jun 2019 - 23:38 |
DotBot, Open Site Explorer | 122 | 5.24 GB | 30 Jun 2019 - 16:48 |
SeznamBot | 109 | 2.99 GB | 30 Jun 2019 - 19:04 |
Bing Preview bot | 103 | 16.68 GB | 30 Jun 2019 - 18:39 |
ltx71 | 79 | 5.87 GB | 25 Jun 2019 - 21:41 |
ning | 77 | 1.61 GB | 22 Jun 2019 - 09:42 |
Unknown robot (identified by 'spider') | 71 | 4.36 GB | 30 Jun 2019 - 21:50 |
Cliqzbot | 67 | 282.63 MB | 27 Jun 2019 - 16:56 |
Mail.ru bot | 47 | 5.42 MB | 29 Jun 2019 - 14:55 |
SMTBot | 44 | 31.68 MB | 28 Jun 2019 - 07:32 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 37 | 22.78 MB | 25 Jun 2019 - 19:52 |
YaCy | 32 | 2.78 GB | 30 Jun 2019 - 15:55 |
LinkChecker | 32 | 0 | 28 Jun 2019 - 16:54 |
Googlebot-Image | 30 | 21.22 KB | 30 Jun 2019 - 14:05 |
Nutch | 24 | 4.54 GB | 20 Jun 2019 - 06:00 |
Web Core / Roots | 21 | 3.00 GB | 26 Jun 2019 - 13:29 |
Sift | 15 | 551.80 KB | 25 Jun 2019 - 16:36 |
360spider | 12 | 3.04 MB | 07 Jun 2019 - 03:23 |
Phantom | 10 | 2.12 GB | 11 Jun 2019 - 02:32 |
FaceBook bot | 9 | 19.00 KB | 22 Jun 2019 - 05:06 |
twitterbot | 9 | 1.99 GB | 24 Jun 2019 - 09:59 |
MojeekBot | 8 | 43.92 KB | 23 Jun 2019 - 10:21 |
Netcraft | 5 | 13.15 KB | 29 Jun 2019 - 19:26 |
Google AdSense | 4 | 2.80 GB | 16 Jun 2019 - 11:23 |
Custo | 3 | 8.90 KB | 28 Jun 2019 - 16:25 |
GigablastOpenSource, an Open Source Search Engine(Wiki) | 3 | 9.84 KB | 13 Jun 2019 - 19:50 |
MJ12bot | 3 | 10.46 KB | 14 Jun 2019 - 01:09 |
A PHP script | 3 | 350.28 KB | 17 Jun 2019 - 04:37 |
WordPress | 2 | 6.70 KB | 06 Jun 2019 - 01:01 |
Unknown robot (identified by 'robot') | 2 | 14.74 KB | 13 Jun 2019 - 13:13 |
InternetArchive | 2 | 0 | 25 Jun 2019 - 00:14 |
Simmany Robot Ver1.0 | 2 | 287.00 MB | 27 Jun 2019 - 17:46 |
IstellaBot | 1 | 3.22 KB | 09 Jun 2019 - 10:13 |
CFNetwork | 1 | 260.67 MB | 27 Jun 2019 - 04:41 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 19 Jun 2019 - 06:51 |
|