67 different robots | Hits | Bandwidth | Last visit |
WGet tools | 4,160,236 | 21103.61 GB | 30 Sep 2019 - 23:59 |
SemrushBot | 44,574 | 206.33 GB | 30 Sep 2019 - 23:59 |
check_http (nagios) | 8,550 | 27.62 MB | 30 Sep 2019 - 23:59 |
Python-urllib | 31,109 | 19.17 GB | 30 Sep 2019 - 23:59 |
Googlebot | 4,212 | 42.41 GB | 30 Sep 2019 - 23:57 |
Bingbot | 5,869 | 126.17 GB | 30 Sep 2019 - 23:57 |
Common *nix tool for automating web document retireval. Most likely a bot. | 29,508 | 246.37 GB | 30 Sep 2019 - 23:56 |
Yandex Bot | 19,002 | 2608.98 GB | 30 Sep 2019 - 23:53 |
AhrefsBot | 4,833 | 54.69 GB | 30 Sep 2019 - 23:50 |
Alexa (IA Archiver) | 126 | 126.24 MB | 30 Sep 2019 - 23:43 |
YaCy | 13,806 | 1651.83 GB | 30 Sep 2019 - 23:38 |
Java (Often spam bot) | 1,594 | 12.30 GB | 30 Sep 2019 - 23:29 |
Unknown robot (identified by empty user agent string) | 13,429 | 377.76 GB | 30 Sep 2019 - 23:17 |
Suspected bot masqurading as Mozilla | 303 | 10.95 GB | 30 Sep 2019 - 22:44 |
Unknown robot (identified by 'spider') | 87 | 24.47 GB | 30 Sep 2019 - 22:32 |
BaiDuSpider | 1,268 | 122.04 GB | 30 Sep 2019 - 22:21 |
MJ12bot | 571 | 48.61 GB | 30 Sep 2019 - 22:16 |
Web Core / Roots | 301 | 10.93 GB | 30 Sep 2019 - 21:38 |
Unknown robot (identified by 'crawl') | 44,289 | 713.30 GB | 30 Sep 2019 - 21:24 |
Googlebot-Image | 60 | 710.66 KB | 30 Sep 2019 - 21:11 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,082 | 43.39 GB | 30 Sep 2019 - 21:10 |
Bing Preview bot | 166 | 78.09 GB | 30 Sep 2019 - 20:42 |
Suspected bot masqurading as Mozilla | 242 | 135.39 MB | 30 Sep 2019 - 20:38 |
GigaBot | 278 | 595.89 MB | 30 Sep 2019 - 20:26 |
Netcraft | 10 | 29.89 KB | 30 Sep 2019 - 19:59 |
Sogou Spider | 189 | 338.45 MB | 30 Sep 2019 - 18:54 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 14 | 9.75 MB | 30 Sep 2019 - 18:29 |
FavIconizer | 334 | 901.95 MB | 30 Sep 2019 - 18:08 |
SeznamBot | 261 | 1.83 GB | 30 Sep 2019 - 17:40 |
DotBot, Open Site Explorer | 128 | 14.15 GB | 30 Sep 2019 - 17:06 |
LinkChecker | 57 | 0 | 30 Sep 2019 - 16:44 |
Jakarta commons-httpclient | 19 | 417.80 MB | 30 Sep 2019 - 08:17 |
Perl tool | 658 | 5.21 GB | 30 Sep 2019 - 07:37 |
MagpieRSS | 1,290 | 312.34 GB | 30 Sep 2019 - 06:59 |
Google AdSense | 1 | 3.24 KB | 29 Sep 2019 - 10:21 |
WordPress | 29 | 19.85 KB | 29 Sep 2019 - 08:31 |
Simmany Robot Ver1.0 | 7 | 610.04 MB | 29 Sep 2019 - 07:43 |
CFNetwork | 5 | 2.75 GB | 29 Sep 2019 - 05:59 |
Nutch | 4 | 1.64 MB | 29 Sep 2019 - 02:49 |
Sift | 15 | 261.64 MB | 28 Sep 2019 - 17:17 |
MojeekBot | 22 | 152.12 KB | 28 Sep 2019 - 02:28 |
ltx71 | 128 | 9.93 GB | 27 Sep 2019 - 18:06 |
360spider | 19 | 4.60 MB | 27 Sep 2019 - 17:47 |
Ultraseek | 50 | 1.68 GB | 27 Sep 2019 - 05:34 |
ning | 26 | 2.51 GB | 27 Sep 2019 - 04:56 |
twitterbot | 11 | 3.71 GB | 26 Sep 2019 - 12:24 |
Phantom | 4 | 13.34 KB | 26 Sep 2019 - 10:00 |
SMTBot | 72 | 118.79 MB | 26 Sep 2019 - 07:27 |
Cliqzbot | 3 | 18.46 MB | 26 Sep 2019 - 05:01 |
AdsBot-Google | 8 | 21.71 KB | 25 Sep 2019 - 12:39 |
FaceBook bot | 6 | 16.74 KB | 24 Sep 2019 - 17:52 |
SEOkicks Webcrawler | 56 | 112.03 MB | 24 Sep 2019 - 06:21 |
Common Crawl | 106 | 3.63 GB | 23 Sep 2019 - 08:12 |
InternetArchive | 3 | 0 | 22 Sep 2019 - 01:39 |
Unknown robot (identified by 'discovery') | 1 | 3.22 KB | 19 Sep 2019 - 17:38 |
Turn It In | 1 | 1.59 MB | 17 Sep 2019 - 11:00 |
yeti | 8 | 341.83 KB | 17 Sep 2019 - 09:59 |
Ruby script | 1 | 3.22 KB | 16 Sep 2019 - 06:31 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 401 | 3.60 GB | 14 Sep 2019 - 23:24 |
Motor | 10 | 24.24 KB | 14 Sep 2019 - 15:19 |
InfoBot | 30 | 126.21 KB | 13 Sep 2019 - 23:05 |
Cfetch | 7 | 2.21 GB | 13 Sep 2019 - 18:05 |
Mail.ru bot | 32 | 2.00 MB | 11 Sep 2019 - 20:42 |
Emacs-w3 Search Engine | 1 | 340.00 MB | 11 Sep 2019 - 11:16 |
Google Sitemaps | 1 | 217 Bytes | 10 Sep 2019 - 13:54 |
W3C Link Checker | 1 | 0 | 10 Sep 2019 - 13:30 |
Fish search | 27 | 10.73 MB | 08 Sep 2019 - 07:56 |
|