68 different robots | Hits | Bandwidth | Last visit |
WGet tools | 6,203,254 | 37390.67 GB | 31 Dec 2020 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 127,273 | 196.43 GB | 31 Dec 2020 - 23:58 |
Bingbot | 98,030 | 685.97 GB | 31 Dec 2020 - 23:59 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 56,107 | 390.64 GB | 31 Dec 2020 - 23:58 |
Unknown robot (identified by 'crawl') | 47,333 | 274.78 GB | 31 Dec 2020 - 14:57 |
Unknown robot (identified by empty user agent string) | 15,554 | 121.66 GB | 31 Dec 2020 - 23:35 |
Googlebot | 14,048 | 93.71 GB | 31 Dec 2020 - 23:59 |
AhrefsBot | 11,825 | 215.81 GB | 31 Dec 2020 - 23:52 |
Unknown robot (identified by 'spider') | 9,093 | 49.75 GB | 31 Dec 2020 - 22:37 |
check_http (nagios) | 8,875 | 28.67 MB | 31 Dec 2020 - 23:50 |
SemrushBot | 7,991 | 64.47 GB | 31 Dec 2020 - 23:24 |
Python-urllib | 7,246 | 13.73 GB | 31 Dec 2020 - 23:50 |
DotBot, Open Site Explorer | 2,458 | 16.77 GB | 31 Dec 2020 - 22:59 |
Yandex Bot | 1,943 | 39.06 GB | 31 Dec 2020 - 19:35 |
MagpieRSS | 1,061 | 208.07 GB | 31 Dec 2020 - 22:19 |
MJ12bot | 912 | 20.50 GB | 31 Dec 2020 - 14:32 |
SEOkicks Webcrawler | 716 | 15.18 GB | 21 Dec 2020 - 22:04 |
Perl tool | 475 | 6.30 GB | 31 Dec 2020 - 08:10 |
ltx71 | 317 | 38.41 GB | 31 Dec 2020 - 16:40 |
Mail.ru bot | 301 | 5.22 GB | 31 Dec 2020 - 21:34 |
Java (Often spam bot) | 280 | 5.48 GB | 28 Dec 2020 - 15:09 |
FavIconizer | 223 | 760.71 KB | 31 Dec 2020 - 22:38 |
BaiDuSpider | 195 | 12.71 GB | 31 Dec 2020 - 15:14 |
Common Crawl | 159 | 46.88 MB | 01 Dec 2020 - 06:23 |
Bing Preview bot | 158 | 6.56 GB | 31 Dec 2020 - 18:53 |
LinkChecker | 135 | 0 | 31 Dec 2020 - 06:13 |
Suspected bot masqurading as Mozilla | 134 | 20.44 KB | 31 Dec 2020 - 21:18 |
SeznamBot | 116 | 1.46 GB | 31 Dec 2020 - 22:43 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 109 | 42.18 MB | 29 Dec 2020 - 06:47 |
Jakarta commons-httpclient | 97 | 4.45 GB | 21 Dec 2020 - 14:11 |
SMTBot | 87 | 102.94 MB | 29 Dec 2020 - 05:48 |
FaceBook bot | 82 | 2.82 GB | 28 Dec 2020 - 19:45 |
Web Core / Roots | 79 | 2.52 GB | 28 Dec 2020 - 19:32 |
MojeekBot | 76 | 5.32 MB | 31 Dec 2020 - 21:12 |
Nutch | 64 | 1.94 GB | 28 Dec 2020 - 22:54 |
Sift | 56 | 921.13 MB | 31 Dec 2020 - 14:10 |
ning | 55 | 198.96 MB | 24 Dec 2020 - 10:36 |
Googlebot-Image | 50 | 594.38 KB | 30 Dec 2020 - 17:30 |
Suspected bot masqurading as Mozilla | 50 | 1.55 GB | 30 Dec 2020 - 17:30 |
YaCy | 35 | 2.87 GB | 17 Dec 2020 - 17:57 |
Netcraft | 35 | 109.28 KB | 31 Dec 2020 - 15:06 |
Emacs-w3 Search Engine | 23 | 40.85 KB | 07 Dec 2020 - 07:58 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 21 | 684.95 MB | 22 Dec 2020 - 17:13 |
Cfetch | 20 | 2.43 GB | 25 Dec 2020 - 04:33 |
Steeler | 19 | 12.09 MB | 11 Dec 2020 - 12:14 |
360spider | 17 | 13.27 KB | 17 Dec 2020 - 05:36 |
Sogou Spider | 16 | 54.92 KB | 31 Dec 2020 - 09:28 |
HTMLParser | 14 | 113.39 KB | 15 Dec 2020 - 04:51 |
twitterbot | 14 | 1.73 GB | 29 Dec 2020 - 23:26 |
WordPress | 14 | 547.99 MB | 31 Dec 2020 - 01:45 |
Anthill | 12 | 196.52 MB | 31 Dec 2020 - 03:13 |
Unknown robot (identified by 'discovery') | 8 | 16.12 KB | 31 Dec 2020 - 00:15 |
Google AdSense | 4 | 15.06 MB | 18 Dec 2020 - 15:20 |
Phantom | 4 | 10.98 KB | 23 Dec 2020 - 06:26 |
Alexa (IA Archiver) | 4 | 262.99 MB | 17 Dec 2020 - 19:52 |
yeti | 3 | 7.47 KB | 25 Dec 2020 - 21:52 |
HTTrack off-line browser | 3 | 38.25 MB | 25 Dec 2020 - 18:42 |
Simmany Robot Ver1.0 | 2 | 9.35 KB | 12 Dec 2020 - 12:26 |
InfoBot | 2 | 8.40 KB | 24 Dec 2020 - 09:11 |
TestBot | 2 | 6.57 KB | 18 Dec 2020 - 16:18 |
ichiro | 2 | 168.37 MB | 29 Dec 2020 - 23:30 |
VORTEX | 2 | 826.00 MB | 01 Dec 2020 - 15:39 |
CFNetwork | 1 | 0 | 21 Dec 2020 - 07:47 |
AdsBot-Google | 1 | 30.20 MB | 14 Dec 2020 - 08:16 |
InternetArchive | 1 | 0 | 31 Dec 2020 - 22:38 |
Monster | 1 | 4.48 KB | 10 Dec 2020 - 05:43 |
Yahoo Slurp | 1 | 3.22 KB | 16 Dec 2020 - 00:03 |
GigablastOpenSource, an Open Source Search Engine(Wiki) | 1 | 6.05 MB | 15 Dec 2020 - 09:01 |
|