69 different robots | Hits | Bandwidth | Last visit |
WGet tools | 4,747,146 | 21948.30 GB | 31 Oct 2019 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 201,834 | 533.14 GB | 31 Oct 2019 - 23:59 |
SemrushBot | 39,944 | 175.11 GB | 31 Oct 2019 - 23:59 |
Python-urllib | 31,149 | 12.39 GB | 31 Oct 2019 - 23:59 |
Googlebot | 5,511 | 59.37 GB | 31 Oct 2019 - 23:59 |
check_http (nagios) | 8,719 | 28.16 MB | 31 Oct 2019 - 23:58 |
BaiDuSpider | 1,272 | 94.04 GB | 31 Oct 2019 - 23:57 |
AhrefsBot | 2,361 | 38.19 GB | 31 Oct 2019 - 23:55 |
Yandex Bot | 18,407 | 2754.87 GB | 31 Oct 2019 - 23:54 |
Bingbot | 5,361 | 84.58 GB | 31 Oct 2019 - 23:50 |
Unknown robot (identified by empty user agent string) | 11,192 | 262.92 GB | 31 Oct 2019 - 23:47 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 136,393 | 864.03 GB | 31 Oct 2019 - 23:41 |
FaceBook bot | 37 | 118.73 KB | 31 Oct 2019 - 23:41 |
SeznamBot | 288 | 12.31 GB | 31 Oct 2019 - 23:34 |
Suspected bot masqurading as Mozilla | 178 | 165.83 MB | 31 Oct 2019 - 23:24 |
Java (Often spam bot) | 2,162 | 28.57 GB | 31 Oct 2019 - 22:50 |
lwp-request | 22 | 0 | 31 Oct 2019 - 22:39 |
MagpieRSS | 1,406 | 338.85 GB | 31 Oct 2019 - 22:14 |
DotBot, Open Site Explorer | 315 | 18.02 GB | 31 Oct 2019 - 22:14 |
Netcraft | 21 | 39.69 KB | 31 Oct 2019 - 21:45 |
Bing Preview bot | 109 | 44.00 GB | 31 Oct 2019 - 21:22 |
FavIconizer | 319 | 53.90 MB | 31 Oct 2019 - 21:16 |
Sogou Spider | 119 | 827.30 MB | 31 Oct 2019 - 19:43 |
MJ12bot | 364 | 37.58 GB | 31 Oct 2019 - 16:52 |
LinkChecker | 52 | 0 | 31 Oct 2019 - 16:16 |
Suspected bot masqurading as Mozilla | 171 | 8.56 GB | 31 Oct 2019 - 16:15 |
ltx71 | 158 | 17.98 GB | 31 Oct 2019 - 13:44 |
Sift | 17 | 418.54 MB | 31 Oct 2019 - 11:55 |
Alexa (IA Archiver) | 691 | 20.73 GB | 31 Oct 2019 - 10:43 |
Perl tool | 495 | 7.77 GB | 31 Oct 2019 - 07:10 |
Unknown robot (identified by 'spider') | 77 | 14.13 GB | 31 Oct 2019 - 01:17 |
yeti | 11 | 27.05 KB | 31 Oct 2019 - 01:14 |
MojeekBot | 5 | 25.44 KB | 30 Oct 2019 - 22:19 |
Googlebot-Image | 33 | 2.42 MB | 30 Oct 2019 - 18:39 |
Web Core / Roots | 176 | 10.93 GB | 30 Oct 2019 - 12:29 |
Unknown robot (identified by 'crawl') | 19,960 | 228.15 GB | 30 Oct 2019 - 09:20 |
360spider | 7 | 12.30 MB | 29 Oct 2019 - 23:26 |
CFNetwork | 50 | 928.84 MB | 29 Oct 2019 - 18:46 |
Nutch | 13 | 421.60 MB | 29 Oct 2019 - 17:09 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 3.35 KB | 29 Oct 2019 - 07:46 |
WebCopy | 1 | 0 | 28 Oct 2019 - 20:16 |
ning | 102 | 1.89 GB | 28 Oct 2019 - 17:07 |
YaCy | 35,105 | 8876.40 GB | 28 Oct 2019 - 11:34 |
twitterbot | 13 | 2.77 GB | 28 Oct 2019 - 08:09 |
Unknown robot (identified by 'robot') | 4 | 98.81 KB | 28 Oct 2019 - 05:57 |
SMTBot | 117 | 109.54 MB | 26 Oct 2019 - 21:44 |
Unknown robot (identified by 'scanner') | 5 | 130.33 KB | 26 Oct 2019 - 21:29 |
WordPress | 14 | 20.60 KB | 26 Oct 2019 - 13:07 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,603 | 14.11 GB | 26 Oct 2019 - 07:22 |
Cfetch | 1 | 338.90 MB | 26 Oct 2019 - 03:40 |
Simmany Robot Ver1.0 | 9 | 1.59 GB | 25 Oct 2019 - 09:58 |
SEOkicks Webcrawler | 106 | 4.38 GB | 24 Oct 2019 - 18:41 |
MSNBot | 4 | 29.09 KB | 24 Oct 2019 - 11:55 |
Emacs-w3 Search Engine | 2 | 700.00 MB | 22 Oct 2019 - 20:23 |
Common Crawl | 242 | 26.88 MB | 22 Oct 2019 - 15:06 |
Unknown robot (identified by 'discovery') | 1 | 3.22 KB | 20 Oct 2019 - 03:09 |
Mail.ru bot | 16 | 698.61 KB | 17 Oct 2019 - 17:56 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 16 Oct 2019 - 06:06 |
Turn It In | 1 | 376.20 KB | 15 Oct 2019 - 11:32 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 360 | 121.52 MB | 14 Oct 2019 - 13:21 |
HTTrack off-line browser | 2 | 331 Bytes | 12 Oct 2019 - 19:01 |
InternetArchive | 2 | 0 | 11 Oct 2019 - 14:02 |
Google AdSense | 1 | 2.80 GB | 07 Oct 2019 - 18:11 |
CMS Crawler | 2 | 6.45 KB | 07 Oct 2019 - 02:20 |
Suspected bot masquerading as M$ IE | 1 | 0 | 06 Oct 2019 - 15:15 |
Motor | 8 | 43.88 KB | 06 Oct 2019 - 01:11 |
ParaSite | 1 | 262.22 MB | 05 Oct 2019 - 12:22 |
Exabot | 1 | 3.22 KB | 04 Oct 2019 - 09:26 |
GigaBot | 18 | 16.89 MB | 03 Oct 2019 - 16:11 |
|