63 different robots | Hits | Bandwidth | Last visit |
WGet tools | 1,548,368 | 8701.35 GB | 30 Apr 2019 - 23:59 |
Googlebot | 18,390 | 102.34 GB | 30 Apr 2019 - 23:56 |
Python-urllib | 17,646 | 17.76 GB | 30 Apr 2019 - 23:40 |
Yandex Bot | 15,807 | 2010.72 GB | 30 Apr 2019 - 23:52 |
Common *nix tool for automating web document retireval. Most likely a bot. | 13,618 | 123.37 GB | 30 Apr 2019 - 23:45 |
SemrushBot | 13,610 | 70.73 GB | 30 Apr 2019 - 23:53 |
Bingbot | 12,448 | 226.12 GB | 30 Apr 2019 - 23:54 |
Unknown robot (identified by empty user agent string) | 9,110 | 237.40 GB | 30 Apr 2019 - 23:59 |
Unknown robot (identified by 'crawl') | 7,803 | 133.21 GB | 30 Apr 2019 - 15:55 |
check_http (nagios) | 5,715 | 18.34 MB | 30 Apr 2019 - 23:58 |
BaiDuSpider | 1,914 | 97.90 GB | 30 Apr 2019 - 21:13 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,466 | 44.74 GB | 30 Apr 2019 - 23:13 |
MagpieRSS | 1,008 | 229.23 GB | 30 Apr 2019 - 02:39 |
Java (Often spam bot) | 755 | 11.84 GB | 30 Apr 2019 - 16:40 |
Perl tool | 485 | 3.74 GB | 30 Apr 2019 - 07:10 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 471 | 11.75 GB | 30 Apr 2019 - 13:14 |
AhrefsBot | 281 | 2.40 GB | 30 Apr 2019 - 13:42 |
Alexa (IA Archiver) | 260 | 230.54 MB | 30 Apr 2019 - 09:27 |
ltx71 | 259 | 40.36 GB | 30 Apr 2019 - 22:34 |
ning | 259 | 835.42 MB | 16 Apr 2019 - 14:03 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 196 | 25.18 GB | 26 Apr 2019 - 12:10 |
Suspected bot masqurading as Mozilla | 187 | 40.10 KB | 30 Apr 2019 - 14:31 |
Exabot | 178 | 3.66 MB | 30 Apr 2019 - 21:58 |
FavIconizer | 165 | 47.11 MB | 30 Apr 2019 - 23:56 |
Sogou Spider | 158 | 246.39 MB | 30 Apr 2019 - 08:47 |
Suspected bot masqurading as Mozilla | 145 | 6.68 GB | 30 Apr 2019 - 13:47 |
Bing Preview bot | 144 | 22.94 GB | 30 Apr 2019 - 18:41 |
SEOkicks Webcrawler | 120 | 206.69 MB | 28 Apr 2019 - 03:52 |
YaCy | 118 | 10.35 GB | 30 Apr 2019 - 21:12 |
Common Crawl | 100 | 255.46 MB | 23 Apr 2019 - 04:53 |
DotBot, Open Site Explorer | 92 | 8.65 GB | 30 Apr 2019 - 12:17 |
SeznamBot | 92 | 23.88 MB | 28 Apr 2019 - 14:24 |
Mail.ru bot | 90 | 189.05 MB | 28 Apr 2019 - 15:37 |
Googlebot-Image | 46 | 595.54 KB | 30 Apr 2019 - 23:20 |
SMTBot | 46 | 993.85 MB | 20 Apr 2019 - 06:23 |
Unknown robot (identified by 'spider') | 46 | 14.91 GB | 30 Apr 2019 - 22:52 |
360spider | 39 | 28.23 MB | 30 Apr 2019 - 21:11 |
MJ12bot | 25 | 4.43 GB | 20 Apr 2019 - 17:53 |
Cliqzbot | 23 | 118.28 MB | 25 Apr 2019 - 22:38 |
LinkChecker | 23 | 0 | 30 Apr 2019 - 10:21 |
Web Core / Roots | 22 | 2.19 GB | 28 Apr 2019 - 12:56 |
InfoBot | 16 | 64.44 KB | 05 Apr 2019 - 12:08 |
Fish search | 12 | 30.68 KB | 24 Apr 2019 - 03:08 |
Nutch | 11 | 1.88 GB | 17 Apr 2019 - 11:20 |
twitterbot | 9 | 1.40 GB | 19 Apr 2019 - 11:29 |
MojeekBot | 8 | 52.50 KB | 28 Apr 2019 - 00:40 |
CFNetwork | 5 | 1.09 GB | 25 Apr 2019 - 02:04 |
Google AdSense | 5 | 14.02 GB | 29 Apr 2019 - 04:25 |
Netcraft | 4 | 9.80 KB | 30 Apr 2019 - 18:05 |
WordPress | 4 | 13.15 KB | 08 Apr 2019 - 18:03 |
IstellaBot | 2 | 6.57 KB | 10 Apr 2019 - 00:13 |
Sift | 2 | 6.45 KB | 13 Apr 2019 - 04:32 |
Jakarta commons-httpclient | 2 | 27.58 MB | 23 Apr 2019 - 11:11 |
Phantom | 1 | 1.28 KB | 13 Apr 2019 - 10:57 |
Ruby script | 1 | 3.35 KB | 30 Apr 2019 - 11:55 |
oBot | 1 | 3.22 KB | 24 Apr 2019 - 17:29 |
Suspected bot masquerading as M$ IE | 1 | 6.32 KB | 28 Apr 2019 - 08:43 |
FaceBook bot | 1 | 261.13 MB | 19 Apr 2019 - 02:34 |
LinkBot | 1 | 0 | 10 Apr 2019 - 06:42 |
JoBo Java Web Robot | 1 | 3.22 KB | 08 Apr 2019 - 09:32 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 3.22 KB | 10 Apr 2019 - 20:39 |
InternetArchive | 1 | 0 | 15 Apr 2019 - 14:45 |
ActiveBookmark | 1 | 5.24 KB | 08 Apr 2019 - 09:32 |
|