61 different robots | Hits | Bandwidth | Last visit |
WGet tools | 3,043,425 | 10281.00 GB | 31 Jul 2022 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 268,449 | 802.47 GB | 31 Jul 2022 - 23:52 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 134,123 | 950.05 GB | 31 Jul 2022 - 23:47 |
Unknown robot (identified by 'crawl') | 93,069 | 490.69 GB | 31 Jul 2022 - 22:23 |
SemrushBot | 38,887 | 134.36 GB | 31 Jul 2022 - 23:58 |
AhrefsBot | 22,568 | 22.22 GB | 31 Jul 2022 - 23:59 |
Bingbot | 20,841 | 562.23 GB | 31 Jul 2022 - 23:58 |
DotBot, Open Site Explorer | 12,547 | 280.77 GB | 31 Jul 2022 - 23:47 |
check_http (nagios) | 8,844 | 28.57 MB | 31 Jul 2022 - 23:52 |
Unknown robot (identified by empty user agent string) | 6,945 | 79.34 GB | 31 Jul 2022 - 23:35 |
Python-urllib | 3,433 | 37.65 GB | 31 Jul 2022 - 21:44 |
MJ12bot | 3,323 | 52.83 GB | 31 Jul 2022 - 22:35 |
Googlebot | 3,229 | 71.68 GB | 31 Jul 2022 - 23:25 |
Java (Often spam bot) | 2,142 | 1.36 GB | 31 Jul 2022 - 15:48 |
Suspected bot masqurading as Mozilla | 1,361 | 537.32 MB | 31 Jul 2022 - 23:19 |
Yandex Bot | 1,334 | 141.68 GB | 31 Jul 2022 - 22:55 |
Unknown robot (identified by 'spider') | 1,329 | 29.95 GB | 31 Jul 2022 - 23:57 |
Common Crawl | 1,204 | 1.86 GB | 07 Jul 2022 - 08:36 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1,137 | 73.20 MB | 27 Jul 2022 - 17:55 |
Suspected bot masqurading as Mozilla | 427 | 7.76 GB | 31 Jul 2022 - 11:45 |
SEOkicks Webcrawler | 375 | 4.49 GB | 06 Jul 2022 - 22:37 |
BaiDuSpider | 353 | 26.12 GB | 31 Jul 2022 - 22:05 |
Custo | 306 | 369.98 MB | 31 Jul 2022 - 22:14 |
Mail.ru bot | 243 | 410.38 MB | 30 Jul 2022 - 08:06 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 214 | 22.90 MB | 22 Jul 2022 - 01:45 |
Bing Preview bot | 207 | 56.90 GB | 31 Jul 2022 - 06:58 |
Googlebot-Image | 173 | 138.64 MB | 31 Jul 2022 - 14:03 |
FaceBook bot | 163 | 23.82 GB | 31 Jul 2022 - 17:10 |
FavIconizer | 141 | 466.88 KB | 31 Jul 2022 - 09:33 |
LinkChecker | 113 | 235.96 MB | 30 Jul 2022 - 12:35 |
MojeekBot | 100 | 1.53 MB | 31 Jul 2022 - 20:26 |
SeznamBot | 100 | 1.45 MB | 31 Jul 2022 - 02:27 |
Perl tool | 99 | 20.50 GB | 31 Jul 2022 - 20:09 |
Web Core / Roots | 91 | 31.65 GB | 30 Jul 2022 - 04:26 |
Y!J Yahoo Japan | 83 | 793.64 MB | 12 Jul 2022 - 00:10 |
yeti | 59 | 5.71 GB | 31 Jul 2022 - 23:51 |
YaCy | 31 | 3.50 MB | 30 Jul 2022 - 21:36 |
twitterbot | 19 | 7.54 GB | 27 Jul 2022 - 18:28 |
Yahoo Slurp | 16 | 1.94 GB | 24 Jul 2022 - 20:35 |
archive.org bot | 13 | 1.36 GB | 17 Jul 2022 - 18:15 |
WordPress | 12 | 93.63 KB | 12 Jul 2022 - 07:34 |
CFNetwork | 10 | 5.13 GB | 30 Jul 2022 - 20:39 |
Feedburner | 8 | 0 | 27 Jul 2022 - 07:35 |
360spider | 7 | 21.45 MB | 15 Jul 2022 - 23:32 |
Sogou Spider | 7 | 23.45 KB | 26 Jul 2022 - 07:14 |
Netcraft | 5 | 16.50 KB | 22 Jul 2022 - 11:05 |
A PHP script | 4 | 15.40 KB | 21 Jul 2022 - 00:50 |
microsoft-webdav-miniredir | 3 | 0 | 17 Jul 2022 - 15:38 |
HTTrack off-line browser | 3 | 5.70 KB | 01 Jul 2022 - 09:33 |
W3C Validator | 3 | 9.51 KB | 15 Jul 2022 - 20:19 |
Nutch | 3 | 28.70 KB | 31 Jul 2022 - 23:01 |
Unknown robot (identified by 'robot') | 2 | 6.70 KB | 12 Jul 2022 - 01:16 |
ning | 2 | 22.00 KB | 18 Jul 2022 - 23:52 |
Feedfetcher-Google | 2 | 3.53 KB | 22 Jul 2022 - 17:49 |
ComputingSite Robi/1.0 | 1 | 3.35 KB | 17 Jul 2022 - 19:42 |
Microsoft URL Control | 1 | 2.82 KB | 19 Jul 2022 - 16:59 |
xydo | 1 | 5.73 KB | 13 Jul 2022 - 17:13 |
MSNBot | 1 | 3.35 KB | 19 Jul 2022 - 13:17 |
Unknown robot (identified by 'discovery') | 1 | 7.61 KB | 16 Jul 2022 - 03:26 |
Suspected bot masquerading as M$ IE | 1 | 15.32 MB | 05 Jul 2022 - 05:28 |
AdsBot-Google | 1 | 3.95 KB | 15 Jul 2022 - 20:19 |
|