51 different robots | Hits | Bandwidth | Last visit |
WGet tools | 3,792,291 | 15212.08 GB | 31 Dec 2022 - 23:59 |
SemrushBot | 165,011 | 79.18 GB | 31 Dec 2022 - 23:59 |
Unknown robot (identified by 'crawl') | 136,251 | 751.02 GB | 31 Dec 2022 - 23:59 |
Bingbot | 31,099 | 538.85 GB | 31 Dec 2022 - 23:58 |
DotBot, Open Site Explorer | 5,320 | 139.57 GB | 31 Dec 2022 - 23:57 |
check_http (nagios) | 8,866 | 29.00 MB | 31 Dec 2022 - 23:57 |
Suspected bot masqurading as Mozilla | 1,135 | 134.74 MB | 31 Dec 2022 - 23:56 |
Googlebot | 7,544 | 338.17 GB | 31 Dec 2022 - 23:49 |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,804 | 173.86 GB | 31 Dec 2022 - 23:49 |
Unknown robot (identified by 'spider') | 1,414 | 69.26 GB | 31 Dec 2022 - 23:48 |
WordPress | 12 | 90.86 MB | 31 Dec 2022 - 23:45 |
AhrefsBot | 22,098 | 24.50 GB | 31 Dec 2022 - 23:41 |
Unknown robot (identified by empty user agent string) | 11,437 | 99.38 GB | 31 Dec 2022 - 23:35 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 12,871 | 208.54 GB | 31 Dec 2022 - 23:30 |
Java (Often spam bot) | 544 | 1.34 GB | 31 Dec 2022 - 23:23 |
Yandex Bot | 1,532 | 51.97 GB | 31 Dec 2022 - 23:13 |
MojeekBot | 166 | 8.60 MB | 31 Dec 2022 - 22:40 |
Python-urllib | 3,377 | 16.49 GB | 31 Dec 2022 - 22:04 |
FavIconizer | 130 | 436.91 KB | 31 Dec 2022 - 21:59 |
Custo | 436 | 1.44 MB | 31 Dec 2022 - 21:22 |
Googlebot-Image | 129 | 53.41 MB | 31 Dec 2022 - 21:21 |
LinkChecker | 160 | 520.50 MB | 31 Dec 2022 - 20:52 |
SeznamBot | 82 | 16.88 MB | 31 Dec 2022 - 18:55 |
FaceBook bot | 157 | 12.20 GB | 31 Dec 2022 - 18:46 |
MJ12bot | 1,810 | 32.50 GB | 31 Dec 2022 - 18:24 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 9 | 30.27 KB | 31 Dec 2022 - 13:30 |
Perl tool | 146 | 11.31 GB | 31 Dec 2022 - 12:00 |
yeti | 24 | 264.34 MB | 31 Dec 2022 - 11:35 |
Suspected bot masqurading as Mozilla | 705 | 2.68 GB | 31 Dec 2022 - 11:24 |
GigablastOpenSource, an Open Source Search Engine(Wiki) | 121 | 27.43 KB | 31 Dec 2022 - 10:42 |
BaiDuSpider | 291 | 17.45 GB | 31 Dec 2022 - 08:18 |
A PHP script | 1 | 3.39 KB | 31 Dec 2022 - 07:32 |
Bing Preview bot | 15 | 1.71 GB | 31 Dec 2022 - 07:21 |
YaCy | 79 | 5.62 GB | 31 Dec 2022 - 07:14 |
Sogou Spider | 14 | 47.23 KB | 29 Dec 2022 - 09:08 |
Motor | 17 | 3.58 GB | 29 Dec 2022 - 05:04 |
twitterbot | 22 | 14.07 GB | 28 Dec 2022 - 22:32 |
HKU WWW Octopus | 1 | 3.62 GB | 27 Dec 2022 - 22:56 |
Netcraft | 8 | 26.88 KB | 27 Dec 2022 - 00:56 |
Mail.ru bot | 135 | 5.02 GB | 25 Dec 2022 - 18:52 |
Web Core / Roots | 25 | 1.14 GB | 25 Dec 2022 - 16:45 |
SEOkicks Webcrawler | 110 | 1.45 GB | 25 Dec 2022 - 16:31 |
archive.org bot | 29 | 198.16 KB | 24 Dec 2022 - 01:44 |
Yahoo Slurp | 13 | 2.34 GB | 24 Dec 2022 - 01:24 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,139 | 335.03 MB | 22 Dec 2022 - 08:40 |
CFNetwork | 4 | 7.63 GB | 21 Dec 2022 - 01:09 |
InternetArchive | 2 | 20.38 KB | 14 Dec 2022 - 01:53 |
Cfetch | 1 | 612.49 KB | 12 Dec 2022 - 19:18 |
Common Crawl | 1,911 | 5.30 GB | 09 Dec 2022 - 07:08 |
Facebot (Facebook bot?) | 1 | 3.27 KB | 08 Dec 2022 - 15:59 |
ning | 15 | 3.17 MB | 05 Dec 2022 - 19:48 |
|