57 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 28,099 | 121.75 GB | 30 Sep 2021 - 23:59 |
WGet tools | 3,557,299 | 7474.38 GB | 30 Sep 2021 - 23:59 |
Bingbot | 38,190 | 531.33 GB | 30 Sep 2021 - 23:59 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 5,990 | 88.87 GB | 30 Sep 2021 - 23:58 |
Yandex Bot | 4,973 | 169.45 GB | 30 Sep 2021 - 23:57 |
AhrefsBot | 3,225 | 56.73 GB | 30 Sep 2021 - 23:57 |
check_http (nagios) | 8,487 | 27.42 MB | 30 Sep 2021 - 23:57 |
Googlebot | 7,545 | 223.53 GB | 30 Sep 2021 - 23:55 |
DotBot, Open Site Explorer | 7,612 | 228.13 GB | 30 Sep 2021 - 23:55 |
Common Crawl | 10,366 | 78.51 GB | 30 Sep 2021 - 23:54 |
Common *nix tool for automating web document retireval. Most likely a bot. | 69,436 | 162.25 GB | 30 Sep 2021 - 23:53 |
Suspected bot masqurading as Mozilla | 613 | 149.36 MB | 30 Sep 2021 - 23:53 |
Unknown robot (identified by 'crawl') | 38,762 | 248.04 GB | 30 Sep 2021 - 23:51 |
MJ12bot | 701 | 30.26 GB | 30 Sep 2021 - 23:35 |
Unknown robot (identified by empty user agent string) | 7,371 | 85.83 GB | 30 Sep 2021 - 23:25 |
FaceBook bot | 460 | 55.57 GB | 30 Sep 2021 - 23:15 |
Custo | 174 | 573.89 KB | 30 Sep 2021 - 23:01 |
Perl tool | 342 | 7.70 GB | 30 Sep 2021 - 22:48 |
Bing Preview bot | 198 | 40.58 GB | 30 Sep 2021 - 22:03 |
YaCy | 507 | 70.72 GB | 30 Sep 2021 - 21:02 |
Unknown robot (identified by 'discovery') | 5 | 16.24 KB | 30 Sep 2021 - 20:42 |
Googlebot-Image | 179 | 13.15 MB | 30 Sep 2021 - 20:23 |
FavIconizer | 216 | 761.83 KB | 30 Sep 2021 - 20:03 |
Nutch | 15,613 | 70.97 GB | 30 Sep 2021 - 17:46 |
Python-urllib | 2,617 | 212.47 GB | 30 Sep 2021 - 17:33 |
Unknown robot (identified by 'spider') | 1,225 | 31.46 GB | 30 Sep 2021 - 16:13 |
Unknown robot (identified by 'robot') | 3 | 54.53 KB | 30 Sep 2021 - 14:53 |
SeznamBot | 111 | 17.79 MB | 30 Sep 2021 - 13:43 |
Sogou Spider | 11 | 30.23 MB | 30 Sep 2021 - 09:28 |
twitterbot | 11 | 1.41 GB | 30 Sep 2021 - 08:59 |
BaiDuSpider | 223 | 19.90 GB | 30 Sep 2021 - 05:52 |
Alexa (IA Archiver) | 70 | 69.28 MB | 30 Sep 2021 - 05:28 |
LinkChecker | 113 | 236.46 MB | 30 Sep 2021 - 05:22 |
Netcraft | 8 | 23.07 KB | 30 Sep 2021 - 05:07 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 164 | 42.50 MB | 29 Sep 2021 - 21:05 |
archive.org bot | 95 | 3.07 MB | 28 Sep 2021 - 21:52 |
MojeekBot | 120 | 17.87 MB | 28 Sep 2021 - 20:42 |
Java (Often spam bot) | 181 | 1.51 GB | 28 Sep 2021 - 19:53 |
ning | 10 | 26.19 KB | 28 Sep 2021 - 11:52 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 61 | 21.49 MB | 27 Sep 2021 - 23:04 |
Mail.ru bot | 203 | 78.89 MB | 27 Sep 2021 - 20:17 |
Suspected bot masqurading as Mozilla | 80 | 659.64 MB | 27 Sep 2021 - 17:46 |
ltx71 | 75 | 1.56 GB | 27 Sep 2021 - 16:31 |
Web Core / Roots | 38 | 402.80 MB | 27 Sep 2021 - 11:55 |
WordPress | 11 | 2.23 GB | 26 Sep 2021 - 08:44 |
Yahoo Slurp | 410 | 74.12 GB | 24 Sep 2021 - 09:26 |
CFNetwork | 3 | 396.52 MB | 22 Sep 2021 - 00:55 |
360spider | 2 | 3.35 KB | 18 Sep 2021 - 12:58 |
Motor | 1 | 559.00 MB | 15 Sep 2021 - 00:20 |
yeti | 4 | 15.07 KB | 14 Sep 2021 - 20:45 |
A PHP script | 2 | 142.47 MB | 12 Sep 2021 - 20:26 |
InfoBot | 2 | 8.90 KB | 09 Sep 2021 - 15:41 |
microsoft-webdav-miniredir | 1 | 0 | 08 Sep 2021 - 13:28 |
SEOkicks Webcrawler | 364 | 19.67 GB | 06 Sep 2021 - 12:48 |
Powermarks | 3 | 10.05 KB | 06 Sep 2021 - 03:11 |
InternetArchive | 1 | 18.23 KB | 04 Sep 2021 - 06:16 |
HTTrack off-line browser | 2 | 53.11 MB | 02 Sep 2021 - 00:02 |
|