43 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 18,137 | 121.36 GB | 30 Sep 2021 - 22:50 |
SemrushBot | 4,673 | 397.01 GB | 30 Sep 2021 - 23:57 |
AhrefsBot | 3,459 | 65.28 GB | 30 Sep 2021 - 23:49 |
Unknown robot (identified by 'crawl') | 3,096 | 138.06 GB | 30 Sep 2021 - 16:11 |
Bingbot | 2,132 | 57.58 GB | 30 Sep 2021 - 23:09 |
Web Core / Roots | 1,434 | 2.22 GB | 30 Sep 2021 - 23:15 |
Googlebot | 1,364 | 13.16 GB | 30 Sep 2021 - 22:10 |
Yandex Bot | 1,320 | 32.60 GB | 30 Sep 2021 - 23:41 |
Perl tool | 751 | 3.01 MB | 30 Sep 2021 - 18:07 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 508 | 17.87 GB | 30 Sep 2021 - 23:52 |
DotBot, Open Site Explorer | 482 | 18.01 GB | 30 Sep 2021 - 23:46 |
Unknown robot (identified by 'spider') | 364 | 22.34 GB | 30 Sep 2021 - 19:35 |
MJ12bot | 332 | 16.72 GB | 30 Sep 2021 - 04:41 |
Nutch | 271 | 25.99 GB | 30 Sep 2021 - 03:45 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 265 | 169.20 MB | 30 Sep 2021 - 19:38 |
Unknown robot (identified by empty user agent string) | 221 | 15.86 GB | 30 Sep 2021 - 23:15 |
Google Web Preview | 168 | 4.15 GB | 30 Sep 2021 - 20:49 |
FaceBook bot | 165 | 870.81 MB | 30 Sep 2021 - 02:15 |
Python-urllib | 128 | 2.01 GB | 30 Sep 2021 - 11:57 |
WGet tools | 125 | 2.16 GB | 30 Sep 2021 - 23:05 |
LinkChecker | 124 | 0 | 30 Sep 2021 - 21:53 |
Common Crawl | 93 | 33.73 MB | 30 Sep 2021 - 15:02 |
rpt-httpclient | 44 | 304.42 MB | 30 Sep 2021 - 18:17 |
ltx71 | 22 | 2.65 GB | 17 Sep 2021 - 05:50 |
yeti | 20 | 154.71 MB | 30 Sep 2021 - 02:00 |
MojeekBot | 19 | 71.60 KB | 30 Sep 2021 - 13:37 |
Java (Often spam bot) | 18 | 958.55 MB | 16 Sep 2021 - 22:08 |
SeznamBot | 14 | 83.75 KB | 30 Sep 2021 - 20:36 |
Bing Preview bot | 12 | 989.95 MB | 30 Sep 2021 - 13:02 |
BaiDuSpider | 12 | 333.93 MB | 28 Sep 2021 - 10:39 |
CFNetwork | 11 | 297.82 MB | 21 Sep 2021 - 09:15 |
Mail.ru bot | 10 | 57.49 MB | 30 Sep 2021 - 16:50 |
SEOkicks Webcrawler | 9 | 30.24 KB | 05 Sep 2021 - 21:50 |
Sogou Spider | 7 | 4.65 MB | 22 Sep 2021 - 18:29 |
Suspected bot masqurading as Mozilla | 4 | 0 | 21 Sep 2021 - 03:15 |
Unknown robot (identified by 'sucker') | 4 | 32.55 MB | 18 Sep 2021 - 07:57 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2 | 6.17 KB | 15 Sep 2021 - 07:26 |
Emacs-w3 Search Engine | 2 | 15.84 MB | 16 Sep 2021 - 07:05 |
twitterbot | 1 | 2.47 KB | 29 Sep 2021 - 09:58 |
Cfetch | 1 | 7.92 MB | 27 Sep 2021 - 17:14 |
Motor | 1 | 7.46 MB | 23 Sep 2021 - 22:22 |
Y!J Yahoo Japan | 1 | 8.11 MB | 18 Sep 2021 - 00:01 |
LinkBot | 1 | 0 | 08 Sep 2021 - 16:42 |
|