54 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 43,911 | 295.42 GB | 31 Oct 2020 - 23:09 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,918 | 139.26 GB | 31 Oct 2020 - 23:08 |
Googlebot | 1,540 | 22.61 GB | 31 Oct 2020 - 23:07 |
SemrushBot | 10,684 | 561.14 GB | 31 Oct 2020 - 23:06 |
AhrefsBot | 5,900 | 166.32 GB | 31 Oct 2020 - 22:51 |
Bingbot | 1,398 | 10.15 GB | 31 Oct 2020 - 22:49 |
Alexa (IA Archiver) | 25 | 7.70 MB | 31 Oct 2020 - 22:45 |
SeznamBot | 39 | 74.10 MB | 31 Oct 2020 - 22:30 |
FaceBook bot | 81 | 1.13 GB | 31 Oct 2020 - 22:20 |
DotBot, Open Site Explorer | 210 | 2.00 GB | 31 Oct 2020 - 20:35 |
Unknown robot (identified by 'crawl') | 1,908 | 70.95 GB | 31 Oct 2020 - 20:30 |
WGet tools | 56 | 1.77 GB | 31 Oct 2020 - 20:28 |
Google Web Preview | 57 | 413.55 MB | 31 Oct 2020 - 19:43 |
Yandex Bot | 1,044 | 40.85 GB | 31 Oct 2020 - 18:44 |
rpt-httpclient | 62 | 152.21 MB | 31 Oct 2020 - 18:42 |
Suspected bot masqurading as Mozilla | 28 | 52.34 MB | 31 Oct 2020 - 18:27 |
ltx71 | 142 | 12.94 GB | 31 Oct 2020 - 18:13 |
Java (Often spam bot) | 169 | 5.14 GB | 31 Oct 2020 - 17:39 |
LinkBot | 1 | 0 | 31 Oct 2020 - 14:36 |
Sogou Spider | 12 | 30.91 MB | 31 Oct 2020 - 13:22 |
Mail.ru bot | 13 | 30.34 MB | 31 Oct 2020 - 12:21 |
Unknown robot (identified by empty user agent string) | 156 | 4.53 GB | 31 Oct 2020 - 11:52 |
CFNetwork | 1,813 | 391.51 MB | 31 Oct 2020 - 11:21 |
Common Crawl | 25 | 167.20 MB | 31 Oct 2020 - 11:11 |
LinkChecker | 121 | 0 | 31 Oct 2020 - 10:58 |
Web Core / Roots | 67 | 1.33 GB | 31 Oct 2020 - 10:43 |
Y!J Yahoo Japan | 1 | 7.68 MB | 31 Oct 2020 - 08:15 |
Python-urllib | 21 | 2.01 GB | 31 Oct 2020 - 07:01 |
MJ12bot | 152 | 7.89 GB | 31 Oct 2020 - 04:09 |
Unknown robot (identified by 'spider') | 113 | 3.47 GB | 31 Oct 2020 - 00:31 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 646 | 3.06 MB | 30 Oct 2020 - 14:36 |
yeti | 51 | 381.24 MB | 30 Oct 2020 - 14:21 |
MojeekBot | 1 | 11.42 KB | 28 Oct 2020 - 16:08 |
Bing Preview bot | 16 | 1.24 GB | 28 Oct 2020 - 05:40 |
BaiDuSpider | 20 | 352.28 MB | 27 Oct 2020 - 06:22 |
Motor | 4 | 27.24 KB | 27 Oct 2020 - 00:25 |
WordPress | 81 | 782.87 MB | 26 Oct 2020 - 12:28 |
twitterbot | 12 | 146.94 MB | 26 Oct 2020 - 08:00 |
Suspected bot masqurading as Mozilla | 3 | 0 | 26 Oct 2020 - 01:19 |
Unknown robot (identified by 'robot') | 3 | 7.84 MB | 25 Oct 2020 - 23:02 |
Emacs-w3 Search Engine | 1 | 398.31 MB | 24 Oct 2020 - 07:49 |
ning | 4 | 167.51 MB | 23 Oct 2020 - 19:03 |
HTTrack off-line browser | 4 | 419.77 MB | 23 Oct 2020 - 07:38 |
FavIconizer | 16 | 98.33 MB | 22 Oct 2020 - 15:32 |
Cfetch | 5 | 37.17 MB | 22 Oct 2020 - 08:59 |
360spider | 2 | 123.88 MB | 20 Oct 2020 - 02:26 |
Google AdSense | 7 | 437.89 MB | 17 Oct 2020 - 06:33 |
windows-rss-platform | 510 | 5.78 KB | 14 Oct 2020 - 16:26 |
SEOkicks Webcrawler | 2 | 7.14 KB | 14 Oct 2020 - 00:33 |
Perl tool | 11 | 262.95 KB | 13 Oct 2020 - 22:00 |
Feedfetcher-Google | 13 | 3.86 KB | 13 Oct 2020 - 19:58 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 3 | 0 | 08 Oct 2020 - 18:08 |
archive.org bot | 2 | 106.37 MB | 06 Oct 2020 - 19:48 |
WWWC Ver 0.2.5 | 1 | 0 | 05 Oct 2020 - 15:40 |
|