53 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,413 | 108.05 GB | 30 Nov 2021 - 23:40 |
AhrefsBot | 5,309 | 150.19 GB | 30 Nov 2021 - 23:56 |
SemrushBot | 3,901 | 302.65 GB | 30 Nov 2021 - 23:28 |
Bingbot | 1,953 | 30.08 GB | 30 Nov 2021 - 23:48 |
Unknown robot (identified by 'crawl') | 1,622 | 86.73 GB | 30 Nov 2021 - 13:54 |
Web Core / Roots | 1,538 | 1.72 GB | 30 Nov 2021 - 23:16 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,253 | 66.93 MB | 29 Nov 2021 - 20:35 |
Googlebot | 1,225 | 12.73 GB | 30 Nov 2021 - 23:44 |
Yandex Bot | 1,174 | 27.57 GB | 30 Nov 2021 - 21:22 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,066 | 57.07 GB | 30 Nov 2021 - 23:57 |
Perl tool | 680 | 2.72 MB | 30 Nov 2021 - 03:50 |
Unknown robot (identified by 'spider') | 427 | 24.52 GB | 30 Nov 2021 - 18:24 |
DotBot, Open Site Explorer | 319 | 6.03 GB | 30 Nov 2021 - 23:23 |
Unknown robot (identified by empty user agent string) | 241 | 15.37 GB | 30 Nov 2021 - 23:12 |
MJ12bot | 157 | 2.83 GB | 30 Nov 2021 - 23:34 |
FaceBook bot | 124 | 1.84 GB | 30 Nov 2021 - 12:49 |
Google Web Preview | 124 | 1.13 GB | 30 Nov 2021 - 19:19 |
LinkChecker | 118 | 0 | 30 Nov 2021 - 14:21 |
WGet tools | 115 | 1.02 GB | 30 Nov 2021 - 16:29 |
WordPress | 102 | 3.60 GB | 26 Nov 2021 - 08:51 |
ltx71 | 92 | 5.65 GB | 30 Nov 2021 - 15:42 |
Nutch | 69 | 107.07 KB | 22 Nov 2021 - 14:29 |
rpt-httpclient | 40 | 304.42 MB | 30 Nov 2021 - 23:26 |
HTTrack off-line browser | 37 | 1.21 GB | 27 Nov 2021 - 14:21 |
Java (Often spam bot) | 32 | 26.40 MB | 23 Nov 2021 - 02:25 |
yeti | 25 | 190.39 MB | 30 Nov 2021 - 04:56 |
Bing Preview bot | 22 | 1.73 GB | 30 Nov 2021 - 18:22 |
Common Crawl | 20 | 25.24 MB | 30 Nov 2021 - 23:35 |
BaiDuSpider | 18 | 67.22 MB | 29 Nov 2021 - 14:02 |
Mail.ru bot | 17 | 53.75 MB | 28 Nov 2021 - 03:53 |
SeznamBot | 14 | 15.73 MB | 30 Nov 2021 - 17:58 |
Suspected bot masqurading as Mozilla | 14 | 63.78 KB | 15 Nov 2021 - 16:16 |
CFNetwork | 8 | 61.89 MB | 23 Nov 2021 - 02:34 |
Python-urllib | 8 | 1.00 GB | 25 Nov 2021 - 12:05 |
MojeekBot | 8 | 84.53 KB | 22 Nov 2021 - 05:54 |
FavIconizer | 7 | 55.43 MB | 20 Nov 2021 - 01:54 |
Alexa (IA Archiver) | 5 | 54.37 KB | 05 Nov 2021 - 20:34 |
Motor | 5 | 33.35 MB | 15 Nov 2021 - 20:27 |
YaCy | 5 | 460.84 MB | 25 Nov 2021 - 21:06 |
twitterbot | 4 | 7.95 MB | 26 Nov 2021 - 14:47 |
Suspected bot masqurading as Mozilla | 3 | 0 | 30 Nov 2021 - 03:40 |
Unknown robot (identified by 'sucker') | 3 | 23.42 MB | 07 Nov 2021 - 20:20 |
Sogou Spider | 3 | 16.81 MB | 24 Nov 2021 - 15:32 |
Anthill | 2 | 5.02 KB | 09 Nov 2021 - 17:14 |
Unknown robot (identified by 'robot') | 2 | 9.19 MB | 24 Nov 2021 - 11:32 |
SEOkicks Webcrawler | 2 | 6.04 KB | 02 Nov 2021 - 00:00 |
Fish search | 1 | 13.71 KB | 06 Nov 2021 - 13:43 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 53.88 MB | 21 Nov 2021 - 04:00 |
AdsBot-Google | 1 | 7.92 MB | 03 Nov 2021 - 08:12 |
The Tweeted Times | 1 | 13.83 KB | 05 Nov 2021 - 21:39 |
archive.org bot | 1 | 7.92 MB | 28 Nov 2021 - 15:37 |
GigaBot | 1 | 7.92 MB | 26 Nov 2021 - 14:47 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 13.83 KB | 05 Nov 2021 - 20:34 |
|