51 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 23,707 | 149.11 GB | 31 Aug 2020 - 21:10 |
AhrefsBot | 9,592 | 377.19 GB | 31 Aug 2020 - 21:01 |
SemrushBot | 7,488 | 557.90 GB | 31 Aug 2020 - 21:06 |
CFNetwork | 3,749 | 379.78 MB | 31 Aug 2020 - 14:12 |
Unknown robot (identified by 'crawl') | 2,814 | 103.66 GB | 31 Aug 2020 - 21:04 |
Googlebot | 1,892 | 22.19 GB | 31 Aug 2020 - 20:53 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,460 | 33.53 GB | 31 Aug 2020 - 21:09 |
Bingbot | 1,308 | 17.74 GB | 31 Aug 2020 - 21:00 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,247 | 174.23 MB | 28 Aug 2020 - 09:29 |
Yandex Bot | 974 | 32.77 GB | 31 Aug 2020 - 20:19 |
Perl tool | 790 | 3.56 MB | 31 Aug 2020 - 02:38 |
DotBot, Open Site Explorer | 790 | 16.45 GB | 31 Aug 2020 - 19:17 |
MJ12bot | 270 | 3.81 GB | 31 Aug 2020 - 20:48 |
LinkChecker | 221 | 0 | 31 Aug 2020 - 10:31 |
Unknown robot (identified by empty user agent string) | 180 | 7.63 GB | 31 Aug 2020 - 20:13 |
Java (Often spam bot) | 107 | 1.26 GB | 30 Aug 2020 - 22:55 |
Web Core / Roots | 101 | 5.36 GB | 31 Aug 2020 - 02:28 |
WordPress | 78 | 1.31 GB | 24 Aug 2020 - 17:24 |
WGet tools | 73 | 2.21 GB | 31 Aug 2020 - 20:34 |
ltx71 | 70 | 6.30 GB | 28 Aug 2020 - 11:45 |
rpt-httpclient | 61 | 152.21 MB | 31 Aug 2020 - 19:11 |
FavIconizer | 55 | 345.62 MB | 31 Aug 2020 - 20:14 |
Google Web Preview | 41 | 294.07 MB | 31 Aug 2020 - 19:47 |
FaceBook bot | 37 | 324.33 MB | 30 Aug 2020 - 19:00 |
Feedfetcher-Google | 31 | 9.96 KB | 31 Aug 2020 - 19:54 |
Suspected bot masqurading as Mozilla | 29 | 0 | 31 Aug 2020 - 16:06 |
Bing Preview bot | 27 | 1.69 GB | 31 Aug 2020 - 16:46 |
Unknown robot (identified by 'spider') | 24 | 702.82 MB | 26 Aug 2020 - 17:30 |
Alexa (IA Archiver) | 21 | 7.31 MB | 29 Aug 2020 - 05:30 |
SeznamBot | 19 | 97.48 MB | 31 Aug 2020 - 19:24 |
Python-urllib | 18 | 1023.73 MB | 27 Aug 2020 - 17:03 |
Sogou Spider | 16 | 52.27 MB | 18 Aug 2020 - 01:40 |
Common Crawl | 13 | 23.39 MB | 13 Aug 2020 - 05:41 |
BaiDuSpider | 13 | 152.52 MB | 31 Aug 2020 - 00:06 |
BUbiNG | 8 | 27.03 KB | 31 Aug 2020 - 06:48 |
Suspected bot masqurading as Mozilla | 7 | 15.45 MB | 27 Aug 2020 - 00:58 |
ning | 6 | 166.42 MB | 12 Aug 2020 - 18:53 |
Google AdSense | 5 | 107.76 MB | 31 Aug 2020 - 20:35 |
yeti | 4 | 420.77 MB | 23 Aug 2020 - 00:54 |
twitterbot | 4 | 1.17 GB | 22 Aug 2020 - 13:03 |
Xenu's Link Sleuth (TM), see Wikipedia | 3 | 0 | 20 Aug 2020 - 14:06 |
LinkBot | 3 | 3.69 KB | 16 Aug 2020 - 06:27 |
MojeekBot | 3 | 8.87 KB | 26 Aug 2020 - 18:40 |
Yahoo Slurp | 2 | 7.46 MB | 22 Aug 2020 - 19:23 |
Cfetch | 2 | 14.64 MB | 25 Aug 2020 - 13:25 |
Motor | 2 | 14.64 MB | 25 Aug 2020 - 16:12 |
Unknown robot (identified by 'checker') | 2 | 7.39 KB | 18 Aug 2020 - 10:54 |
Mail.ru bot | 2 | 1.46 MB | 05 Aug 2020 - 01:48 |
InternetArchive | 1 | 0 | 23 Aug 2020 - 14:01 |
Suspected bot masqurading as Mozilla | 1 | 398.31 MB | 28 Aug 2020 - 17:33 |
360spider | 1 | 9.95 KB | 24 Aug 2020 - 20:58 |
|