48 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 7,241 | 185.97 GB | 31 Mar 2021 - 23:10 |
Bingbot | 14,056 | 102.31 GB | 31 Mar 2021 - 23:10 |
Unknown robot (identified by 'crawl') | 7,085 | 607.57 GB | 31 Mar 2021 - 23:08 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4,026 | 912.82 GB | 31 Mar 2021 - 23:05 |
AhrefsBot | 24,077 | 854.30 GB | 31 Mar 2021 - 23:05 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,544 | 34.70 GB | 31 Mar 2021 - 23:05 |
Perl tool | 272 | 12.36 MB | 31 Mar 2021 - 23:00 |
DotBot, Open Site Explorer | 1,944 | 1.54 GB | 31 Mar 2021 - 22:58 |
Googlebot | 223 | 299.16 MB | 31 Mar 2021 - 22:46 |
CFNetwork | 205 | 6.61 GB | 31 Mar 2021 - 22:06 |
WGet tools | 4,319 | 918.21 GB | 31 Mar 2021 - 20:54 |
Unknown robot (identified by 'spider') | 167 | 66.92 GB | 31 Mar 2021 - 20:39 |
Unknown robot (identified by empty user agent string) | 981 | 55.53 GB | 31 Mar 2021 - 20:29 |
ltx71 | 90 | 26.53 GB | 31 Mar 2021 - 20:17 |
Yandex Bot | 352 | 31.45 GB | 31 Mar 2021 - 19:54 |
Web Core / Roots | 39 | 815.95 MB | 31 Mar 2021 - 19:23 |
Python-urllib | 732 | 410.67 GB | 31 Mar 2021 - 18:29 |
Suspected bot masqurading as Mozilla | 221 | 6.31 GB | 31 Mar 2021 - 17:43 |
BaiDuSpider | 3 | 101.28 MB | 31 Mar 2021 - 17:38 |
LinkChecker | 355 | 0 | 31 Mar 2021 - 16:08 |
Jakarta commons-httpclient | 32 | 512 Bytes | 31 Mar 2021 - 14:01 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 12,110+2 | 431.94 MB | 31 Mar 2021 - 13:44 |
Java (Often spam bot) | 162 | 32.50 GB | 31 Mar 2021 - 11:14 |
SeznamBot | 17 | 89.60 KB | 31 Mar 2021 - 07:27 |
HTTrack off-line browser | 4 | 1.77 MB | 30 Mar 2021 - 19:02 |
Unknown robot (identified by 'robot') | 15 | 183.17 KB | 29 Mar 2021 - 22:45 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 3 | 8.23 MB | 29 Mar 2021 - 04:55 |
archive.org bot | 8 | 240.39 MB | 29 Mar 2021 - 02:06 |
Xenu's Link Sleuth (TM), see Wikipedia | 6 | 0 | 28 Mar 2021 - 16:55 |
Unknown robot (identified by hit on 'robots.txt') | 0+4 | 24.96 KB | 28 Mar 2021 - 08:48 |
MJ12bot | 387 | 2.87 GB | 28 Mar 2021 - 08:11 |
Nutch | 12 | 108.75 GB | 27 Mar 2021 - 20:59 |
YaCy | 1 | 101.09 KB | 27 Mar 2021 - 19:28 |
Bing Preview bot | 9 | 135.52 MB | 26 Mar 2021 - 21:51 |
WordPress | 27 | 0 | 26 Mar 2021 - 17:39 |
GetURL | 32 | 559.81 MB | 26 Mar 2021 - 07:59 |
Google AdSense | 7 | 162.88 MB | 25 Mar 2021 - 14:18 |
Suspected bot masqurading as Mozilla | 1 | 3.32 KB | 24 Mar 2021 - 20:00 |
SEOkicks Webcrawler | 4 | 19.23 KB | 20 Mar 2021 - 01:40 |
twitterbot | 3 | 29.27 MB | 18 Mar 2021 - 15:42 |
Mail.ru bot | 1 | 777.78 KB | 17 Mar 2021 - 00:42 |
FavIconizer | 3 | 58.52 MB | 16 Mar 2021 - 20:40 |
MojeekBot | 1 | 98.36 KB | 13 Mar 2021 - 06:58 |
Simmany Robot Ver1.0 | 3 | 30.85 MB | 10 Mar 2021 - 17:21 |
Motor | 1 | 16.60 MB | 09 Mar 2021 - 14:13 |
Common Crawl | 7 | 81.69 MB | 09 Mar 2021 - 08:01 |
FaceBook bot | 1 | 583 Bytes | 05 Mar 2021 - 07:39 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 2 | 9.49 KB | 05 Mar 2021 - 07:13 |