62 different robots | Hits | Bandwidth | Last visit |
WGet tools | 2,486,648 | 6779.37 GB | 28 Feb 2021 - 23:59 |
Bingbot | 59,554 | 493.04 GB | 28 Feb 2021 - 23:59 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 86,764 | 490.91 GB | 28 Feb 2021 - 23:59 |
SemrushBot | 11,425 | 83.19 GB | 28 Feb 2021 - 23:58 |
ltx71 | 235 | 33.50 GB | 28 Feb 2021 - 23:56 |
AhrefsBot | 8,992 | 152.19 GB | 28 Feb 2021 - 23:55 |
check_http (nagios) | 7,982 | 25.78 MB | 28 Feb 2021 - 23:52 |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,764 | 97.79 GB | 28 Feb 2021 - 23:52 |
DotBot, Open Site Explorer | 2,126 | 23.69 GB | 28 Feb 2021 - 23:50 |
Yandex Bot | 1,564 | 22.48 GB | 28 Feb 2021 - 23:47 |
Python-urllib | 2,661 | 18.33 GB | 28 Feb 2021 - 23:41 |
Googlebot | 4,920 | 33.13 GB | 28 Feb 2021 - 23:31 |
Unknown robot (identified by 'crawl') | 30,931 | 282.65 GB | 28 Feb 2021 - 23:28 |
Unknown robot (identified by empty user agent string) | 37,559 | 213.50 GB | 28 Feb 2021 - 23:25 |
YaCy | 198 | 10.61 GB | 28 Feb 2021 - 22:25 |
Unknown robot (identified by 'spider') | 4,435 | 24.95 GB | 28 Feb 2021 - 22:04 |
Java (Often spam bot) | 694 | 7.52 GB | 28 Feb 2021 - 21:06 |
Suspected bot masqurading as Mozilla | 43 | 45.86 MB | 28 Feb 2021 - 21:05 |
FavIconizer | 159 | 558.92 KB | 28 Feb 2021 - 20:42 |
Perl tool | 417 | 8.29 GB | 28 Feb 2021 - 18:17 |
MJ12bot | 978 | 11.82 GB | 28 Feb 2021 - 18:03 |
Netcraft | 9 | 29.77 KB | 28 Feb 2021 - 17:49 |
Sift | 16 | 53.22 KB | 28 Feb 2021 - 17:43 |
BaiDuSpider | 107 | 7.35 GB | 28 Feb 2021 - 13:34 |
Suspected bot masqurading as Mozilla | 118 | 415.35 MB | 28 Feb 2021 - 11:54 |
MojeekBot | 36 | 15.82 MB | 28 Feb 2021 - 11:39 |
Bing Preview bot | 140 | 16.56 GB | 28 Feb 2021 - 10:56 |
Googlebot-Image | 84 | 4.42 MB | 28 Feb 2021 - 09:25 |
Custo | 31 | 102.83 KB | 28 Feb 2021 - 06:55 |
LinkChecker | 105 | 50.93 MB | 28 Feb 2021 - 01:31 |
Mail.ru bot | 241 | 54.68 MB | 27 Feb 2021 - 23:46 |
Unknown robot (identified by 'robot') | 140 | 1.60 GB | 27 Feb 2021 - 19:46 |
FaceBook bot | 77 | 1.96 GB | 27 Feb 2021 - 18:35 |
SeznamBot | 91 | 1.84 GB | 27 Feb 2021 - 12:14 |
Common Crawl | 170 | 350.30 MB | 27 Feb 2021 - 08:00 |
Anthill | 12 | 137.25 KB | 27 Feb 2021 - 07:00 |
Sogou Spider | 8 | 26.42 KB | 26 Feb 2021 - 19:34 |
WordPress | 58 | 4.29 GB | 26 Feb 2021 - 15:57 |
360spider | 10 | 16.66 MB | 26 Feb 2021 - 14:36 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 4,410 | 465.18 MB | 26 Feb 2021 - 07:50 |
twitterbot | 15 | 2.10 GB | 25 Feb 2021 - 22:26 |
WebCopy | 5 | 2.12 GB | 25 Feb 2021 - 16:18 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 2 | 6.70 KB | 24 Feb 2021 - 02:54 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 38 | 212.29 KB | 22 Feb 2021 - 17:13 |
Web Core / Roots | 16 | 451.27 MB | 22 Feb 2021 - 14:06 |
yeti | 26 | 124.22 KB | 22 Feb 2021 - 07:55 |
MagpieRSS | 734 | 135.43 GB | 21 Feb 2021 - 04:25 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 8.39 KB | 19 Feb 2021 - 17:23 |
SEOkicks Webcrawler | 692 | 16.51 GB | 19 Feb 2021 - 03:29 |
Unknown robot (identified by 'discovery') | 16 | 51.83 KB | 18 Feb 2021 - 22:16 |
Nutch | 50 | 14.63 GB | 18 Feb 2021 - 05:58 |
HTTrack off-line browser | 3 | 49.10 MB | 17 Feb 2021 - 07:35 |
Exabot | 1 | 64.65 KB | 08 Feb 2021 - 12:49 |
GigaBot | 3 | 1.49 MB | 07 Feb 2021 - 10:07 |
ning | 11 | 29.41 KB | 07 Feb 2021 - 08:36 |
CMS Crawler | 1 | 3.35 KB | 06 Feb 2021 - 19:38 |
Powermarks | 3 | 10.05 KB | 05 Feb 2021 - 20:09 |
MSIECrawler | 6 | 20.10 KB | 04 Feb 2021 - 22:21 |
Yahoo Slurp | 1 | 1.14 MB | 03 Feb 2021 - 22:33 |
InternetArchive | 1 | 14.44 KB | 02 Feb 2021 - 19:55 |
archive.org bot | 2 | 2.20 KB | 02 Feb 2021 - 19:09 |
LinkBot | 1 | 0 | 02 Feb 2021 - 12:54 |
|