55 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 6,672 | 377.78 GB | 30 Nov 2019 - 23:59 |
Unknown robot (identified by 'crawl') | 1,101 | 10.60 GB | 30 Nov 2019 - 23:51 |
Yandex Bot | 1,892 | 177.60 GB | 30 Nov 2019 - 23:45 |
DotBot, Open Site Explorer | 366 | 12.15 GB | 30 Nov 2019 - 23:40 |
Googlebot | 1,722 | 21.24 GB | 30 Nov 2019 - 23:31 |
BaiDuSpider | 85 | 5.04 GB | 30 Nov 2019 - 23:29 |
WGet tools | 121 | 5.73 GB | 30 Nov 2019 - 23:25 |
Suspected bot masqurading as Mozilla | 14 | 0 | 30 Nov 2019 - 23:23 |
Java (Often spam bot) | 337 | 13.04 GB | 30 Nov 2019 - 23:22 |
AhrefsBot | 1,373 | 62.57 GB | 30 Nov 2019 - 23:18 |
Bingbot | 1,200 | 7.93 GB | 30 Nov 2019 - 23:17 |
Unknown robot (identified by empty user agent string) | 172 | 6.35 GB | 30 Nov 2019 - 23:17 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 608 | 5.18 GB | 30 Nov 2019 - 23:03 |
MSNBot | 73 | 2.41 GB | 30 Nov 2019 - 22:50 |
Common *nix tool for automating web document retireval. Most likely a bot. | 10,389 | 67.61 GB | 30 Nov 2019 - 22:17 |
rpt-httpclient | 90 | 304.42 MB | 30 Nov 2019 - 21:17 |
WordPress | 28 | 0 | 30 Nov 2019 - 21:08 |
CFNetwork | 1,055 | 1.41 GB | 30 Nov 2019 - 20:26 |
Bing Preview bot | 179 | 2.89 GB | 30 Nov 2019 - 20:19 |
Feedfetcher-Google | 30 | 19.03 KB | 30 Nov 2019 - 18:13 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 169 | 22.42 MB | 30 Nov 2019 - 17:23 |
Alexa (IA Archiver) | 199 | 22.26 GB | 30 Nov 2019 - 13:00 |
Web Core / Roots | 276 | 20.05 GB | 30 Nov 2019 - 12:25 |
MJ12bot | 30 | 1009.18 MB | 30 Nov 2019 - 12:15 |
FavIconizer | 82 | 598.00 MB | 30 Nov 2019 - 11:36 |
LinkChecker | 173 | 0 | 30 Nov 2019 - 03:21 |
Sogou Spider | 28 | 64.29 MB | 30 Nov 2019 - 00:30 |
Perl tool | 29 | 577.23 KB | 29 Nov 2019 - 23:00 |
Cliqzbot | 36 | 225.11 MB | 29 Nov 2019 - 22:03 |
SeznamBot | 27 | 36.05 MB | 29 Nov 2019 - 20:56 |
Python-urllib | 15 | 1.38 GB | 29 Nov 2019 - 13:23 |
Suspected bot masqurading as Mozilla | 30 | 0 | 29 Nov 2019 - 08:04 |
ning | 5 | 351.76 MB | 27 Nov 2019 - 17:05 |
Unknown robot (identified by 'spider') | 47 | 1.25 GB | 27 Nov 2019 - 00:40 |
yeti | 1 | 7.10 MB | 26 Nov 2019 - 14:31 |
Motor | 11 | 125.62 MB | 26 Nov 2019 - 03:59 |
FaceBook bot | 44 | 363.22 MB | 25 Nov 2019 - 22:02 |
Nutch | 23 | 14.52 MB | 24 Nov 2019 - 18:06 |
Google AdSense | 2 | 108.46 MB | 24 Nov 2019 - 15:40 |
InternetArchive | 2 | 0 | 24 Nov 2019 - 06:23 |
A PHP script | 3 | 21.67 MB | 23 Nov 2019 - 11:56 |
Common Crawl | 48 | 28.99 MB | 22 Nov 2019 - 20:47 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 106 | 8.71 GB | 21 Nov 2019 - 19:27 |
lwp-trivial | 1 | 7.18 MB | 20 Nov 2019 - 15:00 |
Mail.ru bot | 1 | 9.95 KB | 19 Nov 2019 - 04:12 |
360spider | 4 | 33.37 KB | 16 Nov 2019 - 16:23 |
Unknown robot (identified by 'robot') | 7 | 14.49 MB | 15 Nov 2019 - 12:53 |
Vagabondo | 1 | 3.69 KB | 14 Nov 2019 - 10:57 |
twitterbot | 1 | 20.07 KB | 13 Nov 2019 - 23:16 |
MojeekBot | 1 | 9.07 KB | 13 Nov 2019 - 07:50 |
microsoft-webdav-miniredir | 7 | 0 | 10 Nov 2019 - 18:27 |
Turn It In | 6 | 145.06 MB | 07 Nov 2019 - 09:08 |
archive.org bot | 2 | 11.54 KB | 04 Nov 2019 - 02:26 |
Exabot | 1 | 7.13 MB | 04 Nov 2019 - 01:13 |
Wotbox | 2 | 7.27 KB | 03 Nov 2019 - 17:15 |