49 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 9,224 | 38.22 GB | 30 Nov 2019 - 23:58 |
AhrefsBot | 7,768 | 331.49 GB | 30 Nov 2019 - 23:54 |
Alexa (IA Archiver) | 167 | 57.23 MB | 30 Nov 2019 - 23:50 |
Yandex Bot | 1,871 | 17.77 GB | 30 Nov 2019 - 23:45 |
Perl tool | 258 | 7.44 MB | 30 Nov 2019 - 23:42 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4,112 | 621.90 GB | 30 Nov 2019 - 23:36 |
WGet tools | 22,388 | 1153.71 GB | 30 Nov 2019 - 23:34 |
LinkChecker | 218 | 0 | 30 Nov 2019 - 23:33 |
Python-urllib | 1,425 | 297.83 GB | 30 Nov 2019 - 23:02 |
Unknown robot (identified by empty user agent string) | 1,995 | 114.08 GB | 30 Nov 2019 - 23:00 |
Bingbot | 297 | 220.98 MB | 30 Nov 2019 - 22:19 |
Googlebot | 263 | 1.80 GB | 30 Nov 2019 - 21:35 |
archive.org bot | 8 | 231.76 MB | 30 Nov 2019 - 21:12 |
DotBot, Open Site Explorer | 2,513 | 48.69 GB | 30 Nov 2019 - 20:10 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 258 | 42.57 MB | 30 Nov 2019 - 17:24 |
FaceBook bot | 45 | 3.68 MB | 30 Nov 2019 - 16:47 |
Unknown robot (identified by 'crawl') | 2,657 | 26.71 GB | 30 Nov 2019 - 16:35 |
Jakarta commons-httpclient | 41 | 656 Bytes | 30 Nov 2019 - 15:01 |
MJ12bot | 21 | 111.58 MB | 30 Nov 2019 - 14:14 |
BaiDuSpider | 34 | 34.45 MB | 30 Nov 2019 - 12:28 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 13,664+1 | 68.85 GB | 30 Nov 2019 - 11:09 |
Cliqzbot | 4 | 2.93 MB | 29 Nov 2019 - 22:08 |
ltx71 | 39 | 348.11 MB | 29 Nov 2019 - 17:27 |
Web Core / Roots | 16 | 429.03 MB | 29 Nov 2019 - 14:10 |
Unknown robot (identified by 'robot') | 10 | 54.50 KB | 29 Nov 2019 - 13:06 |
Sogou Spider | 11 | 12.20 MB | 29 Nov 2019 - 05:41 |
CFNetwork | 316 | 9.07 GB | 28 Nov 2019 - 22:56 |
Unknown robot (identified by 'spider') | 15 | 73.35 MB | 28 Nov 2019 - 19:07 |
SeznamBot | 10 | 50.21 KB | 28 Nov 2019 - 17:18 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 3 | 16.06 KB | 28 Nov 2019 - 08:55 |
LinkBot | 1 | 0 | 27 Nov 2019 - 09:14 |
Java (Often spam bot) | 1,175 | 28.33 GB | 27 Nov 2019 - 06:07 |
Motor | 1 | 28.60 MB | 24 Nov 2019 - 15:32 |
Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 22 Nov 2019 - 17:25 |
Common Crawl | 48 | 324.67 KB | 22 Nov 2019 - 16:16 |
FavIconizer | 4 | 57.20 MB | 22 Nov 2019 - 13:35 |
Unknown robot (identified by 'checker') | 1 | 392.05 KB | 21 Nov 2019 - 13:28 |
BBot | 1 | 28.60 MB | 19 Nov 2019 - 10:24 |
WordPress | 6 | 3.58 KB | 17 Nov 2019 - 17:40 |
MSNBot | 3 | 2.94 MB | 16 Nov 2019 - 02:57 |
DragonBot | 1 | 3.58 KB | 15 Nov 2019 - 18:07 |
Vagabondo | 1 | 7.00 KB | 14 Nov 2019 - 11:06 |
Simmany Robot Ver1.0 | 2 | 8.54 KB | 13 Nov 2019 - 15:36 |
MojeekBot | 1 | 52.10 KB | 12 Nov 2019 - 15:04 |
twitterbot | 1 | 8.04 KB | 11 Nov 2019 - 09:50 |
ning | 2 | 57.21 MB | 10 Nov 2019 - 10:02 |
360spider | 1 | 2.61 KB | 04 Nov 2019 - 02:40 |
Wotbox | 2 | 9.49 KB | 03 Nov 2019 - 17:15 |
Nutch | 31 | 198.83 KB | 03 Nov 2019 - 09:31 |
|