45 different robots | Hits | Bandwidth | Last visit |
DotBot, Open Site Explorer | 4,707 | 32.01 GB | 30 Jun 2017 - 23:57 |
Yandex Bot | 4,492 | 84.34 GB | 30 Jun 2017 - 23:59 |
Unknown robot (identified by 'crawl') | 4,016 | 31.03 GB | 30 Jun 2017 - 11:52 |
AhrefsBot | 2,717 | 38.99 GB | 30 Jun 2017 - 22:49 |
Bingbot | 2,364 | 22.98 GB | 30 Jun 2017 - 23:42 |
MJ12bot | 1,514 | 7.99 GB | 30 Jun 2017 - 13:55 |
Yahoo Slurp | 1,507 | 20.14 GB | 30 Jun 2017 - 23:49 |
BaiDuSpider | 1,161 | 19.93 GB | 30 Jun 2017 - 22:29 |
WGet tools | 890 | 77.28 MB | 30 Jun 2017 - 22:00 |
SemrushBot | 708 | 118.12 MB | 30 Jun 2017 - 19:55 |
Googlebot | 486 | 964.57 MB | 30 Jun 2017 - 23:11 |
Unknown robot (identified by empty user agent string) | 338 | 2.81 MB | 30 Jun 2017 - 06:53 |
Bing Preview bot | 163 | 16.61 GB | 30 Jun 2017 - 16:50 |
Python-urllib | 75 | 196.35 MB | 30 Jun 2017 - 13:46 |
ltx71 | 70 | 39.29 GB | 30 Jun 2017 - 06:20 |
Googlebot-Image | 62 | 91.02 MB | 30 Jun 2017 - 00:45 |
360spider | 54 | 725.49 KB | 30 Jun 2017 - 01:04 |
Java (Often spam bot) | 48 | 429.25 KB | 30 Jun 2017 - 17:11 |
Cliqzbot | 29 | 807.03 KB | 27 Jun 2017 - 23:36 |
Sogou Spider | 28 | 180.77 KB | 30 Jun 2017 - 12:54 |
Unknown robot (identified by 'checker') | 28 | 0 | 30 Jun 2017 - 00:29 |
Web Core / Roots | 26 | 10.82 GB | 29 Jun 2017 - 10:40 |
Common Crawl | 25 | 58.55 MB | 27 Jun 2017 - 20:56 |
SeznamBot | 15 | 2.23 MB | 30 Jun 2017 - 02:05 |
Common *nix tool for automating web document retireval. Most likely a bot. | 11 | 82.31 MB | 17 Jun 2017 - 18:55 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 11 | 107.83 KB | 23 Jun 2017 - 22:59 |
Nutch | 10 | 651.42 KB | 23 Jun 2017 - 06:29 |
Suspected bot masqurading as Mozilla | 9 | 97.46 KB | 26 Jun 2017 - 11:14 |
Alexa (IA Archiver) | 9 | 144.17 KB | 25 Jun 2017 - 13:53 |
SEOkicks Webcrawler | 9 | 31.99 KB | 16 Jun 2017 - 05:28 |
Site Explorer | 4 | 131.52 KB | 28 Jun 2017 - 10:56 |
CrazyWeb Crawler | 4 | 0 | 25 Jun 2017 - 15:12 |
Phantom | 4 | 88.35 KB | 26 Jun 2017 - 10:28 |
Custo | 4 | 5.35 GB | 07 Jun 2017 - 06:48 |
Mail.ru bot | 4 | 7.82 MB | 23 Jun 2017 - 06:25 |
Linkdex | 3 | 14.99 KB | 18 Jun 2017 - 21:24 |
ZumBot | 2 | 2.67 GB | 28 Jun 2017 - 21:39 |
FavIconizer | 2 | 858.50 KB | 27 Jun 2017 - 09:23 |
YaCy | 2 | 8.24 KB | 11 Jun 2017 - 10:47 |
Unknown robot (identified by 'robot') | 1 | 3.23 KB | 15 Jun 2017 - 13:12 |
archive.org bot | 1 | 487.40 KB | 16 Jun 2017 - 00:15 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1 | 62.65 KB | 23 Jun 2017 - 00:47 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 25 Jun 2017 - 23:31 |
twitterbot | 1 | 1.34 GB | 21 Jun 2017 - 20:21 |
Heritrix | 1 | 413.24 KB | 27 Jun 2017 - 09:22 |
|