29 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 48,487 | 97.04 GB | 31 Jul 2020 - 23:09 |
AhrefsBot | 13,376 | 41.55 GB | 31 Jul 2020 - 21:12 |
DotBot, Open Site Explorer | 6,372 | 17.18 GB | 31 Jul 2020 - 22:58 |
MJ12bot | 1,662 | 51.49 GB | 31 Jul 2020 - 15:21 |
Yandex Bot | 1,399 | 5.86 MB | 31 Jul 2020 - 23:08 |
Common *nix tool for automating web document retireval. Most likely a bot. | 177 | 2.98 GB | 30 Jul 2020 - 17:05 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 135 | 483.68 KB | 31 Jul 2020 - 20:59 |
Googlebot | 110 | 957.54 KB | 31 Jul 2020 - 17:47 |
WGet tools | 98 | 4.97 GB | 31 Jul 2020 - 22:16 |
Unknown robot (identified by 'crawl') | 86 | 301.37 KB | 24 Jul 2020 - 20:49 |
Bingbot | 83 | 273.91 KB | 31 Jul 2020 - 11:31 |
Grabber (SDSC) | 61 | 1.93 GB | 22 Jul 2020 - 10:35 |
Alexa (IA Archiver) | 47 | 166.39 KB | 30 Jul 2020 - 15:18 |
Unknown robot (identified by 'robot') | 32 | 131.53 KB | 31 Jul 2020 - 11:06 |
Suspected bot masqurading as Mozilla | 18 | 7.46 KB | 31 Jul 2020 - 21:14 |
Python-urllib | 15 | 44.32 KB | 30 Jul 2020 - 20:16 |
Common Crawl | 15 | 68.91 KB | 04 Jul 2020 - 12:55 |
Unknown robot (identified by empty user agent string) | 13 | 362.60 MB | 30 Jul 2020 - 15:18 |
FavIconizer | 10 | 32.55 KB | 30 Jul 2020 - 10:42 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 9 | 27.61 KB | 30 Jul 2020 - 17:47 |
twitterbot | 8 | 32.30 KB | 30 Jul 2020 - 15:17 |
Unknown robot (identified by 'scanner') | 3 | 21.79 KB | 09 Jul 2020 - 08:23 |
SeznamBot | 3 | 8.17 KB | 20 Jul 2020 - 19:41 |
Bing Preview bot | 3 | 8.85 KB | 21 Jul 2020 - 11:30 |
ltx71 | 2 | 54.56 MB | 02 Jul 2020 - 09:05 |
CFNetwork | 2 | 7.91 KB | 25 Jul 2020 - 14:03 |
Netcraft | 1 | 3.13 KB | 02 Jul 2020 - 16:45 |
Web Core / Roots | 1 | 0 | 30 Jul 2020 - 13:57 |
archive.org bot | 1 | 3.96 KB | 29 Jul 2020 - 06:58 |
|