28 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 39,327 | 1805.72 GB | 31 Dec 2022 - 23:10 |
Unknown robot (identified by empty user agent string) | 103 | 9.97 GB | 31 Dec 2022 - 23:10 |
SemrushBot | 96,389 | 478.15 MB | 31 Dec 2022 - 23:10 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 13,088 | 14.89 GB | 31 Dec 2022 - 23:09 |
AhrefsBot | 54,229 | 7.25 GB | 31 Dec 2022 - 23:09 |
Bingbot | 3,630 | 3.84 GB | 31 Dec 2022 - 22:48 |
Yandex Bot | 1,089 | 365.70 MB | 31 Dec 2022 - 22:00 |
DotBot, Open Site Explorer | 29,135 | 189.91 GB | 31 Dec 2022 - 21:47 |
MJ12bot | 26,647 | 373.39 GB | 31 Dec 2022 - 20:24 |
Custo | 63 | 208.70 KB | 31 Dec 2022 - 18:05 |
WGet tools | 14,663 | 29.63 GB | 31 Dec 2022 - 15:10 |
Suspected bot masqurading as Mozilla | 121 | 0 | 31 Dec 2022 - 14:26 |
Python-urllib | 121 | 32.00 GB | 31 Dec 2022 - 03:13 |
Googlebot | 64 | 280.37 MB | 31 Dec 2022 - 01:30 |
GigablastOpenSource, an Open Source Search Engine(Wiki) | 12 | 2.42 KB | 31 Dec 2022 - 01:09 |
MojeekBot | 31 | 226.49 KB | 29 Dec 2022 - 15:16 |
Grabber (SDSC) | 81 | 2.23 GB | 29 Dec 2022 - 14:34 |
LinkChecker | 6 | 0 | 27 Dec 2022 - 11:20 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 199 | 1.01 MB | 26 Dec 2022 - 04:58 |
Unknown robot (identified by 'robot') | 9 | 59.96 KB | 22 Dec 2022 - 16:17 |
InfoBot | 5 | 45.37 KB | 20 Dec 2022 - 23:31 |
WordPress | 3 | 3.76 KB | 17 Dec 2022 - 14:18 |
Bing Preview bot | 1 | 2.35 KB | 14 Dec 2022 - 08:30 |
Unknown robot (identified by 'crawl') | 1,501 | 1.57 MB | 13 Dec 2022 - 01:12 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 95 | 319.11 KB | 12 Dec 2022 - 16:16 |
Common Crawl | 323 | 424.83 MB | 09 Dec 2022 - 13:54 |
Netcraft | 2 | 3.36 KB | 07 Dec 2022 - 00:20 |
Googlebot-Image | 1 | 5.82 KB | 06 Dec 2022 - 13:56 |
|