30 different robots | Hits | Bandwidth | Last visit |
DotBot, Open Site Explorer | 7,394 | 1.41 GB | 31 Jan 2022 - 23:59 |
SemrushBot | 20,606 | 124.25 GB | 31 Jan 2022 - 23:59 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 10,974 | 102.24 GB | 31 Jan 2022 - 23:57 |
WGet tools | 11,040 | 20.75 GB | 31 Jan 2022 - 23:57 |
Googlebot | 495 | 909.94 MB | 31 Jan 2022 - 23:56 |
Common *nix tool for automating web document retireval. Most likely a bot. | 8,677 | 627.85 GB | 31 Jan 2022 - 23:52 |
Yandex Bot | 272 | 711.63 MB | 31 Jan 2022 - 23:28 |
Bingbot | 2,405 | 5.70 GB | 31 Jan 2022 - 23:20 |
MJ12bot | 12,415 | 267.56 GB | 31 Jan 2022 - 22:54 |
Unknown robot (identified by 'robot') | 9,449 | 23.49 GB | 31 Jan 2022 - 18:18 |
AhrefsBot | 37,261 | 26.88 GB | 31 Jan 2022 - 17:12 |
Unknown robot (identified by empty user agent string) | 165 | 5.48 GB | 31 Jan 2022 - 16:04 |
Suspected bot masqurading as Mozilla | 22 | 0 | 31 Jan 2022 - 14:03 |
MojeekBot | 3 | 15.90 KB | 30 Jan 2022 - 14:07 |
Netcraft | 2 | 6.64 KB | 30 Jan 2022 - 06:55 |
Python-urllib | 17 | 56.07 MB | 30 Jan 2022 - 04:38 |
Custo | 33 | 107.99 KB | 30 Jan 2022 - 03:28 |
LinkChecker | 6 | 0 | 29 Jan 2022 - 03:15 |
Common Crawl | 288 | 402.36 MB | 28 Jan 2022 - 12:54 |
SeznamBot | 2 | 6.64 KB | 28 Jan 2022 - 05:44 |
Unknown robot (identified by 'crawl') | 7,615 | 982.47 MB | 27 Jan 2022 - 23:48 |
Grabber (SDSC) | 138 | 3.70 GB | 27 Jan 2022 - 18:38 |
twitterbot | 1 | 3.59 KB | 25 Jan 2022 - 19:37 |
FaceBook bot | 2 | 296 Bytes | 22 Jan 2022 - 02:49 |
Gaisbot | 2 | 6.51 KB | 20 Jan 2022 - 13:18 |
FavIconizer | 6 | 19.66 KB | 17 Jan 2022 - 21:05 |
InfoBot | 102 | 613.94 KB | 14 Jan 2022 - 23:01 |
Nutch | 1 | 15.66 KB | 11 Jan 2022 - 02:07 |
Googlebot-Image | 5 | 1.01 KB | 06 Jan 2022 - 19:47 |
ltx71 | 2 | 18.72 KB | 02 Jan 2022 - 16:12 |
|