46 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 13,221 | 90.54 GB | 31 Oct 2021 - 20:13 |
AhrefsBot | 6,091 | 149.74 GB | 31 Oct 2021 - 21:04 |
SemrushBot | 4,303 | 336.09 GB | 31 Oct 2021 - 21:03 |
Unknown robot (identified by 'crawl') | 2,589 | 133.21 GB | 31 Oct 2021 - 20:12 |
Bingbot | 2,558 | 57.61 GB | 31 Oct 2021 - 20:41 |
Web Core / Roots | 1,440 | 1.99 GB | 31 Oct 2021 - 21:06 |
Yandex Bot | 1,287 | 59.98 GB | 31 Oct 2021 - 20:44 |
Googlebot | 1,267 | 14.89 GB | 31 Oct 2021 - 19:46 |
Unknown robot (identified by 'spider') | 1,092 | 37.81 GB | 31 Oct 2021 - 20:43 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 974 | 50.48 GB | 31 Oct 2021 - 19:59 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 969 | 312.75 MB | 31 Oct 2021 - 15:56 |
DotBot, Open Site Explorer | 781 | 37.64 GB | 31 Oct 2021 - 19:13 |
Perl tool | 767 | 3.08 MB | 31 Oct 2021 - 03:48 |
Unknown robot (identified by empty user agent string) | 375 | 28.67 GB | 31 Oct 2021 - 19:12 |
MJ12bot | 333 | 2.73 GB | 31 Oct 2021 - 10:03 |
Google Web Preview | 143 | 1.60 GB | 31 Oct 2021 - 09:12 |
Common Crawl | 132 | 4.43 GB | 28 Oct 2021 - 22:09 |
LinkChecker | 115 | 0 | 31 Oct 2021 - 01:30 |
Nutch | 97 | 2.25 GB | 18 Oct 2021 - 21:05 |
WGet tools | 86 | 1.16 GB | 31 Oct 2021 - 03:47 |
FaceBook bot | 80 | 833.54 MB | 30 Oct 2021 - 18:51 |
rpt-httpclient | 43 | 304.42 MB | 31 Oct 2021 - 10:23 |
Java (Often spam bot) | 36 | 32.55 MB | 30 Oct 2021 - 06:25 |
Mail.ru bot | 22 | 119.85 MB | 30 Oct 2021 - 08:33 |
Alexa (IA Archiver) | 18 | 731.16 MB | 26 Oct 2021 - 18:23 |
Bing Preview bot | 18 | 1.41 GB | 31 Oct 2021 - 08:56 |
yeti | 16 | 124.80 MB | 31 Oct 2021 - 03:23 |
SeznamBot | 15 | 64.08 KB | 27 Oct 2021 - 19:32 |
BaiDuSpider | 14 | 196.90 MB | 30 Oct 2021 - 18:58 |
CFNetwork | 14 | 827.24 MB | 31 Oct 2021 - 03:43 |
Python-urllib | 13 | 1.63 GB | 29 Oct 2021 - 23:35 |
ltx71 | 13 | 1.37 GB | 31 Oct 2021 - 07:31 |
FavIconizer | 8 | 226.94 MB | 27 Oct 2021 - 20:09 |
Phantom | 7 | 104.25 MB | 30 Oct 2021 - 03:14 |
Suspected bot masqurading as Mozilla | 5 | 0 | 31 Oct 2021 - 03:29 |
Sogou Spider | 4 | 3.71 MB | 18 Oct 2021 - 13:26 |
archive.org bot | 4 | 40.42 KB | 06 Oct 2021 - 02:00 |
Motor | 3 | 17.75 MB | 29 Oct 2021 - 02:08 |
twitterbot | 3 | 147.00 MB | 27 Oct 2021 - 07:06 |
Unknown robot (identified by 'robot') | 2 | 12.01 KB | 11 Oct 2021 - 16:03 |
ning | 2 | 152.21 MB | 18 Oct 2021 - 05:00 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2 | 6.04 KB | 20 Oct 2021 - 05:11 |
Anthill | 2 | 4.95 KB | 13 Oct 2021 - 12:11 |
Y!J Yahoo Japan | 1 | 8.11 MB | 03 Oct 2021 - 01:03 |
microsoft-webdav-miniredir | 1 | 0 | 17 Oct 2021 - 07:09 |
GigaBot | 1 | 7.92 MB | 16 Oct 2021 - 06:04 |
Others | 0 | 4 Bytes | |
|