40 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 14,725 | 24.69 GB | 30 Sep 2021 - 21:14 |
Bingbot | 53,252 | 9.30 GB | 30 Sep 2021 - 21:14 |
Suspected bot masqurading as Mozilla | 50,157 | 288.75 MB | 30 Sep 2021 - 21:12 |
Perl tool | 12,230 | 17.53 GB | 30 Sep 2021 - 21:11 |
Python-urllib | 130,818 | 100.48 GB | 30 Sep 2021 - 21:10 |
WGet tools | 822,764 | 1174.68 GB | 30 Sep 2021 - 21:10 |
Unknown robot (identified by 'spider') | 1,226 | 11.15 MB | 30 Sep 2021 - 21:04 |
SemrushBot | 11,115 | 1.20 GB | 30 Sep 2021 - 21:01 |
DotBot, Open Site Explorer | 60,007 | 39.15 GB | 30 Sep 2021 - 20:59 |
Yandex Bot | 1,714 | 1.28 GB | 30 Sep 2021 - 20:35 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 241 | 613.04 MB | 30 Sep 2021 - 19:55 |
Web Core / Roots | 404 | 53.68 MB | 30 Sep 2021 - 19:03 |
Nutch | 3,177 | 696.83 MB | 30 Sep 2021 - 18:17 |
AhrefsBot | 336 | 315.77 MB | 30 Sep 2021 - 18:16 |
Java (Often spam bot) | 546 | 15.12 MB | 30 Sep 2021 - 18:06 |
WordPress | 59 | 240.01 KB | 30 Sep 2021 - 17:34 |
FaceBook bot | 82 | 2.13 MB | 30 Sep 2021 - 17:00 |
Unknown robot (identified by 'robot') | 60 | 1.65 MB | 30 Sep 2021 - 16:27 |
Common Crawl | 3,379 | 2.72 GB | 30 Sep 2021 - 16:22 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 74 | 7.43 MB | 30 Sep 2021 - 16:16 |
Unknown robot (identified by empty user agent string) | 4,596 | 315.83 MB | 30 Sep 2021 - 15:37 |
twitterbot | 6 | 7.88 MB | 30 Sep 2021 - 14:31 |
Googlebot | 295 | 16.93 MB | 30 Sep 2021 - 12:44 |
BaiDuSpider | 50 | 177.19 KB | 29 Sep 2021 - 12:13 |
MJ12bot | 222 | 21.56 MB | 29 Sep 2021 - 12:02 |
Unknown robot (identified by 'crawl') | 63,372 | 3.06 GB | 28 Sep 2021 - 20:52 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 32 | 772.10 KB | 28 Sep 2021 - 07:01 |
Mail.ru bot | 48 | 424.22 KB | 27 Sep 2021 - 17:05 |
LinkChecker | 4 | 16.80 KB | 27 Sep 2021 - 13:15 |
WebCopy | 2 | 4.23 KB | 23 Sep 2021 - 09:15 |
MojeekBot | 4 | 11.82 KB | 15 Sep 2021 - 17:17 |
Heritrix | 1 | 4.23 KB | 15 Sep 2021 - 12:15 |
ltx71 | 71 | 7.12 MB | 12 Sep 2021 - 18:16 |
Grabber (SDSC) | 1 | 626 Bytes | 12 Sep 2021 - 01:52 |
yeti | 1 | 4.23 KB | 10 Sep 2021 - 10:58 |
SMTBot | 23 | 70.57 KB | 09 Sep 2021 - 06:49 |
SeznamBot | 1 | 4.23 KB | 07 Sep 2021 - 17:23 |
SEOkicks Webcrawler | 44 | 142.73 KB | 06 Sep 2021 - 03:31 |
Phantom | 1 | 4.23 KB | 05 Sep 2021 - 12:16 |
Yahoo Slurp | 1 | 1.80 MB | 04 Sep 2021 - 03:11 |
|