44 different robots | Hits | Bandwidth | Last visit |
DotBot, Open Site Explorer | 7,829 | 54.15 GB | 31 Dec 2021 - 23:59 |
Bingbot | 11,028 | 9.26 GB | 31 Dec 2021 - 23:56 |
AhrefsBot | 27,127 | 388.36 GB | 31 Dec 2021 - 23:55 |
SemrushBot | 5,466 | 28.09 GB | 31 Dec 2021 - 23:55 |
Googlebot | 378 | 117.84 MB | 31 Dec 2021 - 23:54 |
Perl tool | 277 | 15.91 MB | 31 Dec 2021 - 23:46 |
Yandex Bot | 2,302 | 17.76 GB | 31 Dec 2021 - 23:43 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,220 | 10.91 GB | 31 Dec 2021 - 23:35 |
Common *nix tool for automating web document retireval. Most likely a bot. | 7,188 | 717.97 GB | 31 Dec 2021 - 23:22 |
Unknown robot (identified by empty user agent string) | 665 | 63.78 GB | 31 Dec 2021 - 23:11 |
Suspected bot masqurading as Mozilla | 971 | 31.06 GB | 31 Dec 2021 - 23:02 |
WGet tools | 4,414 | 826.88 GB | 31 Dec 2021 - 21:00 |
Python-urllib | 586 | 290.66 GB | 31 Dec 2021 - 21:00 |
CFNetwork | 758 | 28.71 GB | 31 Dec 2021 - 18:43 |
Unknown robot (identified by 'crawl') | 6,081 | 18.80 GB | 31 Dec 2021 - 18:39 |
LinkChecker | 371 | 116.40 MB | 31 Dec 2021 - 17:19 |
Unknown robot (identified by 'robot') | 110 | 24.98 MB | 31 Dec 2021 - 15:57 |
Jakarta commons-httpclient | 31 | 496 Bytes | 31 Dec 2021 - 15:05 |
Unknown robot (identified by 'spider') | 1,425 | 383.68 MB | 31 Dec 2021 - 13:00 |
ltx71 | 194 | 62.62 GB | 31 Dec 2021 - 11:52 |
Java (Often spam bot) | 2,478 | 57.85 GB | 31 Dec 2021 - 11:49 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 89 | 47.79 MB | 31 Dec 2021 - 09:17 |
Web Core / Roots | 111 | 2.20 GB | 31 Dec 2021 - 08:38 |
MJ12bot | 536 | 1.10 GB | 31 Dec 2021 - 03:34 |
SeznamBot | 10 | 40.93 KB | 30 Dec 2021 - 07:29 |
WordPress | 41 | 165.67 MB | 30 Dec 2021 - 06:08 |
HTTrack off-line browser | 6 | 28.98 KB | 30 Dec 2021 - 04:23 |
Alexa (IA Archiver) | 4 | 98.30 MB | 29 Dec 2021 - 20:56 |
Bing Preview bot | 2 | 14.08 MB | 28 Dec 2021 - 22:57 |
SEOkicks Webcrawler | 2 | 9.74 KB | 27 Dec 2021 - 22:07 |
archive.org bot | 6 | 208.13 MB | 26 Dec 2021 - 21:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 26 Dec 2021 - 18:24 |
twitterbot | 6 | 168.35 MB | 25 Dec 2021 - 14:52 |
BaiDuSpider | 5 | 6.73 MB | 23 Dec 2021 - 14:50 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 12 | 77.65 MB | 22 Dec 2021 - 18:42 |
Xenu's Link Sleuth (TM), see Wikipedia | 3 | 0 | 22 Dec 2021 - 09:53 |
Google AdSense | 5 | 142.78 MB | 22 Dec 2021 - 04:49 |
Mail.ru bot | 2 | 13.88 KB | 22 Dec 2021 - 04:49 |
MojeekBot | 2 | 127.30 KB | 20 Dec 2021 - 14:48 |
Nutch | 41 | 22.34 KB | 18 Dec 2021 - 12:55 |
Simmany Robot Ver1.0 | 2 | 7.04 KB | 16 Dec 2021 - 06:30 |
Common Crawl | 486 | 53.74 MB | 09 Dec 2021 - 03:48 |
yeti | 1 | 61.24 KB | 06 Dec 2021 - 03:53 |
YaCy | 1 | 3.52 KB | 04 Dec 2021 - 04:38 |
|