43 different robots | Hits | Bandwidth | Last visit |
Bingbot | 44,313 | 118.55 GB | 31 Dec 2020 - 23:59 |
AhrefsBot | 27,707 | 648.32 GB | 31 Dec 2020 - 23:59 |
SemrushBot | 5,048 | 13.58 GB | 31 Dec 2020 - 23:55 |
Perl tool | 286 | 10.97 MB | 31 Dec 2020 - 23:54 |
Common *nix tool for automating web document retireval. Most likely a bot. | 7,536 | 1790.90 GB | 31 Dec 2020 - 23:54 |
Unknown robot (identified by empty user agent string) | 1,265 | 69.93 GB | 31 Dec 2020 - 23:08 |
Suspected bot masqurading as Mozilla | 997 | 28.49 GB | 31 Dec 2020 - 23:05 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,283 | 14.01 GB | 31 Dec 2020 - 23:04 |
Googlebot | 699 | 658.10 GB | 31 Dec 2020 - 23:00 |
Unknown robot (identified by 'crawl') | 2,821 | 26.27 GB | 31 Dec 2020 - 22:29 |
LinkChecker | 477 | 0 | 31 Dec 2020 - 21:52 |
Web Core / Roots | 69 | 1.69 GB | 31 Dec 2020 - 21:03 |
DotBot, Open Site Explorer | 1,577 | 822.11 MB | 31 Dec 2020 - 20:46 |
SeznamBot | 14 | 72.32 KB | 31 Dec 2020 - 20:07 |
WGet tools | 90,655+1 | 1102.81 GB | 31 Dec 2020 - 20:00 |
Python-urllib | 549 | 259.94 GB | 31 Dec 2020 - 19:52 |
Bing Preview bot | 9 | 216.07 MB | 31 Dec 2020 - 19:15 |
Unknown robot (identified by 'spider') | 40 | 6.77 GB | 31 Dec 2020 - 18:48 |
MJ12bot | 220 | 167.90 MB | 31 Dec 2020 - 17:46 |
Java (Often spam bot) | 22 | 223.80 MB | 31 Dec 2020 - 16:08 |
CFNetwork | 715 | 22.57 GB | 31 Dec 2020 - 15:08 |
Jakarta commons-httpclient | 34 | 544 Bytes | 31 Dec 2020 - 15:01 |
Yandex Bot | 644 | 787.90 GB | 31 Dec 2020 - 11:54 |
ltx71 | 108 | 823.08 MB | 31 Dec 2020 - 00:16 |
WordPress | 20 | 175.69 MB | 29 Dec 2020 - 15:56 |
Yahoo Slurp | 1 | 7.92 KB | 29 Dec 2020 - 06:12 |
BaiDuSpider | 2 | 180.63 KB | 28 Dec 2020 - 07:45 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 2,665 | 214.28 MB | 26 Dec 2020 - 17:13 |
archive.org bot | 8 | 242.26 MB | 26 Dec 2020 - 14:04 |
Unknown robot (identified by hit on 'robots.txt') | 0+3 | 12.48 KB | 26 Dec 2020 - 00:47 |
Steeler | 2 | 392.05 KB | 26 Dec 2020 - 00:25 |
Google AdSense | 7 | 173.05 MB | 24 Dec 2020 - 18:13 |
Nutch | 180 | 2278.60 GB | 24 Dec 2020 - 14:30 |
twitterbot | 3 | 29.27 MB | 24 Dec 2020 - 14:11 |
SEOkicks Webcrawler | 4 | 19.49 KB | 21 Dec 2020 - 13:27 |
MojeekBot | 2 | 10.48 KB | 18 Dec 2020 - 17:12 |
Suspected bot masqurading as Mozilla | 3 | 87.79 MB | 16 Dec 2020 - 03:46 |
Mail.ru bot | 4 | 14.21 KB | 15 Dec 2020 - 00:25 |
microsoft-webdav-miniredir | 1 | 0 | 07 Dec 2020 - 20:29 |
FaceBook bot | 11 | 45.26 KB | 06 Dec 2020 - 18:15 |
Common Crawl | 19 | 94.93 KB | 05 Dec 2020 - 23:11 |
Suspected bot masqurading as Mozilla | 1 | 16 Bytes | 03 Dec 2020 - 15:53 |
HTMLParser | 2 | 166.99 KB | 02 Dec 2020 - 19:42 |
|