46 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,511 | 21.95 GB | 31 May 2022 - 22:10 |
AhrefsBot | 13,132 | 1.04 GB | 31 May 2022 - 22:10 |
SemrushBot | 3,952 | 22.25 GB | 31 May 2022 - 22:09 |
Googlebot | 515 | 260.04 MB | 31 May 2022 - 22:09 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4,859 | 761.06 GB | 31 May 2022 - 22:00 |
Bingbot | 8,897+2 | 20.91 GB | 31 May 2022 - 21:58 |
DotBot, Open Site Explorer | 6,557 | 26.48 GB | 31 May 2022 - 21:57 |
CFNetwork | 401 | 13.73 GB | 31 May 2022 - 21:53 |
Suspected bot masqurading as Mozilla | 582 | 17.48 GB | 31 May 2022 - 21:50 |
Unknown robot (identified by empty user agent string) | 633 | 45.84 GB | 31 May 2022 - 21:45 |
Perl tool | 176 | 110.23 GB | 31 May 2022 - 21:30 |
WGet tools | 106,123+1 | 1484.43 GB | 31 May 2022 - 20:49 |
Yandex Bot | 273 | 2.68 GB | 31 May 2022 - 20:05 |
Python-urllib | 674 | 298.00 GB | 31 May 2022 - 18:32 |
LinkChecker | 379 | 407.41 MB | 31 May 2022 - 18:20 |
MJ12bot | 2,930 | 979.73 MB | 31 May 2022 - 17:14 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 4,600 | 155.49 MB | 31 May 2022 - 16:08 |
Java (Often spam bot) | 2,409 | 62.49 GB | 31 May 2022 - 16:05 |
Jakarta commons-httpclient | 30 | 480 Bytes | 31 May 2022 - 14:04 |
BaiDuSpider | 49 | 459.38 MB | 31 May 2022 - 12:57 |
Unknown robot (identified by 'crawl') | 5,121 | 20.34 GB | 31 May 2022 - 10:25 |
twitterbot | 1 | 8.04 KB | 31 May 2022 - 06:55 |
Web Core / Roots | 115 | 5.69 GB | 31 May 2022 - 05:05 |
Xenu's Link Sleuth (TM), see Wikipedia | 6 | 0 | 30 May 2022 - 13:36 |
Bing Preview bot | 3 | 28.34 MB | 30 May 2022 - 10:29 |
WordPress | 29 | 17.79 KB | 29 May 2022 - 14:55 |
Heritrix | 2 | 72.91 MB | 29 May 2022 - 14:08 |
SEOkicks Webcrawler | 2 | 9.74 KB | 29 May 2022 - 07:11 |
Common Crawl | 269+1 | 52.92 MB | 29 May 2022 - 06:39 |
Unknown robot (identified by hit on 'robots.txt') | 0+5 | 31.20 KB | 28 May 2022 - 11:15 |
W3C Validator | 1 | 6.88 KB | 27 May 2022 - 08:44 |
Suspected bot masquerading as M$ IE | 1 | 2.61 KB | 27 May 2022 - 08:44 |
SeznamBot | 6 | 22.44 KB | 26 May 2022 - 04:18 |
yeti | 1 | 30.16 MB | 26 May 2022 - 03:53 |
FaceBook bot | 2 | 7.17 KB | 25 May 2022 - 12:19 |
Unknown robot (identified by 'spider') | 57 | 67.32 MB | 25 May 2022 - 04:54 |
Unknown robot (identified by 'robot') | 112 | 343.02 MB | 22 May 2022 - 17:33 |
Google Web Preview | 1 | 2.74 KB | 17 May 2022 - 11:19 |
Bloglines | 2 | 13.88 KB | 14 May 2022 - 04:48 |
Mail.ru bot | 5 | 421.02 KB | 13 May 2022 - 21:23 |
A PHP script | 1 | 7.00 KB | 12 May 2022 - 16:38 |
archive.org bot | 4 | 145.82 MB | 10 May 2022 - 22:12 |
MojeekBot | 2 | 272.76 KB | 09 May 2022 - 15:27 |
YaCy | 15 | 306.23 MB | 08 May 2022 - 07:07 |
Yahoo Slurp | 1 | 2.61 KB | 07 May 2022 - 11:36 |
Gulper Bot | 1 | 7.00 KB | 06 May 2022 - 07:43 |
|