49 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 8,828 | 29.82 GB | 31 May 2022 - 22:08 |
Bingbot | 1,679 | 27.73 GB | 31 May 2022 - 22:05 |
Web Core / Roots | 2,576 | 9.68 GB | 31 May 2022 - 22:04 |
Googlebot | 1,422 | 14.19 GB | 31 May 2022 - 21:53 |
SemrushBot | 3,504 | 310.33 GB | 31 May 2022 - 21:45 |
Unknown robot (identified by 'crawl') | 2,889 | 184.10 GB | 31 May 2022 - 21:44 |
DotBot, Open Site Explorer | 220 | 5.11 GB | 31 May 2022 - 21:14 |
Yandex Bot | 591 | 30.37 GB | 31 May 2022 - 21:14 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 888 | 17.20 GB | 31 May 2022 - 21:06 |
AhrefsBot | 7,379 | 106.90 GB | 31 May 2022 - 21:03 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 241 | 142.23 MB | 31 May 2022 - 18:54 |
rpt-httpclient | 54 | 152.21 MB | 31 May 2022 - 18:19 |
MJ12bot | 298 | 1.16 GB | 31 May 2022 - 17:14 |
Google Web Preview | 110 | 1.56 GB | 31 May 2022 - 16:18 |
Sogou Spider | 220 | 1.60 GB | 31 May 2022 - 15:56 |
Unknown robot (identified by empty user agent string) | 188 | 10.36 GB | 31 May 2022 - 14:26 |
linkedinbot | 2 | 27.54 KB | 31 May 2022 - 13:05 |
Unknown robot (identified by 'spider') | 521 | 32.35 GB | 31 May 2022 - 07:04 |
LinkChecker | 226 | 0 | 31 May 2022 - 05:52 |
BaiDuSpider | 35 | 1.52 GB | 31 May 2022 - 03:31 |
Perl tool | 778 | 3.12 MB | 31 May 2022 - 02:57 |
WGet tools | 549 | 45.47 GB | 31 May 2022 - 02:57 |
Java (Often spam bot) | 103 | 3.36 GB | 31 May 2022 - 01:22 |
FaceBook bot | 151 | 2.68 GB | 30 May 2022 - 22:05 |
MojeekBot | 1 | 2.47 KB | 30 May 2022 - 16:40 |
Bing Preview bot | 27 | 2.25 GB | 30 May 2022 - 02:13 |
Google AdSense | 4 | 23.49 MB | 29 May 2022 - 21:18 |
SeznamBot | 11 | 19.76 KB | 29 May 2022 - 18:44 |
SEOkicks Webcrawler | 2 | 6.24 KB | 29 May 2022 - 07:11 |
Suspected bot masqurading as Mozilla | 3 | 0 | 29 May 2022 - 04:43 |
YaCy | 1 | 398.31 MB | 29 May 2022 - 02:23 |
Common Crawl | 70 | 2.90 GB | 29 May 2022 - 00:28 |
CFNetwork | 16 | 202.99 MB | 26 May 2022 - 06:20 |
Mail.ru bot | 82 | 413.00 MB | 25 May 2022 - 16:31 |
Nutch | 5 | 7.96 MB | 25 May 2022 - 01:56 |
HTTrack off-line browser | 170 | 5.82 GB | 23 May 2022 - 16:56 |
Python-urllib | 7 | 8.13 MB | 23 May 2022 - 08:50 |
Unknown robot (identified by 'robot') | 122 | 1.84 GB | 22 May 2022 - 16:59 |
twitterbot | 2 | 6.35 KB | 22 May 2022 - 05:49 |
yeti | 7 | 53.66 MB | 20 May 2022 - 00:10 |
WordPress | 21 | 57.06 MB | 19 May 2022 - 02:40 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2 | 105.56 MB | 17 May 2022 - 03:27 |
Yahoo Slurp | 2 | 7.92 MB | 13 May 2022 - 18:34 |
Feedfetcher-Google | 1 | 3.69 KB | 12 May 2022 - 13:28 |
Motor | 1 | 3.69 KB | 11 May 2022 - 05:05 |
Suspected bot masqurading as Mozilla | 1 | 7.46 MB | 10 May 2022 - 00:15 |
ning | 1 | 76.11 MB | 08 May 2022 - 00:46 |
WWWC Ver 0.2.5 | 1 | 3.30 KB | 04 May 2022 - 16:37 |
Alexa (IA Archiver) | 1 | 2.47 KB | 04 May 2022 - 01:58 |
|