38 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 20,241 | 958.16 MB | 28 Feb 2021 - 23:55 |
Common *nix tool for automating web document retireval. Most likely a bot. | 14,641 | 128.94 MB | 28 Feb 2021 - 23:55 |
AhrefsBot | 8,604 | 843.32 MB | 28 Feb 2021 - 23:57 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,688 | 822.74 MB | 28 Feb 2021 - 23:42 |
Bingbot | 4,191 | 1.66 GB | 28 Feb 2021 - 23:56 |
Yandex Bot | 3,683 | 345.73 MB | 28 Feb 2021 - 22:58 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,280 | 16.73 MB | 26 Feb 2021 - 05:04 |
Unknown robot (identified by 'crawl') | 1,114 | 20.74 MB | 28 Feb 2021 - 21:35 |
DotBot, Open Site Explorer | 748 | 33.69 MB | 28 Feb 2021 - 23:43 |
Googlebot | 239 | 70.40 MB | 28 Feb 2021 - 18:01 |
WGet tools | 237 | 211.97 MB | 28 Feb 2021 - 21:28 |
Unknown robot (identified by 'spider') | 92 | 4.86 MB | 28 Feb 2021 - 21:35 |
Web Core / Roots | 65 | 38.42 MB | 28 Feb 2021 - 19:07 |
Java (Often spam bot) | 42 | 2.36 MB | 27 Feb 2021 - 02:43 |
Unknown robot (identified by 'robot') | 37 | 2.48 MB | 21 Feb 2021 - 11:55 |
Nutch | 26 | 5.38 MB | 28 Feb 2021 - 00:05 |
Sift | 18 | 730.79 KB | 22 Feb 2021 - 12:23 |
MJ12bot | 18 | 653.15 KB | 27 Feb 2021 - 11:51 |
SEOkicks Webcrawler | 10 | 40.02 KB | 25 Feb 2021 - 13:01 |
Python-urllib | 10 | 4.38 MB | 28 Feb 2021 - 08:31 |
Common Crawl | 9 | 92.52 KB | 25 Feb 2021 - 20:00 |
SeznamBot | 9 | 22.69 KB | 26 Feb 2021 - 12:45 |
ltx71 | 8 | 1.18 MB | 25 Feb 2021 - 07:50 |
HTTrack off-line browser | 7 | 113.78 KB | 19 Feb 2021 - 01:52 |
InternetArchive | 6 | 0 | 22 Feb 2021 - 13:46 |
Unknown robot (identified by empty user agent string) | 6 | 847.08 KB | 28 Feb 2021 - 06:40 |
FavIconizer | 5 | 15.89 KB | 25 Feb 2021 - 16:45 |
Yahoo Slurp | 4 | 2.36 MB | 26 Feb 2021 - 10:13 |
yeti | 3 | 124.32 KB | 22 Feb 2021 - 00:03 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 3 | 179.97 KB | 24 Feb 2021 - 08:50 |
Mail.ru bot | 3 | 2.40 KB | 23 Feb 2021 - 05:03 |
Perl tool | 2 | 908.13 KB | 04 Feb 2021 - 19:19 |
MojeekBot | 2 | 13.33 KB | 07 Feb 2021 - 00:00 |
LinkBot | 2 | 2.81 KB | 23 Feb 2021 - 07:18 |
Googlebot-Image | 2 | 93.88 KB | 17 Feb 2021 - 00:14 |
FaceBook bot | 2 | 1.18 MB | 16 Feb 2021 - 08:30 |
Bing Preview bot | 1 | 6.67 KB | 08 Feb 2021 - 13:30 |
BaiDuSpider | 1 | 4.75 KB | 24 Feb 2021 - 08:12 |
|