47 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 7,915 | 556.51 GB | 31 Jul 2020 - 23:09 |
Common *nix tool for automating web document retireval. Most likely a bot. | 24,234 | 145.48 GB | 31 Jul 2020 - 23:09 |
Googlebot | 2,072 | 35.46 GB | 31 Jul 2020 - 23:07 |
AhrefsBot | 9,908 | 398.09 GB | 31 Jul 2020 - 23:05 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 904 | 115.05 MB | 31 Jul 2020 - 22:57 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,418 | 28.96 GB | 31 Jul 2020 - 22:55 |
Yandex Bot | 834 | 29.99 GB | 31 Jul 2020 - 22:53 |
Bingbot | 1,718 | 29.20 GB | 31 Jul 2020 - 22:52 |
DotBot, Open Site Explorer | 374 | 11.47 GB | 31 Jul 2020 - 22:45 |
Unknown robot (identified by empty user agent string) | 294 | 16.94 GB | 31 Jul 2020 - 22:05 |
Perl tool | 549 | 2.74 MB | 31 Jul 2020 - 22:00 |
Bing Preview bot | 44 | 3.12 GB | 31 Jul 2020 - 21:39 |
Unknown robot (identified by 'spider') | 96 | 6.47 GB | 31 Jul 2020 - 21:32 |
Feedfetcher-Google | 31 | 9.96 KB | 31 Jul 2020 - 19:51 |
rpt-httpclient | 62 | 152.21 MB | 31 Jul 2020 - 19:07 |
FavIconizer | 79 | 439.17 MB | 31 Jul 2020 - 16:08 |
Suspected bot masqurading as Mozilla | 31 | 0 | 31 Jul 2020 - 16:01 |
LinkChecker | 234 | 0 | 31 Jul 2020 - 13:59 |
Unknown robot (identified by 'crawl') | 2,546 | 75.41 GB | 31 Jul 2020 - 12:45 |
CFNetwork | 2,543 | 251.23 MB | 31 Jul 2020 - 12:40 |
BaiDuSpider | 12 | 386.18 MB | 31 Jul 2020 - 08:32 |
Google Web Preview | 42 | 299.23 MB | 31 Jul 2020 - 06:47 |
ning | 3 | 22.42 MB | 31 Jul 2020 - 03:02 |
WGet tools | 78 | 1.74 GB | 31 Jul 2020 - 02:41 |
Web Core / Roots | 74 | 3.34 GB | 31 Jul 2020 - 00:20 |
Motor | 8 | 237.20 MB | 30 Jul 2020 - 23:56 |
Sogou Spider | 17 | 20.01 MB | 30 Jul 2020 - 21:59 |
FaceBook bot | 37 | 234.70 MB | 30 Jul 2020 - 19:05 |
MJ12bot | 122 | 4.70 GB | 30 Jul 2020 - 13:37 |
Python-urllib | 27 | 1.00 GB | 30 Jul 2020 - 07:10 |
MojeekBot | 2 | 6.47 KB | 29 Jul 2020 - 10:18 |
twitterbot | 6 | 146.24 MB | 28 Jul 2020 - 12:58 |
Suspected bot masqurading as Mozilla | 6 | 6 Bytes | 28 Jul 2020 - 00:47 |
Java (Often spam bot) | 142 | 2.55 GB | 27 Jul 2020 - 22:49 |
SeznamBot | 23 | 52.58 MB | 27 Jul 2020 - 12:44 |
Cfetch | 2 | 15.34 MB | 25 Jul 2020 - 20:15 |
archive.org bot | 1 | 7.75 MB | 22 Jul 2020 - 18:21 |
Unknown robot (identified by 'robot') | 2 | 8.52 KB | 21 Jul 2020 - 12:09 |
Cliqzbot | 3 | 21.73 MB | 19 Jul 2020 - 19:13 |
ltx71 | 5 | 118.65 MB | 19 Jul 2020 - 16:37 |
Mail.ru bot | 12 | 43.40 MB | 16 Jul 2020 - 15:30 |
Common Crawl | 42 | 66.90 MB | 15 Jul 2020 - 08:07 |
Fish search | 3 | 210.19 MB | 14 Jul 2020 - 11:00 |
Alexa (IA Archiver) | 24 | 100.68 KB | 12 Jul 2020 - 21:55 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 10 Jul 2020 - 09:28 |
InternetArchive | 1 | 0 | 07 Jul 2020 - 17:25 |
SEOkicks Webcrawler | 94 | 416.02 KB | 03 Jul 2020 - 21:46 |
|