47 different robots | Hits | Bandwidth | Last visit |
WGet tools | 7,704 | 21.45 GB | 29 Feb 2020 - 23:48 |
Common *nix tool for automating web document retireval. Most likely a bot. | 1,305 | 2.89 GB | 29 Feb 2020 - 23:13 |
Unknown robot (identified by 'crawl') | 1,257 | 1.40 GB | 29 Feb 2020 - 11:58 |
Yandex Bot | 1,150 | 940.93 MB | 29 Feb 2020 - 23:57 |
Bingbot | 749 | 1.07 GB | 29 Feb 2020 - 22:21 |
Python-urllib | 739 | 94.60 MB | 29 Feb 2020 - 21:11 |
Perl tool | 519 | 18.33 MB | 29 Feb 2020 - 23:24 |
AhrefsBot | 429 | 703.12 MB | 29 Feb 2020 - 22:45 |
Googlebot | 364 | 250.67 MB | 29 Feb 2020 - 10:15 |
SemrushBot | 338 | 153.49 MB | 29 Feb 2020 - 18:28 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 324 | 360.22 MB | 29 Feb 2020 - 16:33 |
DotBot, Open Site Explorer | 298 | 85.08 MB | 29 Feb 2020 - 23:43 |
MJ12bot | 163 | 119.24 MB | 29 Feb 2020 - 08:04 |
BaiDuSpider | 147 | 288.96 KB | 29 Feb 2020 - 23:31 |
Suspected bot masqurading as Mozilla | 119 | 191.16 MB | 29 Feb 2020 - 07:32 |
Unknown robot (identified by empty user agent string) | 107 | 34.03 MB | 29 Feb 2020 - 18:08 |
SMTBot | 89 | 35.36 MB | 22 Feb 2020 - 01:40 |
FavIconizer | 87 | 7.14 MB | 29 Feb 2020 - 14:56 |
Java (Often spam bot) | 81 | 72.54 MB | 29 Feb 2020 - 23:01 |
LinkChecker | 69 | 0 | 29 Feb 2020 - 23:54 |
SEOkicks Webcrawler | 32 | 944.58 KB | 24 Feb 2020 - 18:52 |
Mail.ru bot | 25 | 18.70 MB | 28 Feb 2020 - 19:00 |
ltx71 | 21 | 33.96 MB | 29 Feb 2020 - 08:00 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 20 | 943.41 KB | 23 Feb 2020 - 23:57 |
ning | 17 | 2.49 MB | 20 Feb 2020 - 11:22 |
Sogou Spider | 16 | 708.38 KB | 28 Feb 2020 - 11:16 |
Common Crawl | 15 | 190.73 KB | 18 Feb 2020 - 23:22 |
SeznamBot | 13 | 432.75 KB | 29 Feb 2020 - 21:31 |
WordPress | 12 | 2.54 MB | 22 Feb 2020 - 13:16 |
Google AdSense | 9 | 21.99 MB | 29 Feb 2020 - 10:10 |
FaceBook bot | 9 | 199.73 KB | 29 Feb 2020 - 15:06 |
yeti | 8 | 242.24 KB | 25 Feb 2020 - 23:00 |
Alexa (IA Archiver) | 8 | 4.99 MB | 29 Feb 2020 - 17:34 |
Bing Preview bot | 6 | 2.21 MB | 28 Feb 2020 - 10:50 |
YaCy | 5 | 236.17 KB | 23 Feb 2020 - 02:36 |
Googlebot-Image | 4 | 1.25 KB | 29 Feb 2020 - 00:17 |
archive.org bot | 3 | 3.30 MB | 26 Feb 2020 - 22:06 |
Cliqzbot | 2 | 94.52 KB | 12 Feb 2020 - 09:32 |
GigaBot | 2 | 94.52 KB | 06 Feb 2020 - 07:00 |
Web Core / Roots | 2 | 3.30 MB | 24 Feb 2020 - 17:18 |
Nutch | 2 | 47.50 KB | 14 Feb 2020 - 04:22 |
Drupal Site | 1 | 0 | 15 Feb 2020 - 17:01 |
CMS Crawler | 1 | 47.13 KB | 13 Feb 2020 - 13:36 |
Yahoo Slurp | 1 | 2.42 MB | 02 Feb 2020 - 13:03 |
MSNBot | 1 | 2.20 KB | 01 Feb 2020 - 11:23 |
IstellaBot | 1 | 47.13 KB | 24 Feb 2020 - 17:10 |
MojeekBot | 1 | 47.26 KB | 27 Feb 2020 - 22:55 |
|