55 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 8,084 | 46.43 GB | 30 Sep 2019 - 22:08 |
SemrushBot | 6,539 | 356.72 GB | 30 Sep 2019 - 21:50 |
Yandex Bot | 1,961 | 164.42 GB | 30 Sep 2019 - 21:19 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,687 | 71.34 MB | 29 Sep 2019 - 04:13 |
Bingbot | 1,614 | 16.50 GB | 30 Sep 2019 - 21:45 |
Googlebot | 1,594 | 22.12 GB | 30 Sep 2019 - 21:55 |
AhrefsBot | 1,509 | 69.25 GB | 30 Sep 2019 - 21:43 |
CFNetwork | 1,217 | 1.20 GB | 30 Sep 2019 - 11:44 |
Unknown robot (identified by 'crawl') | 910 | 14.43 GB | 30 Sep 2019 - 14:33 |
Bing Preview bot | 369 | 6.29 GB | 30 Sep 2019 - 21:45 |
Java (Often spam bot) | 352 | 15.20 GB | 30 Sep 2019 - 02:12 |
Web Core / Roots | 228 | 18.01 GB | 30 Sep 2019 - 18:48 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 178 | 4.37 GB | 30 Sep 2019 - 21:11 |
LinkChecker | 126 | 747.38 KB | 30 Sep 2019 - 17:31 |
DotBot, Open Site Explorer | 121 | 4.37 GB | 30 Sep 2019 - 09:11 |
rpt-httpclient | 91 | 532.74 MB | 30 Sep 2019 - 21:22 |
FavIconizer | 70 | 467.11 MB | 30 Sep 2019 - 22:09 |
Unknown robot (identified by empty user agent string) | 55 | 2.56 GB | 30 Sep 2019 - 21:36 |
WGet tools | 49 | 2.01 GB | 29 Sep 2019 - 16:05 |
MJ12bot | 45 | 479.94 MB | 30 Sep 2019 - 09:18 |
Unknown robot (identified by 'spider') | 44 | 1.73 GB | 30 Sep 2019 - 02:25 |
Sogou Spider | 42 | 185.05 MB | 30 Sep 2019 - 20:55 |
Common Crawl | 41 | 610.76 MB | 23 Sep 2019 - 09:45 |
BaiDuSpider | 41 | 1.69 GB | 30 Sep 2019 - 01:15 |
Suspected bot masqurading as Mozilla | 31 | 0 | 30 Sep 2019 - 14:45 |
SeznamBot | 28 | 398.46 MB | 30 Sep 2019 - 18:50 |
WordPress | 24 | 42.68 MB | 08 Sep 2019 - 08:57 |
Suspected bot masqurading as Mozilla | 20 | 22.76 KB | 30 Sep 2019 - 03:26 |
Google Web Preview | 20 | 1.54 GB | 16 Sep 2019 - 12:29 |
Python-urllib | 18 | 2.80 GB | 30 Sep 2019 - 00:06 |
ltx71 | 14 | 1.41 GB | 26 Sep 2019 - 10:35 |
GigaBot | 14 | 1.38 GB | 08 Sep 2019 - 18:00 |
Nutch | 11 | 229.22 MB | 28 Sep 2019 - 14:41 |
Alexa (IA Archiver) | 9 | 21.36 MB | 30 Sep 2019 - 20:35 |
FaceBook bot | 8 | 374.07 MB | 30 Sep 2019 - 03:31 |
360spider | 7 | 32.45 KB | 25 Sep 2019 - 15:08 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 96.27 MB | 21 Sep 2019 - 22:03 |
Cliqzbot | 5 | 36.06 MB | 26 Sep 2019 - 05:01 |
Google AdSense | 4 | 67.98 MB | 21 Sep 2019 - 19:20 |
Exabot | 3 | 7.15 MB | 22 Sep 2019 - 10:58 |
yeti | 3 | 21.34 MB | 25 Sep 2019 - 12:25 |
Motor | 2 | 124.02 MB | 21 Sep 2019 - 20:41 |
SEOkicks Webcrawler | 2 | 7.39 KB | 02 Sep 2019 - 01:50 |
NG 2.x (Exalead) | 2 | 152.21 MB | 08 Sep 2019 - 10:12 |
Mail.ru bot | 2 | 757.93 KB | 10 Sep 2019 - 22:48 |
lwp-trivial | 1 | 98.91 MB | 30 Sep 2019 - 08:53 |
Yahoo Slurp | 1 | 7.13 MB | 14 Sep 2019 - 16:40 |
Aport | 1 | 7.04 MB | 22 Sep 2019 - 20:48 |
Grapeshot Crawler | 1 | 7.03 MB | 05 Sep 2019 - 16:18 |
A PHP script | 1 | 0 | 28 Sep 2019 - 23:53 |
MojeekBot | 1 | 9.06 KB | 28 Sep 2019 - 19:21 |
ning | 1 | 7.02 MB | 08 Sep 2019 - 04:38 |
WWWC Ver 0.2.5 | 1 | 0 | 01 Sep 2019 - 12:38 |
LinkBot | 1 | 0 | 16 Sep 2019 - 17:44 |
Unknown robot (identified by 'robot') | 1 | 6.66 KB | 17 Sep 2019 - 10:32 |
|