51 different robots | Hits | Bandwidth | Last visit |
WGet tools | 8,484 | 24.42 GB | 30 Jun 2021 - 23:47 |
Common *nix tool for automating web document retireval. Most likely a bot. | 3,545 | 7.24 GB | 30 Jun 2021 - 23:03 |
Sogou Spider | 1,722 | 81.51 MB | 30 Jun 2021 - 23:55 |
Unknown robot (identified by 'crawl') | 957 | 1.28 GB | 29 Jun 2021 - 14:58 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 760 | 980.72 MB | 30 Jun 2021 - 23:50 |
Java (Often spam bot) | 759 | 1.22 GB | 28 Jun 2021 - 13:31 |
Python-urllib | 594 | 307.57 MB | 30 Jun 2021 - 23:27 |
Perl tool | 443 | 18.66 MB | 30 Jun 2021 - 22:26 |
Unknown robot (identified by 'robot') | 404 | 598.66 MB | 26 Jun 2021 - 14:58 |
AhrefsBot | 332 | 584.39 MB | 24 Jun 2021 - 09:48 |
Bingbot | 287 | 141.67 MB | 30 Jun 2021 - 22:05 |
Yandex Bot | 233 | 157.64 MB | 30 Jun 2021 - 20:45 |
archive.org bot | 222 | 396.45 MB | 03 Jun 2021 - 21:13 |
SemrushBot | 201 | 132.57 MB | 30 Jun 2021 - 23:55 |
BaiDuSpider | 152 | 131.11 MB | 30 Jun 2021 - 22:09 |
SEOkicks Webcrawler | 145 | 205.19 MB | 16 Jun 2021 - 23:39 |
Googlebot | 131 | 43.75 MB | 30 Jun 2021 - 23:33 |
Unknown robot (identified by empty user agent string) | 91 | 46.17 MB | 30 Jun 2021 - 17:11 |
ltx71 | 79 | 152.18 MB | 30 Jun 2021 - 15:55 |
LinkChecker | 68 | 0 | 30 Jun 2021 - 20:20 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 65 | 109.40 MB | 30 Jun 2021 - 18:18 |
MJ12bot | 53 | 6.27 MB | 30 Jun 2021 - 08:51 |
Custo | 48 | 2.27 MB | 30 Jun 2021 - 15:11 |
FavIconizer | 45 | 2.13 MB | 30 Jun 2021 - 17:38 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 32 | 1.51 MB | 29 Jun 2021 - 11:12 |
Suspected bot masqurading as Mozilla | 29 | 3.25 MB | 30 Jun 2021 - 19:38 |
DotBot, Open Site Explorer | 27 | 14.23 MB | 30 Jun 2021 - 18:30 |
Googlebot-Image | 19 | 50.85 KB | 30 Jun 2021 - 08:11 |
Bing Preview bot | 18 | 39.62 KB | 28 Jun 2021 - 19:05 |
Mail.ru bot | 16 | 11.36 MB | 28 Jun 2021 - 19:17 |
Unknown robot (identified by 'spider') | 16 | 451.75 KB | 22 Jun 2021 - 16:20 |
SeznamBot | 11 | 533.62 KB | 30 Jun 2021 - 19:32 |
yeti | 10 | 248.23 KB | 28 Jun 2021 - 07:50 |
Google AdSense | 6 | 15.84 MB | 26 Jun 2021 - 10:49 |
MSIECrawler | 6 | 291.06 KB | 29 Jun 2021 - 08:16 |
Motor | 5 | 52.11 KB | 26 Jun 2021 - 23:56 |
Common Crawl | 5 | 242.30 KB | 18 Jun 2021 - 05:15 |
FaceBook bot | 3 | 145.53 KB | 09 Jun 2021 - 19:25 |
WebCopy | 2 | 0 | 01 Jun 2021 - 02:20 |
Yahoo Slurp | 2 | 2.35 MB | 29 Jun 2021 - 16:54 |
Web Core / Roots | 2 | 2.42 MB | 24 Jun 2021 - 15:46 |
WordPress | 2 | 96.90 KB | 30 Jun 2021 - 13:43 |
Drupal Site | 2 | 0 | 07 Jun 2021 - 15:15 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 16 Jun 2021 - 11:31 |
360spider | 1 | 48.51 KB | 19 Jun 2021 - 03:37 |
Netcraft | 1 | 48.38 KB | 01 Jun 2021 - 17:05 |
InfoBot | 1 | 48.51 KB | 10 Jun 2021 - 06:02 |
YaCy | 1 | 48.38 KB | 16 Jun 2021 - 03:03 |
twitterbot | 1 | 3.17 MB | 30 Jun 2021 - 16:02 |
Unknown robot (identified by 'discovery') | 1 | 48.38 KB | 02 Jun 2021 - 07:39 |
MojeekBot | 1 | 48.38 KB | 19 Jun 2021 - 08:20 |