68 different robots | Hits | Bandwidth | Last visit |
WGet tools | 2,675,894 | 10622.41 GB | 31 May 2022 - 23:59 |
Unknown robot (identified by 'crawl') | 72,527 | 471.51 GB | 31 May 2022 - 21:44 |
SemrushBot | 43,324 | 145.00 GB | 31 May 2022 - 23:59 |
Bingbot | 32,274 | 426.47 GB | 31 May 2022 - 23:55 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 25,832 | 118.19 GB | 31 May 2022 - 23:11 |
AhrefsBot | 19,298 | 16.26 GB | 31 May 2022 - 23:56 |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,557 | 211.54 GB | 31 May 2022 - 23:14 |
DotBot, Open Site Explorer | 7,679 | 90.23 GB | 31 May 2022 - 23:49 |
Unknown robot (identified by empty user agent string) | 7,033 | 100.12 GB | 31 May 2022 - 23:35 |
Googlebot | 5,702 | 75.69 GB | 31 May 2022 - 23:55 |
HTTrack off-line browser | 5,226 | 22.50 GB | 13 May 2022 - 10:13 |
check_http (nagios) | 4,122 | 13.31 MB | 15 May 2022 - 15:57 |
Python-urllib | 3,165 | 31.35 GB | 31 May 2022 - 22:02 |
Common Crawl | 2,881 | 15.45 GB | 28 May 2022 - 17:56 |
MJ12bot | 2,493 | 63.77 GB | 31 May 2022 - 20:09 |
Unknown robot (identified by 'spider') | 1,295 | 42.31 GB | 31 May 2022 - 23:50 |
Yandex Bot | 1,214 | 131.39 GB | 31 May 2022 - 21:14 |
YaCy | 978 | 40.72 GB | 22 May 2022 - 03:09 |
Suspected bot masqurading as Mozilla | 911 | 598.77 MB | 31 May 2022 - 23:46 |
Java (Often spam bot) | 831 | 605.99 MB | 31 May 2022 - 23:47 |
Suspected bot masqurading as Mozilla | 486 | 19.29 GB | 31 May 2022 - 21:05 |
SEOkicks Webcrawler | 380 | 5.50 GB | 29 May 2022 - 11:28 |
BaiDuSpider | 313 | 34.04 GB | 31 May 2022 - 07:37 |
Custo | 290 | 960.17 KB | 31 May 2022 - 23:05 |
Mail.ru bot | 268 | 68.70 MB | 31 May 2022 - 14:05 |
Googlebot-Image | 238 | 45.60 MB | 31 May 2022 - 23:51 |
Unknown robot (identified by 'robot') | 190 | 6.94 GB | 19 May 2022 - 22:03 |
Perl tool | 133 | 39.96 GB | 30 May 2022 - 20:31 |
LinkChecker | 119 | 266.87 MB | 31 May 2022 - 21:57 |
FavIconizer | 119 | 393.56 KB | 31 May 2022 - 18:02 |
MojeekBot | 117 | 20.26 MB | 31 May 2022 - 22:22 |
SeznamBot | 115 | 774.09 MB | 31 May 2022 - 21:04 |
Bing Preview bot | 110 | 17.17 GB | 31 May 2022 - 13:36 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 82 | 70.41 MB | 29 May 2022 - 13:26 |
FaceBook bot | 76 | 6.16 GB | 30 May 2022 - 19:02 |
Web Core / Roots | 35 | 26.22 GB | 30 May 2022 - 06:03 |
Sogou Spider | 27 | 89.81 KB | 31 May 2022 - 07:43 |
archive.org bot | 15 | 2.70 GB | 26 May 2022 - 02:30 |
Yahoo Slurp | 12 | 960.52 MB | 30 May 2022 - 14:39 |
Google AdSense | 12 | 16.81 MB | 22 May 2022 - 12:01 |
yeti | 12 | 76.38 KB | 29 May 2022 - 16:32 |
CFNetwork | 8 | 951.18 MB | 15 May 2022 - 22:49 |
twitterbot | 7 | 1.84 GB | 24 May 2022 - 13:41 |
Netcraft | 6 | 19.72 KB | 21 May 2022 - 14:57 |
Suspected bot masqurading as Mozilla | 5 | 44.00 MB | 03 May 2022 - 09:30 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 422.41 MB | 24 May 2022 - 15:08 |
HKU WWW Octopus | 3 | 1.79 MB | 29 May 2022 - 21:53 |
A PHP script | 3 | 53.28 MB | 16 May 2022 - 13:21 |
Motor | 3 | 806.01 KB | 06 May 2022 - 00:51 |
HTMLParser | 3 | 9.92 KB | 25 May 2022 - 06:52 |
Google Web Preview | 2 | 3.88 KB | 03 May 2022 - 07:40 |
MSNBot | 2 | 99 Bytes | 03 May 2022 - 07:40 |
ning | 2 | 357.02 MB | 15 May 2022 - 14:38 |
WordPress | 2 | 24.45 KB | 30 May 2022 - 14:06 |
Unknown robot (identified by 'discovery') | 1 | 21.88 KB | 26 May 2022 - 07:31 |
360spider | 1 | 16.62 MB | 16 May 2022 - 16:39 |
Gulper Bot | 1 | 2.94 KB | 03 May 2022 - 07:39 |
Feedfetcher-Google | 1 | 6.20 KB | 03 May 2022 - 07:40 |
InternetArchive | 1 | 12.10 KB | 21 May 2022 - 10:31 |
BBot | 1 | 3.35 KB | 16 May 2022 - 09:29 |
Spry Wizard Robot | 1 | 3.35 KB | 30 May 2022 - 17:31 |
AdsBot-Google | 1 | 3.35 KB | 31 May 2022 - 07:36 |
Language Tools Bot (ltbot) | 1 | 3.22 KB | 28 May 2022 - 00:29 |
Monster | 1 | 4.36 KB | 22 May 2022 - 11:05 |
Grub.org | 1 | 2.94 KB | 03 May 2022 - 07:39 |
Bloglines | 1 | 3.22 KB | 16 May 2022 - 10:41 |
SuperBot | 1 | 3.35 KB | 24 May 2022 - 17:07 |
LinkBot | 1 | 2.20 MB | 26 May 2022 - 18:11 |
|