62 different robots | Hits | Bandwidth | Last visit |
WGet tools | 3,265,498 | 9748.64 GB | 31 Jan 2022 - 23:59 |
Unknown robot (identified by 'crawl') | 86,577 | 337.17 GB | 31 Jan 2022 - 23:50 |
SemrushBot | 38,622 | 162.61 GB | 31 Jan 2022 - 23:59 |
Bingbot | 30,513 | 458.58 GB | 31 Jan 2022 - 23:49 |
DotBot, Open Site Explorer | 28,684 | 237.91 GB | 31 Jan 2022 - 23:48 |
AhrefsBot | 21,729 | 52.44 GB | 31 Jan 2022 - 23:32 |
Common *nix tool for automating web document retireval. Most likely a bot. | 17,081 | 104.71 GB | 31 Jan 2022 - 23:56 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 13,272 | 125.72 GB | 31 Jan 2022 - 23:58 |
check_http (nagios) | 8,828 | 28.52 MB | 31 Jan 2022 - 23:56 |
Python-urllib | 8,788 | 21.53 GB | 31 Jan 2022 - 23:07 |
Unknown robot (identified by empty user agent string) | 6,283 | 47.16 GB | 31 Jan 2022 - 23:36 |
Googlebot | 6,047 | 121.10 GB | 31 Jan 2022 - 23:51 |
Yandex Bot | 2,273 | 101.77 GB | 31 Jan 2022 - 23:52 |
MJ12bot | 2,199 | 35.29 GB | 31 Jan 2022 - 21:57 |
Common Crawl | 1,258 | 5.02 GB | 26 Jan 2022 - 18:23 |
Unknown robot (identified by 'spider') | 1,229 | 29.41 GB | 31 Jan 2022 - 23:58 |
Java (Often spam bot) | 781 | 409.49 KB | 31 Jan 2022 - 23:56 |
Suspected bot masqurading as Mozilla | 750 | 296.41 MB | 31 Jan 2022 - 22:52 |
ltx71 | 629 | 29.45 GB | 31 Jan 2022 - 17:40 |
Suspected bot masqurading as Mozilla | 441 | 3.43 GB | 30 Jan 2022 - 12:16 |
YaCy | 353 | 41.84 MB | 31 Jan 2022 - 21:06 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 343 | 51.84 MB | 20 Jan 2022 - 11:15 |
FaceBook bot | 316 | 49.25 GB | 31 Jan 2022 - 15:35 |
Yahoo Slurp | 256 | 45.20 GB | 26 Jan 2022 - 15:48 |
BaiDuSpider | 211 | 17.64 GB | 31 Jan 2022 - 21:59 |
Unknown robot (identified by 'robot') | 205 | 11.72 GB | 28 Jan 2022 - 00:26 |
Bing Preview bot | 167 | 26.51 GB | 31 Jan 2022 - 22:57 |
Mail.ru bot | 154 | 1.21 GB | 31 Jan 2022 - 20:18 |
FavIconizer | 138 | 1.04 MB | 31 Jan 2022 - 22:34 |
Custo | 121 | 398.88 KB | 31 Jan 2022 - 22:00 |
MojeekBot | 112 | 13.88 MB | 31 Jan 2022 - 20:18 |
SeznamBot | 104 | 43.49 MB | 31 Jan 2022 - 23:22 |
LinkChecker | 104 | 174.21 MB | 30 Jan 2022 - 19:49 |
Googlebot-Image | 87 | 1.22 MB | 31 Jan 2022 - 01:02 |
Perl tool | 82 | 5.73 GB | 31 Jan 2022 - 14:38 |
Web Core / Roots | 60 | 3.81 GB | 28 Jan 2022 - 13:31 |
Alexa (IA Archiver) | 38 | 1.31 GB | 23 Jan 2022 - 09:27 |
ning | 32 | 573.40 MB | 29 Jan 2022 - 12:48 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 29 | 193.51 MB | 14 Jan 2022 - 03:53 |
Sogou Spider | 22 | 72.43 KB | 29 Jan 2022 - 19:33 |
archive.org bot | 20 | 6.43 MB | 30 Jan 2022 - 18:42 |
twitterbot | 15 | 3.87 GB | 31 Jan 2022 - 09:47 |
yeti | 14 | 84.96 KB | 31 Jan 2022 - 20:30 |
Netcraft | 12 | 23.20 KB | 30 Jan 2022 - 13:32 |
Google Web Preview | 10 | 35.69 KB | 27 Jan 2022 - 03:02 |
Fish search | 8 | 18.91 KB | 31 Jan 2022 - 14:50 |
Exabot | 8 | 2.03 GB | 21 Jan 2022 - 05:16 |
Phantom | 7 | 17.38 KB | 17 Jan 2022 - 03:34 |
Simmany Robot Ver1.0 | 6 | 64.69 KB | 23 Jan 2022 - 16:22 |
A PHP script | 4 | 187.68 MB | 30 Jan 2022 - 19:46 |
WordPress | 3 | 35.72 KB | 12 Jan 2022 - 19:08 |
WebCopy | 3 | 3.35 KB | 23 Jan 2022 - 15:47 |
HTTrack off-line browser | 2 | 9.42 KB | 05 Jan 2022 - 20:10 |
Unknown robot (identified by 'scanner') | 2 | 6.57 KB | 08 Jan 2022 - 10:32 |
InfoBot | 2 | 8.77 KB | 10 Jan 2022 - 16:27 |
CFNetwork | 2 | 650.76 MB | 18 Jan 2022 - 05:10 |
Unknown robot (identified by 'discovery') | 2 | 6.70 KB | 15 Jan 2022 - 17:36 |
Cfetch | 1 | 642.00 MB | 10 Jan 2022 - 00:13 |
SMTBot | 1 | 0 | 16 Jan 2022 - 11:31 |
Google AdSense | 1 | 479.24 KB | 01 Jan 2022 - 23:02 |
InternetArchive | 1 | 3.47 KB | 03 Jan 2022 - 23:05 |
Emacs-w3 Search Engine | 1 | 435.00 MB | 26 Jan 2022 - 04:54 |
|