65 different robots | Hits | Bandwidth | Last visit |
WGet tools | 2,029,822 | 12761.15 GB | 31 Jul 2019 - 23:59 |
Yandex Bot | 34,658 | 4790.08 GB | 31 Jul 2019 - 23:53 |
Python-urllib | 22,366 | 19.22 GB | 31 Jul 2019 - 23:59 |
SemrushBot | 20,667 | 99.74 GB | 31 Jul 2019 - 23:52 |
Unknown robot (identified by 'crawl') | 17,759 | 288.93 GB | 30 Jul 2019 - 21:02 |
Common *nix tool for automating web document retireval. Most likely a bot. | 14,868 | 118.73 GB | 31 Jul 2019 - 23:32 |
GigaBot | 13,704 | 34.63 GB | 31 Jul 2019 - 23:50 |
Unknown robot (identified by empty user agent string) | 8,632 | 222.73 GB | 31 Jul 2019 - 22:50 |
Googlebot | 6,766 | 47.23 GB | 31 Jul 2019 - 23:29 |
AhrefsBot | 6,565 | 51.57 GB | 31 Jul 2019 - 13:28 |
check_http (nagios) | 5,845 | 18.76 MB | 31 Jul 2019 - 23:57 |
Bingbot | 5,030 | 138.81 GB | 31 Jul 2019 - 23:48 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,040 | 46.62 GB | 31 Jul 2019 - 19:48 |
BaiDuSpider | 2,455 | 108.00 GB | 31 Jul 2019 - 23:53 |
Java (Often spam bot) | 897 | 5.47 GB | 31 Jul 2019 - 23:45 |
MagpieRSS | 843 | 195.83 GB | 30 Jul 2019 - 22:09 |
Perl tool | 566 | 6.90 GB | 31 Jul 2019 - 23:31 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 496 | 3.61 GB | 31 Jul 2019 - 17:40 |
Suspected bot masqurading as Mozilla | 308 | 10.15 GB | 31 Jul 2019 - 11:17 |
SEOkicks Webcrawler | 257 | 2.57 GB | 30 Jul 2019 - 19:22 |
Common Crawl | 226 | 61.26 MB | 22 Jul 2019 - 04:17 |
Exabot | 225 | 944.21 KB | 31 Jul 2019 - 16:24 |
Sogou Spider | 220 | 669.61 MB | 31 Jul 2019 - 14:05 |
FavIconizer | 202 | 92.18 MB | 31 Jul 2019 - 20:52 |
Jakarta commons-httpclient | 202 | 725.95 MB | 31 Jul 2019 - 15:14 |
Suspected bot masqurading as Mozilla | 188 | 125.61 MB | 31 Jul 2019 - 15:17 |
ltx71 | 135 | 20.54 GB | 28 Jul 2019 - 23:19 |
SeznamBot | 131 | 8.48 GB | 31 Jul 2019 - 23:50 |
Alexa (IA Archiver) | 109 | 41.05 MB | 30 Jul 2019 - 13:30 |
Bing Preview bot | 109 | 44.90 GB | 31 Jul 2019 - 14:12 |
Unknown robot (identified by 'spider') | 109 | 15.43 GB | 31 Jul 2019 - 21:56 |
Web Core / Roots | 85 | 8.80 GB | 31 Jul 2019 - 12:40 |
DotBot, Open Site Explorer | 81 | 11.38 GB | 31 Jul 2019 - 10:32 |
ning | 63 | 548.38 MB | 27 Jul 2019 - 03:43 |
yeti | 48 | 4.54 GB | 18 Jul 2019 - 12:09 |
Mail.ru bot | 42 | 14.30 MB | 27 Jul 2019 - 12:27 |
LinkChecker | 37 | 0 | 30 Jul 2019 - 14:49 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 32 | 6.69 GB | 30 Jul 2019 - 13:42 |
SMTBot | 30 | 26.10 MB | 19 Jul 2019 - 06:22 |
Phantom | 21 | 49.43 KB | 24 Jul 2019 - 21:09 |
Sift | 17 | 76.97 KB | 30 Jul 2019 - 01:01 |
Nutch | 16 | 2.18 GB | 26 Jul 2019 - 04:03 |
Googlebot-Image | 16 | 2.75 KB | 30 Jul 2019 - 18:30 |
MJ12bot | 15 | 2.40 GB | 25 Jul 2019 - 03:28 |
FaceBook bot | 15 | 522.04 MB | 30 Jul 2019 - 07:44 |
Cliqzbot | 14 | 51.48 MB | 01 Jul 2019 - 18:51 |
WordPress | 13 | 236.80 MB | 29 Jul 2019 - 07:04 |
twitterbot | 12 | 1.13 GB | 31 Jul 2019 - 05:36 |
360spider | 11 | 13.97 MB | 30 Jul 2019 - 05:00 |
MojeekBot | 8 | 33.13 KB | 24 Jul 2019 - 02:21 |
YaCy | 7 | 25.85 KB | 31 Jul 2019 - 13:43 |
Netcraft | 6 | 19.59 KB | 05 Jul 2019 - 10:00 |
Google AdSense | 5 | 2.80 GB | 29 Jul 2019 - 11:35 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 5 | 17.49 KB | 12 Jul 2019 - 05:04 |
Simmany Robot Ver1.0 | 4 | 267.01 MB | 31 Jul 2019 - 01:11 |
CFNetwork | 2 | 552.60 MB | 08 Jul 2019 - 09:45 |
BacklinkCrawler | 1 | 56 Bytes | 28 Jul 2019 - 20:46 |
IstellaBot | 1 | 3.22 KB | 09 Jul 2019 - 14:37 |
Unknown robot (identified by 'scanner') | 1 | 76.23 KB | 31 Jul 2019 - 18:50 |
Miva | 1 | 6.46 KB | 13 Jul 2019 - 13:57 |
psbot | 1 | 76.23 KB | 31 Jul 2019 - 13:42 |
Unknown robot (identified by 'robot') | 1 | 9.41 KB | 23 Jul 2019 - 16:00 |
archive.org bot | 1 | 19.60 KB | 23 Jul 2019 - 22:27 |
CMS Crawler | 1 | 3.35 KB | 09 Jul 2019 - 02:00 |
Emacs-w3 Search Engine | 1 | 292.00 MB | 01 Jul 2019 - 21:06 |
|