70 different robots | Hits | Bandwidth | Last visit |
WGet tools | 3,744,051 | 18850.91 GB | 31 Dec 2019 - 23:59 |
SEOkicks Webcrawler | 137,358 | 1424.79 GB | 31 Dec 2019 - 12:43 |
Unknown robot (identified by 'crawl') | 58,164 | 516.75 GB | 31 Dec 2019 - 01:15 |
Common *nix tool for automating web document retireval. Most likely a bot. | 41,573 | 185.20 GB | 31 Dec 2019 - 23:56 |
SemrushBot | 40,986 | 182.57 GB | 31 Dec 2019 - 23:59 |
Python-urllib | 31,015 | 27.19 GB | 31 Dec 2019 - 23:50 |
Unknown robot (identified by empty user agent string) | 14,806 | 354.56 GB | 31 Dec 2019 - 23:56 |
AhrefsBot | 11,137 | 125.51 GB | 31 Dec 2019 - 23:58 |
Yandex Bot | 8,866 | 496.08 GB | 31 Dec 2019 - 23:52 |
check_http (nagios) | 8,850 | 28.59 MB | 31 Dec 2019 - 23:57 |
Googlebot | 7,656 | 52.12 GB | 31 Dec 2019 - 23:52 |
DotBot, Open Site Explorer | 6,239 | 146.80 GB | 31 Dec 2019 - 23:29 |
Unknown robot (identified by 'spider') | 5,509 | 34.69 GB | 31 Dec 2019 - 12:44 |
Bingbot | 4,860 | 80.31 GB | 31 Dec 2019 - 23:24 |
MagpieRSS | 1,521 | 330.77 GB | 31 Dec 2019 - 14:53 |
Java (Often spam bot) | 1,503 | 1.56 GB | 31 Dec 2019 - 23:01 |
BaiDuSpider | 1,429 | 100.84 GB | 31 Dec 2019 - 23:21 |
MJ12bot | 1,354 | 47.10 GB | 31 Dec 2019 - 21:58 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,326 | 40.48 GB | 31 Dec 2019 - 23:43 |
Alexa (IA Archiver) | 647 | 21.41 GB | 31 Dec 2019 - 13:57 |
Perl tool | 629 | 7.01 GB | 31 Dec 2019 - 23:27 |
Suspected bot masqurading as Mozilla | 378 | 15.32 GB | 31 Dec 2019 - 23:35 |
FavIconizer | 314 | 30.50 MB | 31 Dec 2019 - 21:28 |
SeznamBot | 300 | 6.61 GB | 31 Dec 2019 - 23:21 |
Common Crawl | 280 | 88.57 MB | 14 Dec 2019 - 18:51 |
Bing Preview bot | 201 | 33.28 GB | 31 Dec 2019 - 23:33 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 197 | 70.88 MB | 31 Dec 2019 - 07:55 |
Suspected bot masqurading as Mozilla | 179 | 216.38 MB | 31 Dec 2019 - 22:20 |
ichiro | 142 | 12.26 GB | 21 Dec 2019 - 13:58 |
ltx71 | 124 | 8.80 GB | 29 Dec 2019 - 15:08 |
Custo | 118 | 15.74 GB | 26 Dec 2019 - 06:29 |
Sogou Spider | 112 | 254.37 MB | 31 Dec 2019 - 22:57 |
ning | 92 | 4.46 GB | 28 Dec 2019 - 12:22 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 88 | 8.82 GB | 29 Dec 2019 - 15:30 |
Web Core / Roots | 71 | 8.35 GB | 31 Dec 2019 - 07:42 |
LinkChecker | 69 | 0 | 31 Dec 2019 - 10:43 |
Mail.ru bot | 60 | 1.46 MB | 31 Dec 2019 - 22:27 |
Emacs-w3 Search Engine | 59 | 193.60 MB | 22 Dec 2019 - 08:15 |
StackRambler | 52 | 44.03 MB | 19 Dec 2019 - 13:48 |
MojeekBot | 52 | 4.47 MB | 31 Dec 2019 - 05:10 |
MSNBot | 52 | 696.35 MB | 31 Dec 2019 - 20:49 |
InfoBot | 40 | 153.85 KB | 21 Dec 2019 - 11:47 |
360spider | 29 | 211.88 MB | 30 Dec 2019 - 09:37 |
Sift | 27 | 695.00 MB | 31 Dec 2019 - 13:32 |
YaCy | 23 | 1.61 GB | 27 Dec 2019 - 07:32 |
SMTBot | 22 | 15.76 MB | 29 Dec 2019 - 07:50 |
Netcraft | 20 | 26.17 KB | 31 Dec 2019 - 22:20 |
Googlebot-Image | 18 | 458.11 KB | 30 Dec 2019 - 15:07 |
FaceBook bot | 17 | 407.32 MB | 31 Dec 2019 - 12:14 |
Jakarta commons-httpclient | 17 | 459.69 MB | 17 Dec 2019 - 11:43 |
twitterbot | 16 | 4.11 GB | 28 Dec 2019 - 02:51 |
GigablastOpenSource, an Open Source Search Engine(Wiki) | 15 | 2.31 GB | 27 Dec 2019 - 10:15 |
Cliqzbot | 14 | 12.14 MB | 09 Dec 2019 - 17:11 |
WordPress | 12 | 25.64 KB | 18 Dec 2019 - 08:48 |
Motor | 12 | 2.12 GB | 06 Dec 2019 - 11:13 |
yeti | 11 | 26.19 KB | 31 Dec 2019 - 12:43 |
Phantom | 8 | 745.19 MB | 26 Dec 2019 - 00:07 |
Nutch | 6 | 188.57 MB | 16 Dec 2019 - 02:15 |
psbot | 4 | 17.78 KB | 05 Dec 2019 - 02:32 |
Ruby script | 2 | 6.70 KB | 11 Dec 2019 - 03:43 |
Google AdSense | 2 | 2.80 GB | 03 Dec 2019 - 15:26 |
LinkBot | 2 | 58.02 KB | 04 Dec 2019 - 13:09 |
Unknown robot (identified by 'scanner') | 2 | 22.61 KB | 15 Dec 2019 - 10:44 |
GetURL | 2 | 12.72 KB | 07 Dec 2019 - 19:32 |
CFNetwork | 2 | 349.01 MB | 30 Dec 2019 - 04:55 |
Unknown robot (identified by 'robot') | 2 | 14.03 MB | 13 Dec 2019 - 11:50 |
InternetArchive | 1 | 0 | 22 Dec 2019 - 05:21 |
Turtle | 1 | 203.48 MB | 03 Dec 2019 - 09:53 |
A PHP script | 1 | 3.35 KB | 25 Dec 2019 - 04:29 |
archive.org bot | 1 | 222.43 MB | 17 Dec 2019 - 19:09 |
|