67 different robots | Hits | Bandwidth | Last visit |
WGet tools | 3,018,673 | 20658.05 GB | 31 Aug 2019 - 23:59 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 15,833 | 120.11 GB | 31 Aug 2019 - 23:59 |
check_http (nagios) | 8,650 | 27.94 MB | 31 Aug 2019 - 23:59 |
Python-urllib | 30,734 | 41.88 GB | 31 Aug 2019 - 23:59 |
SemrushBot | 40,605 | 189.59 GB | 31 Aug 2019 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 44,203 | 287.42 GB | 31 Aug 2019 - 23:50 |
Bingbot | 5,354 | 127.58 GB | 31 Aug 2019 - 23:49 |
Unknown robot (identified by empty user agent string) | 14,715 | 386.66 GB | 31 Aug 2019 - 23:47 |
Mail.ru bot | 146 | 20.84 MB | 31 Aug 2019 - 23:42 |
Yandex Bot | 19,285 | 2775.22 GB | 31 Aug 2019 - 23:35 |
FavIconizer | 274 | 87.44 MB | 31 Aug 2019 - 23:32 |
BaiDuSpider | 2,593 | 145.79 GB | 31 Aug 2019 - 23:26 |
Googlebot | 13,571 | 73.75 GB | 31 Aug 2019 - 23:04 |
Suspected bot masqurading as Mozilla | 259 | 138.77 MB | 31 Aug 2019 - 22:44 |
Bing Preview bot | 156 | 61.55 GB | 31 Aug 2019 - 22:26 |
Java (Often spam bot) | 1,506 | 6.83 GB | 31 Aug 2019 - 21:45 |
DotBot, Open Site Explorer | 150 | 6.87 GB | 31 Aug 2019 - 21:42 |
Sogou Spider | 146 | 231.40 MB | 31 Aug 2019 - 19:42 |
ning | 88 | 4.11 GB | 31 Aug 2019 - 17:14 |
FaceBook bot | 58 | 2.51 GB | 31 Aug 2019 - 16:14 |
Perl tool | 771 | 14.74 GB | 31 Aug 2019 - 13:41 |
MJ12bot | 561 | 46.55 GB | 31 Aug 2019 - 12:25 |
twitterbot | 12 | 1.71 GB | 31 Aug 2019 - 12:04 |
Suspected bot masqurading as Mozilla | 408 | 13.31 GB | 31 Aug 2019 - 11:12 |
Exabot | 57 | 223.64 KB | 31 Aug 2019 - 09:12 |
SeznamBot | 264 | 788.62 MB | 31 Aug 2019 - 08:44 |
Alexa (IA Archiver) | 155 | 141.12 MB | 31 Aug 2019 - 08:36 |
archive.org bot | 4 | 818 Bytes | 31 Aug 2019 - 04:35 |
360spider | 8 | 6.18 MB | 31 Aug 2019 - 03:05 |
ltx71 | 115 | 21.89 GB | 31 Aug 2019 - 02:39 |
VSE | 5 | 22.55 KB | 30 Aug 2019 - 23:59 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 411 | 192.97 MB | 30 Aug 2019 - 21:45 |
Googlebot-Image | 30 | 173.12 KB | 30 Aug 2019 - 21:11 |
Sift | 24 | 261.34 MB | 30 Aug 2019 - 20:42 |
Unknown robot (identified by 'spider') | 102 | 18.59 GB | 30 Aug 2019 - 20:39 |
YaCy | 166 | 21.55 GB | 30 Aug 2019 - 17:07 |
MagpieRSS | 1,475 | 357.12 GB | 30 Aug 2019 - 13:37 |
Web Core / Roots | 129 | 13.52 GB | 30 Aug 2019 - 12:37 |
Unknown robot (identified by 'crawl') | 227 | 47.12 MB | 30 Aug 2019 - 10:22 |
CFNetwork | 9 | 1.87 GB | 30 Aug 2019 - 09:50 |
LinkChecker | 49 | 0 | 30 Aug 2019 - 07:35 |
MojeekBot | 11 | 1.81 MB | 29 Aug 2019 - 21:54 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 43 | 14.08 MB | 29 Aug 2019 - 18:19 |
Jakarta commons-httpclient | 5 | 340.01 MB | 29 Aug 2019 - 09:22 |
yeti | 15 | 37.37 KB | 29 Aug 2019 - 00:16 |
AdsBot-Google | 3 | 8.72 KB | 28 Aug 2019 - 23:34 |
AhrefsBot | 1,587 | 20.74 GB | 28 Aug 2019 - 04:49 |
Wotbox | 13 | 3.92 MB | 27 Aug 2019 - 20:30 |
SMTBot | 59 | 56.81 MB | 27 Aug 2019 - 06:30 |
Common Crawl | 519 | 23.17 GB | 26 Aug 2019 - 01:27 |
Yahoo Slurp | 2 | 11.13 KB | 24 Aug 2019 - 03:16 |
Simmany Robot Ver1.0 | 4 | 976.00 MB | 23 Aug 2019 - 22:31 |
Nutch | 11 | 2.36 GB | 23 Aug 2019 - 07:02 |
SEOkicks Webcrawler | 40 | 79.42 MB | 21 Aug 2019 - 22:37 |
Phantom | 11 | 28.36 KB | 20 Aug 2019 - 12:13 |
Google AdSense | 1 | 2.80 GB | 20 Aug 2019 - 04:32 |
WordPress | 27 | 623.28 MB | 17 Aug 2019 - 19:47 |
CMS Crawler | 2 | 6.57 KB | 16 Aug 2019 - 15:34 |
Turn It In | 1 | 1.59 MB | 14 Aug 2019 - 00:00 |
Cliqzbot | 19 | 52.22 MB | 11 Aug 2019 - 22:08 |
Emacs-w3 Search Engine | 19 | 2.45 GB | 11 Aug 2019 - 09:43 |
Netcraft | 7 | 19.72 KB | 06 Aug 2019 - 07:03 |
GigaBot | 16,370 | 56.99 GB | 05 Aug 2019 - 23:00 |
Suspected bot masqurading as Mozilla | 4 | 518.93 MB | 05 Aug 2019 - 04:12 |
MSIECrawler | 1 | 3.48 KB | 04 Aug 2019 - 15:13 |
BacklinkCrawler | 2 | 6.57 KB | 03 Aug 2019 - 12:51 |
oBot | 4 | 0 | 01 Aug 2019 - 08:36 |
|