42 different robots | Hits | Bandwidth | Last visit |
Googlebot | 335+81 | 5.85 MB | 31 May 2016 - 19:56 |
Unknown robot (identified by hit on 'robots.txt') | 0+750 | 102.54 KB | 31 May 2016 - 19:55 |
Unknown robot (identified by 'crawl') | 557+161 | 7.31 MB | 31 May 2016 - 19:51 |
Unknown robot (identified by 'bot*') | 1885+198 | 21.70 MB | 31 May 2016 - 19:40 |
BaiDuSpider | 1553+32 | 21.04 MB | 31 May 2016 - 19:36 |
MJ12bot | 546+437 | 10.23 MB | 31 May 2016 - 19:15 |
SeznamBot | 57+97 | 1.05 MB | 31 May 2016 - 18:15 |
Yahoo Slurp | 175+81 | 1.02 MB | 31 May 2016 - 17:42 |
Java (Often spam bot) | 922+1 | 7.39 MB | 31 May 2016 - 16:56 |
Unknown robot (identified by empty user agent string) | 383+10 | 7.02 MB | 31 May 2016 - 16:37 |
Yandex bot | 203+71 | 2.81 MB | 31 May 2016 - 14:25 |
Unknown robot (identified by 'robot') | 105+77 | 2.95 MB | 31 May 2016 - 11:10 |
GigaBot | 42+26 | 673.14 KB | 31 May 2016 - 10:16 |
Mail.ru bot | 43+31 | 1.19 MB | 31 May 2016 - 07:51 |
Phantom | 692 | 4.89 MB | 31 May 2016 - 06:00 |
Unknown robot (identified by 'spider') | 51+16 | 671.50 KB | 31 May 2016 - 05:25 |
Feedfetcher-Google | 31 | 644.38 KB | 31 May 2016 - 03:07 |
CFNetwork | 1 | 15.29 KB | 30 May 2016 - 16:52 |
SpiderBot | 3+3 | 46.27 KB | 29 May 2016 - 16:24 |
MagpieRSS | 12 | 0 | 29 May 2016 - 04:36 |
VSE | 2+1 | 140 Bytes | 28 May 2016 - 03:45 |
Exabot | 25+18 | 59.40 KB | 27 May 2016 - 18:00 |
yacy | 19+18 | 252.19 KB | 27 May 2016 - 11:45 |
Heritrix | 16 | 244.59 KB | 27 May 2016 - 10:35 |
MSIECrawler | 6 | 77.23 KB | 27 May 2016 - 10:22 |
SurveyBot | 4+2 | 61.42 KB | 26 May 2016 - 16:53 |
archive.org bot | 2+12 | 44.41 KB | 26 May 2016 - 16:38 |
Speedy Spider | 2+2 | 30.85 KB | 26 May 2016 - 13:47 |
Nutch | 33+10 | 418.48 KB | 25 May 2016 - 14:22 |
LinkBot | 4 | 49.08 KB | 25 May 2016 - 10:44 |
Python-urllib | 2+2 | 30.85 KB | 23 May 2016 - 14:14 |
Jakarta commons-httpclient | 1 | 0 | 22 May 2016 - 04:44 |
MojeekBot | 4+3 | 32.01 KB | 20 May 2016 - 17:35 |
HTTrack off-line browser | 3 | 39.36 KB | 20 May 2016 - 12:20 |
Unknown robot (identified by '*bot') | 2+1 | 15.42 KB | 20 May 2016 - 12:02 |
Alexa (IA Archiver) | 6+6 | 63.93 KB | 20 May 2016 - 10:46 |
Web Core / Roots | 8+2 | 120.40 KB | 19 May 2016 - 00:35 |
Powermarks | 2 | 12.69 KB | 15 May 2016 - 11:38 |
Netcraft | 3 | 15.29 KB | 10 May 2016 - 17:18 |
Sogou Spider | 1+1 | 10.11 KB | 07 May 2016 - 15:28 |
BBot | 2 | 30.57 KB | 04 May 2016 - 12:11 |
Orbiter | 1 | 15.29 KB | 02 May 2016 - 18:08 |