68 different robots | Hits | Bandwidth | Last visit |
Yandex bot | 11868+70 | 315.20 MB | 31 Jul 2013 - 23:59 |
Googlebot | 200665+159 | 9.69 GB | 31 Jul 2013 - 23:59 |
Unknown robot (identified by 'crawl') | 89795+1205 | 3.97 GB | 31 Jul 2013 - 23:58 |
Unknown robot (identified by 'bot*') | 197013+945 | 11.69 GB | 31 Jul 2013 - 23:57 |
MSNBot-media | 11873+8463 | 337.41 MB | 31 Jul 2013 - 23:56 |
Unknown robot (identified by 'robot') | 72628+700 | 3.57 GB | 31 Jul 2013 - 23:55 |
BaiDuSpider | 5546+45 | 245.57 MB | 31 Jul 2013 - 23:55 |
MagpieRSS | 48373+195 | 2.32 GB | 31 Jul 2013 - 23:51 |
Unknown robot (identified by '*bot') | 1367+687 | 66.74 MB | 31 Jul 2013 - 23:50 |
Jakarta commons-httpclient | 281 | 9.86 MB | 31 Jul 2013 - 23:49 |
Java (Often spam bot) | 6894+289 | 280.46 MB | 31 Jul 2013 - 23:49 |
CFNetwork | 1147 | 68.94 MB | 31 Jul 2013 - 23:47 |
Unknown robot (identified by hit on 'robots.txt') | 0+588 | 184.01 KB | 31 Jul 2013 - 23:42 |
Unknown robot (identified by empty user agent string) | 2958+4 | 117.78 MB | 31 Jul 2013 - 23:40 |
Unknown robot (identified by 'spider') | 13102+123 | 745.16 MB | 31 Jul 2013 - 23:36 |
Python-urllib | 383+28 | 24.45 MB | 31 Jul 2013 - 23:32 |
DoCoMo | 196+29 | 8.66 MB | 31 Jul 2013 - 23:12 |
MJ12bot | 14642+1302 | 640.32 MB | 31 Jul 2013 - 23:01 |
ichiro | 1169+38 | 29.02 MB | 31 Jul 2013 - 22:57 |
LinkScan | 36 | 1.46 MB | 31 Jul 2013 - 22:35 |
Sogou Spider | 162+41 | 5.72 MB | 31 Jul 2013 - 22:02 |
Google AdSense | 18 | 924.59 KB | 31 Jul 2013 - 21:52 |
Nutch | 127+64 | 7.57 MB | 31 Jul 2013 - 21:44 |
WordPress | 519 | 19.22 MB | 31 Jul 2013 - 19:55 |
VORTEX | 1 | 6.64 KB | 31 Jul 2013 - 19:00 |
SeznamBot | 2631+18 | 157.84 MB | 31 Jul 2013 - 18:57 |
WebFilter | 3301+57 | 164.46 MB | 31 Jul 2013 - 18:29 |
Motor | 148 | 2.96 MB | 31 Jul 2013 - 17:51 |
Exabot | 57+53 | 2.51 MB | 31 Jul 2013 - 17:33 |
XYLEME Robot | 10 | 178.53 KB | 31 Jul 2013 - 17:16 |
BSpider | 1720+3 | 120.48 MB | 31 Jul 2013 - 17:03 |
WallPaper (alias crawlpaper) | 12 | 1.52 MB | 31 Jul 2013 - 16:48 |
TITAN | 58 | 1.51 MB | 31 Jul 2013 - 13:09 |
Heritrix | 125+3 | 2.73 MB | 31 Jul 2013 - 11:50 |
Mail.ru bot | 758+2 | 68.55 MB | 31 Jul 2013 - 11:03 |
Alexa (IA Archiver) | 310+81 | 16.73 MB | 31 Jul 2013 - 10:03 |
WebCollage | 14 | 510.53 KB | 31 Jul 2013 - 01:56 |
Feedfetcher-Google | 54 | 1.93 MB | 30 Jul 2013 - 17:31 |
Fish search | 16 | 360.74 KB | 30 Jul 2013 - 13:34 |
psbot | 6+4 | 122.60 KB | 30 Jul 2013 - 13:21 |
Findlinks | 3+3 | 100.69 KB | 30 Jul 2013 - 11:03 |
archive.org bot | 279+16 | 11.05 MB | 30 Jul 2013 - 05:20 |
Y!J Yahoo Japan | 1+1 | 18.26 KB | 30 Jul 2013 - 01:08 |
W3C Link Checker | 5+5 | 1.57 KB | 29 Jul 2013 - 15:43 |
Steeler | 35+5 | 2.13 MB | 29 Jul 2013 - 07:15 |
yacy | 4+9 | 135.05 KB | 29 Jul 2013 - 03:36 |
Phantom | 7685 | 119.97 MB | 28 Jul 2013 - 18:56 |
LinkChecker | 5+6 | 85.76 KB | 28 Jul 2013 - 05:30 |
NG 1.x (Exalead) | 27 | 1.40 MB | 27 Jul 2013 - 19:48 |
MSNBot | 60+2 | 4.03 MB | 27 Jul 2013 - 18:22 |
Yahoo Slurp | 2488+13 | 52.91 MB | 27 Jul 2013 - 18:11 |
arks | 2 | 0 | 27 Jul 2013 - 06:45 |
MSIECrawler | 6 | 241.77 KB | 26 Jul 2013 - 12:03 |
SurveyBot | 12+3 | 400.81 KB | 26 Jul 2013 - 08:59 |
legs | 1+2 | 34.05 KB | 24 Jul 2013 - 18:09 |
Web Core / Roots | 66 | 1.31 MB | 23 Jul 2013 - 17:18 |
NG 2.x (Exalead) | 1 | 68.52 KB | 22 Jul 2013 - 09:45 |
Raven Search | 1 | 0 | 19 Jul 2013 - 11:14 |
larbin | 79+6 | 2.60 MB | 19 Jul 2013 - 00:32 |
VSE | 1+1 | 33.75 KB | 18 Jul 2013 - 19:19 |
Custo | 2+1 | 64.28 KB | 13 Jul 2013 - 21:14 |
Pioneer | 2 | 26.28 KB | 12 Jul 2013 - 01:45 |
StackRambler | 20 | 416.71 KB | 10 Jul 2013 - 16:55 |
Voila | 0+1 | 321 Bytes | 10 Jul 2013 - 13:39 |
Netcraft | 5 | 134.58 KB | 08 Jul 2013 - 17:10 |
OutfoxBot/YodaoBot | 49 | 1.61 MB | 08 Jul 2013 - 06:49 |
the World Wide Web Wanderer | 20 | 294.20 KB | 06 Jul 2013 - 14:57 |
LinkBot | 1 | 62.33 KB | 04 Jul 2013 - 14:02 |