50 different robots | Hits | Bandwidth | Last visit |
CFNetwork | 8104 | 149.51 GB | 31 Mar 2010 - 23:58 |
Unknown robot (identified by empty user agent string) | 5071 | 10.60 GB | 31 Mar 2010 - 23:56 |
Yahoo Slurp | 4850 | 19.91 GB | 31 Mar 2010 - 23:35 |
MSNBot | 3830 | 16.87 GB | 31 Mar 2010 - 22:38 |
Python-urllib | 2602 | 2.38 GB | 31 Mar 2010 - 17:36 |
legs | 1807 | 16.26 GB | 31 Mar 2010 - 22:53 |
Googlebot | 1764 | 359.45 MB | 31 Mar 2010 - 23:23 |
Speedy Spider | 478 | 458.67 MB | 31 Mar 2010 - 23:27 |
Unknown robot (identified by 'robot') | 421 | 2.32 GB | 31 Mar 2010 - 22:22 |
Yandex bot | 393 | 890.92 MB | 31 Mar 2010 - 11:30 |
VSE | 382 | 118.59 MB | 31 Mar 2010 - 17:10 |
Unknown robot (identified by 'crawl') | 301 | 221.10 MB | 31 Mar 2010 - 07:29 |
twiceler | 171 | 21.71 MB | 31 Mar 2010 - 22:55 |
WordPress | 135 | 197.96 MB | 31 Mar 2010 - 18:03 |
Feedfetcher-Google | 98 | 18.56 MB | 31 Mar 2010 - 20:55 |
larbin | 97 | 738.32 MB | 31 Mar 2010 - 10:41 |
BaiDuSpider | 96 | 560.69 MB | 31 Mar 2010 - 22:20 |
ABCdatos BotLink | 93 | 906.75 MB | 31 Mar 2010 - 02:37 |
MSNBot-media | 90 | 762.05 MB | 30 Mar 2010 - 17:59 |
Unknown robot (identified by 'bot*') | 87 | 417.58 MB | 30 Mar 2010 - 03:48 |
Heritrix | 70 | 730.28 MB | 29 Mar 2010 - 03:03 |
WWWC Ver 0.2.5 | 69 | 0 | 30 Mar 2010 - 17:39 |
Web Core / Roots | 55 | 79.88 MB | 30 Mar 2010 - 19:23 |
Java (Often spam bot) | 45 | 561.23 MB | 29 Mar 2010 - 14:05 |
Tarantula | 40 | 275.76 MB | 20 Mar 2010 - 00:52 |
Custo | 38 | 7.26 MB | 30 Mar 2010 - 20:33 |
Google AdSense | 37 | 260.96 MB | 31 Mar 2010 - 18:33 |
Voila | 36 | 55.87 MB | 31 Mar 2010 - 22:04 |
BSpider | 36 | 656.30 MB | 30 Mar 2010 - 17:58 |
Unknown robot (identified by 'spider') | 34 | 301.86 MB | 31 Mar 2010 - 08:42 |
NG 1.x (Exalead) | 18 | 134.15 MB | 30 Mar 2010 - 12:12 |
Sunrise | 18 | 147.25 MB | 30 Mar 2010 - 08:06 |
arks | 15 | 151.71 MB | 31 Mar 2010 - 21:13 |
HTTrack off-line browser | 15 | 104.33 MB | 31 Mar 2010 - 13:22 |
yacy | 14 | 126.23 KB | 30 Mar 2010 - 09:34 |
Jakarta commons-httpclient | 9 | 55.86 MB | 31 Mar 2010 - 12:33 |
Feedburner | 7 | 0 | 26 Mar 2010 - 10:03 |
Exabot | 6 | 71.52 MB | 27 Mar 2010 - 09:36 |
MSIECrawler | 6 | 62.75 KB | 30 Mar 2010 - 04:35 |
Motor | 5 | 80.32 MB | 28 Mar 2010 - 17:53 |
Ask | 5 | 314.83 KB | 28 Mar 2010 - 14:17 |
Alexa (IA Archiver) | 4 | 29.68 KB | 30 Mar 2010 - 06:36 |
SuperBot | 3 | 20.51 MB | 10 Mar 2010 - 06:20 |
Turn It In | 3 | 9.96 KB | 21 Mar 2010 - 00:42 |
MJ12bot | 3 | 9.82 MB | 19 Mar 2010 - 18:56 |
WallPaper (alias crawlpaper) | 2 | 897.64 KB | 28 Mar 2010 - 19:05 |
Cursor | 2 | 558.78 KB | 02 Mar 2010 - 16:29 |
Patric | 1 | 448.82 KB | 29 Mar 2010 - 22:27 |
Nutch | 1 | 6.69 KB | 22 Mar 2010 - 11:19 |
Y!J Yahoo Japan | 1 | 9.28 MB | 12 Mar 2010 - 14:17 |