50 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 20717 | 61.42 GB | 30 Sep 2009 - 23:59 |
CFNetwork | 18604 | 277.47 GB | 30 Sep 2009 - 23:52 |
MSNBot | 5855 | 7.20 GB | 30 Sep 2009 - 23:52 |
Googlebot | 5221 | 4.01 GB | 30 Sep 2009 - 23:57 |
Unknown robot (identified by empty user agent string) | 1040 | 22.36 GB | 30 Sep 2009 - 22:33 |
Unknown robot (identified by 'crawl') | 883 | 1.40 GB | 30 Sep 2009 - 21:09 |
Yandex bot | 771 | 5.27 GB | 30 Sep 2009 - 07:25 |
Unknown robot (identified by 'robot') | 510 | 29.19 KB | 30 Sep 2009 - 19:41 |
Exabot | 501 | 2.11 GB | 29 Sep 2009 - 04:14 |
VSE | 474 | 12.47 GB | 30 Sep 2009 - 18:27 |
Feedfetcher-Google | 447 | 6.32 GB | 30 Sep 2009 - 22:39 |
BaiDuSpider | 273 | 4.51 GB | 30 Sep 2009 - 15:53 |
twiceler | 239 | 223.91 MB | 22 Sep 2009 - 10:25 |
HTTrack off-line browser | 147 | 142.53 MB | 23 Sep 2009 - 18:20 |
larbin | 145 | 1.19 GB | 30 Sep 2009 - 11:25 |
Google AdSense | 120 | 2.22 GB | 30 Sep 2009 - 20:41 |
Unknown robot (identified by 'bot*') | 102 | 552.60 MB | 29 Sep 2009 - 20:10 |
WordPress | 100 | 367.23 MB | 30 Sep 2009 - 08:56 |
Custo | 97 | 1.98 GB | 30 Sep 2009 - 01:10 |
WWWC Ver 0.2.5 | 95 | 0 | 30 Sep 2009 - 10:33 |
ABCdatos BotLink | 90 | 1.57 GB | 30 Sep 2009 - 02:35 |
Web Core / Roots | 74 | 0 | 30 Sep 2009 - 23:05 |
BSpider | 64 | 1.21 GB | 30 Sep 2009 - 23:20 |
MJ12bot | 60 | 827.12 MB | 20 Sep 2009 - 16:50 |
Ask | 56 | 103.11 MB | 29 Sep 2009 - 06:08 |
Python-urllib | 52 | 586.40 MB | 30 Sep 2009 - 22:24 |
Java (Often spam bot) | 46 | 663.43 MB | 26 Sep 2009 - 02:59 |
Nutch | 43 | 364.44 MB | 25 Sep 2009 - 10:08 |
Voila | 42 | 198.37 MB | 30 Sep 2009 - 18:35 |
Jakarta commons-httpclient | 24 | 366.64 MB | 30 Sep 2009 - 22:57 |
WallPaper (alias crawlpaper) | 22 | 627.01 MB | 29 Sep 2009 - 07:49 |
yacy | 17 | 108.39 KB | 29 Sep 2009 - 09:10 |
Speedy Spider | 17 | 69.81 KB | 29 Sep 2009 - 14:15 |
Unknown robot (identified by 'spider') | 16 | 45.99 MB | 25 Sep 2009 - 23:22 |
Heritrix | 14 | 144.76 MB | 03 Sep 2009 - 03:40 |
Alexa (IA Archiver) | 6 | 27.28 KB | 30 Sep 2009 - 08:35 |
Ocelli | 6 | 19.23 KB | 16 Sep 2009 - 17:07 |
Sunrise | 5 | 76.38 MB | 24 Sep 2009 - 11:11 |
Ingrid | 4 | 114.00 MB | 17 Sep 2009 - 07:42 |
Motor | 3 | 59.05 MB | 09 Sep 2009 - 00:54 |
arks | 3 | 28.50 MB | 28 Sep 2009 - 13:55 |
legs | 3 | 66.47 MB | 18 Sep 2009 - 21:19 |
Unknown robot (identified by '*bot') | 2 | 19.92 KB | 13 Sep 2009 - 14:55 |
Cursor | 2 | 57.00 MB | 25 Sep 2009 - 03:57 |
Y!J Yahoo Japan | 2 | 0 | 27 Sep 2009 - 06:46 |
Internet Shinchakubin | 2 | 57.00 MB | 18 Sep 2009 - 15:41 |
The Jubii Indexing Robot | 2 | 57.00 MB | 20 Sep 2009 - 16:11 |
Feedburner | 1 | 0 | 07 Sep 2009 - 02:02 |
Sogou Spider | 1 | 28.50 MB | 24 Sep 2009 - 08:19 |
The World Wide Web Worm | 1 | 28.50 MB | 07 Sep 2009 - 04:48 |