94 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by empty user agent string) | 2469652 | 2133.81 GB | 31 Jan 2011 - 23:59 |
Googlebot | 571383 | 12.05 GB | 31 Jan 2011 - 23:59 |
Yahoo Slurp | 265894 | 14.07 GB | 31 Jan 2011 - 23:59 |
Yandex bot | 168688 | 1.07 GB | 31 Jan 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 163741 | 6.74 GB | 31 Jan 2011 - 23:59 |
Unknown robot (identified by 'spider') | 128912 | 2.63 GB | 31 Jan 2011 - 22:46 |
MSNBot | 106526 | 616.42 MB | 31 Jan 2011 - 23:59 |
Nagios | 84533 | 1.76 GB | 31 Jan 2011 - 23:59 |
Feedfetcher-Google | 29232 | 112.52 MB | 31 Jan 2011 - 23:59 |
NG 1.x (Exalead) | 24653 | 505.93 MB | 31 Jan 2011 - 23:55 |
BaiDuSpider | 21429 | 1.97 GB | 31 Jan 2011 - 23:57 |
Unknown robot (identified by 'crawl') | 14476 | 129.13 MB | 31 Jan 2011 - 23:42 |
BSpider | 14370 | 694.64 MB | 31 Jan 2011 - 23:52 |
VSE | 14116 | 886.99 MB | 31 Jan 2011 - 22:13 |
Unknown robot (identified by 'robot') | 13292 | 190.56 MB | 31 Jan 2011 - 23:50 |
Speedy Spider | 12395 | 65.84 MB | 31 Jan 2011 - 23:53 |
Alexa (IA Archiver) | 8730 | 546.24 MB | 31 Jan 2011 - 23:56 |
CFNetwork | 7327 | 1.30 GB | 31 Jan 2011 - 23:32 |
UniversalFeedParser | 5756 | 33.13 MB | 31 Jan 2011 - 23:50 |
Nutch | 5513 | 401.84 MB | 31 Jan 2011 - 23:51 |
Custo | 5257 | 76.70 MB | 31 Jan 2011 - 23:39 |
Voila | 3752 | 38.29 MB | 31 Jan 2011 - 22:45 |
Exabot | 3211 | 35.91 MB | 31 Jan 2011 - 23:58 |
ichiro | 3210 | 78.31 MB | 31 Jan 2011 - 23:28 |
Python-urllib | 2634 | 128.16 MB | 31 Jan 2011 - 23:30 |
Web Core / Roots | 1933 | 71.00 MB | 31 Jan 2011 - 20:06 |
Motor | 1910 | 9.51 MB | 31 Jan 2011 - 20:39 |
WordPress | 1674 | 61.86 MB | 31 Jan 2011 - 19:20 |
MJ12bot | 1544 | 11.62 MB | 31 Jan 2011 - 21:10 |
DoCoMo | 1482 | 37.35 MB | 31 Jan 2011 - 23:30 |
MagpieRSS | 1421 | 10.06 MB | 31 Jan 2011 - 23:37 |
MSNBot-media | 1378 | 10.36 MB | 31 Jan 2011 - 23:53 |
Ask | 1364 | 23.83 MB | 31 Jan 2011 - 23:33 |
NewsGator Online | 1310 | 11.45 MB | 31 Jan 2011 - 23:41 |
StackRambler | 999 | 5.92 MB | 31 Jan 2011 - 07:12 |
Java (Often spam bot) | 841 | 26.39 MB | 31 Jan 2011 - 23:43 |
Sogou Spider | 837 | 6.87 MB | 31 Jan 2011 - 21:56 |
arks | 798 | 135.21 MB | 30 Jan 2011 - 17:53 |
larbin | 767 | 16.04 MB | 31 Jan 2011 - 13:42 |
archive.org bot | 765 | 56.38 MB | 23 Jan 2011 - 13:39 |
Cursor | 657 | 3.85 MB | 31 Jan 2011 - 03:41 |
Yahoo Feed Seeker | 657 | 6.39 MB | 31 Jan 2011 - 22:41 |
Fish search | 468 | 13.37 MB | 31 Jan 2011 - 17:54 |
Misterbot | 461 | 2.28 MB | 31 Jan 2011 - 18:03 |
Voyager | 457 | 6.10 MB | 31 Jan 2011 - 23:17 |
Y!J Yahoo Japan | 456 | 4.44 MB | 31 Jan 2011 - 17:08 |
The web archive (IA Archiver) | 413 | 915.99 KB | 31 Jan 2011 - 20:36 |
Jakarta commons-httpclient | 354 | 59.65 MB | 31 Jan 2011 - 20:33 |
SeznamBot | 336 | 8.56 MB | 31 Jan 2011 - 11:40 |
GigaBot | 286 | 23.69 MB | 29 Jan 2011 - 00:17 |
Vagabondo | 286 | 5.71 MB | 31 Jan 2011 - 17:01 |
W3C Validator | 257 | 1.62 MB | 31 Jan 2011 - 16:11 |
WWWC Ver 0.2.5 | 251 | 5.81 MB | 31 Jan 2011 - 23:16 |
legs | 237 | 2.14 MB | 26 Jan 2011 - 11:09 |
FeedValidator | 198 | 1.26 MB | 31 Jan 2011 - 16:11 |
MSIECrawler | 188 | 3.12 MB | 31 Jan 2011 - 15:02 |
Patric | 144 | 756.88 KB | 04 Jan 2011 - 18:05 |
HTTrack off-line browser | 131 | 634.70 KB | 28 Jan 2011 - 04:01 |
Powermarks | 129 | 3.50 MB | 31 Jan 2011 - 04:09 |
Heritrix | 120 | 1021.46 KB | 31 Jan 2011 - 20:50 |
LinkChecker | 114 | 899.57 KB | 31 Jan 2011 - 03:35 |
yacy | 72 | 495.86 KB | 30 Jan 2011 - 04:36 |
Google AdSense | 60 | 136.88 MB | 31 Jan 2011 - 10:42 |
VORTEX | 49 | 340.33 KB | 26 Jan 2011 - 00:26 |
Unknown robot (identified by '*bot') | 42 | 1010.48 KB | 31 Jan 2011 - 23:40 |
Holmes | 39 | 292.96 KB | 24 Jan 2011 - 22:21 |
Ingrid | 35 | 207.77 KB | 20 Jan 2011 - 06:40 |
Internet Shinchakubin | 33 | 177.91 KB | 14 Jan 2011 - 13:35 |
Findlinks | 31 | 854.02 KB | 31 Jan 2011 - 06:15 |
NetSprint | 30 | 81.33 KB | 30 Jan 2011 - 10:23 |
Feedburner | 29 | 1.90 MB | 31 Jan 2011 - 15:05 |
YahooSeeker Yahoo! Blog crawler | 27 | 41.95 KB | 30 Jan 2011 - 10:34 |
JoBo Java Web Robot | 23 | 276.98 KB | 26 Jan 2011 - 13:18 |
Susie | 16 | 658.07 KB | 31 Jan 2011 - 07:51 |
OutfoxBot/YodaoBot | 14 | 44.28 KB | 29 Jan 2011 - 13:57 |
Sunrise | 13 | 94.41 KB | 12 Jan 2011 - 21:40 |
Mail.ru bot | 12 | 180.56 KB | 28 Jan 2011 - 12:58 |
Netcraft | 12 | 215.35 KB | 30 Jan 2011 - 23:09 |
W3C Link Checker | 12 | 49.75 KB | 26 Jan 2011 - 19:33 |
NutchCVS | 9 | 136.19 KB | 25 Jan 2011 - 14:09 |
Monster | 6 | 122.77 KB | 14 Jan 2011 - 16:39 |
Emacs-w3 Search Engine | 6 | 21.08 KB | 14 Jan 2011 - 14:35 |
EasyDL | 5 | 136.47 KB | 28 Jan 2011 - 16:47 |
bender focused_crawler | 3 | 23.67 KB | 22 Jan 2011 - 15:55 |
FavOrg | 2 | 50.81 KB | 29 Jan 2011 - 02:58 |
QihooBot | 2 | 8.49 KB | 21 Jan 2011 - 23:19 |
Atomz.com Search Robot | 2 | 3.11 KB | 19 Jan 2011 - 10:19 |
lwp-trivial | 2 | 5.17 KB | 09 Jan 2011 - 04:05 |
WebCollage | 1 | 6.29 KB | 11 Jan 2011 - 16:49 |
Pioneer | 1 | 11.60 KB | 07 Jan 2011 - 01:01 |
lwp-request | 1 | 0 | 08 Jan 2011 - 01:45 |
WallPaper (alias crawlpaper) | 1 | 73.77 KB | 19 Jan 2011 - 20:59 |
Girafabot | 1 | 28.26 KB | 09 Jan 2011 - 04:05 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 1.55 KB | 16 Jan 2011 - 06:33 |