93 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by empty user agent string) | 1306880 | 1593.20 GB | 30 Jun 2011 - 23:59 |
Googlebot | 575403 | 13.28 GB | 30 Jun 2011 - 23:59 |
Yahoo Slurp | 179671 | 9.29 GB | 30 Jun 2011 - 23:59 |
Yandex bot | 114765 | 802.29 MB | 30 Jun 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 109730 | 4.80 GB | 30 Jun 2011 - 23:59 |
MSNBot | 52332 | 489.66 MB | 30 Jun 2011 - 23:57 |
Nagios | 27585 | 619.71 MB | 30 Jun 2011 - 23:59 |
Feedfetcher-Google | 24547 | 126.86 MB | 30 Jun 2011 - 23:55 |
Unknown robot (identified by 'robot') | 22749 | 619.99 MB | 30 Jun 2011 - 23:55 |
NG 1.x (Exalead) | 11293 | 163.72 MB | 30 Jun 2011 - 23:51 |
HTTrack off-line browser | 10134 | 175.51 MB | 28 Jun 2011 - 20:59 |
Sogou Spider | 8899 | 32.84 MB | 30 Jun 2011 - 23:57 |
Speedy Spider | 7023 | 35.67 MB | 30 Jun 2011 - 23:59 |
MJ12bot | 6562 | 112.23 MB | 30 Jun 2011 - 22:56 |
VSE | 5863 | 53.43 MB | 30 Jun 2011 - 11:43 |
BaiDuSpider | 5853 | 152.64 MB | 30 Jun 2011 - 23:59 |
BSpider | 5602 | 46.22 MB | 30 Jun 2011 - 23:52 |
Unknown robot (identified by '*bot') | 4971 | 78.26 MB | 30 Jun 2011 - 23:59 |
Alexa (IA Archiver) | 4749 | 232.05 MB | 30 Jun 2011 - 23:59 |
UniversalFeedParser | 3260 | 11.06 MB | 30 Jun 2011 - 23:50 |
CFNetwork | 3162 | 383.24 MB | 30 Jun 2011 - 23:08 |
Voila | 2323 | 146.65 MB | 30 Jun 2011 - 23:54 |
Nutch | 1982 | 69.99 MB | 30 Jun 2011 - 23:15 |
Web Core / Roots | 1967 | 23.59 MB | 29 Jun 2011 - 22:57 |
Custo | 1258 | 10.60 MB | 30 Jun 2011 - 23:44 |
Python-urllib | 1252 | 35.19 MB | 30 Jun 2011 - 22:00 |
Unknown robot (identified by 'spider') | 1179 | 7.82 MB | 30 Jun 2011 - 23:58 |
Unknown robot (identified by 'crawl') | 1175 | 10.63 MB | 30 Jun 2011 - 23:27 |
Exabot | 1151 | 5.47 MB | 30 Jun 2011 - 22:27 |
Java (Often spam bot) | 1094 | 26.59 MB | 30 Jun 2011 - 22:48 |
Motor | 989 | 6.05 MB | 30 Jun 2011 - 11:07 |
MagpieRSS | 597 | 2.47 MB | 30 Jun 2011 - 22:03 |
Ask | 556 | 9.58 MB | 30 Jun 2011 - 09:37 |
Y!J Yahoo Japan | 433 | 9.48 MB | 30 Jun 2011 - 14:52 |
legs | 429 | 3.59 MB | 30 Jun 2011 - 04:49 |
Jakarta commons-httpclient | 425 | 3.51 MB | 28 Jun 2011 - 12:44 |
WordPress | 403 | 14.50 MB | 30 Jun 2011 - 21:11 |
Yahoo Feed Seeker | 400 | 3.22 MB | 30 Jun 2011 - 22:41 |
StackRambler | 384 | 1.91 MB | 23 Jun 2011 - 10:25 |
MSNBot-media | 300 | 955.73 KB | 30 Jun 2011 - 21:17 |
DoCoMo | 259 | 6.62 MB | 30 Jun 2011 - 14:46 |
VORTEX | 204 | 450.48 KB | 20 Jun 2011 - 00:49 |
Google AdSense | 199 | 279.43 MB | 30 Jun 2011 - 17:28 |
The World Wide Web Worm | 187 | 1.45 MB | 15 Jun 2011 - 00:25 |
ComputingSite Robi/1.0 | 179 | 1.35 MB | 13 Jun 2011 - 10:05 |
Turn It In | 169 | 59.43 MB | 21 Jun 2011 - 07:14 |
OutfoxBot/YodaoBot | 161 | 693.06 KB | 30 Jun 2011 - 21:12 |
Fish search | 161 | 6.09 MB | 28 Jun 2011 - 21:33 |
WallPaper (alias crawlpaper) | 155 | 649.96 KB | 14 Jun 2011 - 19:40 |
NewsGator Online | 128 | 451.73 KB | 30 Jun 2011 - 21:36 |
WWWC Ver 0.2.5 | 114 | 4.54 MB | 30 Jun 2011 - 23:16 |
LinkChecker | 109 | 918.02 KB | 25 Jun 2011 - 02:14 |
Scooter | 79 | 188.73 KB | 24 Jun 2011 - 16:28 |
W3C Validator | 59 | 332.82 KB | 29 Jun 2011 - 07:41 |
yacy | 55 | 316.02 KB | 30 Jun 2011 - 22:23 |
Powermarks | 51 | 1.51 MB | 30 Jun 2011 - 20:29 |
MSIECrawler | 50 | 88.74 KB | 30 Jun 2011 - 14:34 |
psbot | 44 | 627.52 KB | 22 Jun 2011 - 19:03 |
larbin | 43 | 874.56 KB | 30 Jun 2011 - 20:32 |
Findlinks | 36 | 364.30 KB | 29 Jun 2011 - 01:05 |
Mail.ru bot | 35 | 872.45 KB | 29 Jun 2011 - 12:24 |
Ingrid | 31 | 54.84 KB | 24 Jun 2011 - 12:05 |
Muncher | 29 | 664.68 KB | 09 Jun 2011 - 03:45 |
Heritrix | 22 | 278.40 KB | 30 Jun 2011 - 23:43 |
Netcraft | 17 | 322.90 KB | 30 Jun 2011 - 12:11 |
NetSprint | 16 | 37.87 KB | 30 Jun 2011 - 23:21 |
GigaBot | 14 | 168.73 KB | 29 Jun 2011 - 16:07 |
Vagabondo | 13 | 259.28 KB | 24 Jun 2011 - 06:46 |
YahooSeeker Yahoo! Blog crawler | 13 | 19.96 KB | 26 Jun 2011 - 10:22 |
Holmes | 11 | 103.67 KB | 25 Jun 2011 - 11:35 |
InternetSeer | 11 | 502.50 KB | 29 Jun 2011 - 04:04 |
arks | 11 | 102.46 KB | 28 Jun 2011 - 16:23 |
bender focused_crawler | 9 | 9.61 KB | 28 Jun 2011 - 08:34 |
Feedburner | 9 | 512.85 KB | 23 Jun 2011 - 09:27 |
ichiro | 9 | 83.16 KB | 25 Jun 2011 - 09:00 |
Emacs-w3 Search Engine | 9 | 1.05 MB | 11 Jun 2011 - 14:41 |
FavOrg | 5 | 139.23 KB | 24 Jun 2011 - 01:02 |
ASpider (Associative Spider) | 4 | 12.78 KB | 28 Jun 2011 - 09:53 |
SeznamBot | 3 | 10.32 KB | 17 Jun 2011 - 10:36 |
Susie | 3 | 221.14 KB | 17 Jun 2011 - 11:39 |
HTMLParser | 3 | 18.33 KB | 20 Jun 2011 - 00:52 |
W3C Link Checker | 2 | 6.39 KB | 03 Jun 2011 - 20:50 |
Arale | 2 | 155.73 KB | 11 Jun 2011 - 11:52 |
TailRank | 1 | 27.61 KB | 02 Jun 2011 - 00:04 |
ChristCrawler.com | 1 | 5.16 KB | 06 Jun 2011 - 02:33 |
Spiderman | 1 | 1.55 KB | 04 Jun 2011 - 11:18 |
BBot | 1 | 1.22 KB | 02 Jun 2011 - 14:20 |
Atomz.com Search Robot | 1 | 1.55 KB | 16 Jun 2011 - 11:23 |
FeedValidator | 1 | 4.69 KB | 27 Jun 2011 - 22:08 |
gazz | 1 | 3.85 KB | 06 Jun 2011 - 02:40 |
Bookmark-Manager | 1 | 25.40 KB | 20 Jun 2011 - 10:13 |
Voyager | 1 | 17.43 KB | 12 Jun 2011 - 10:08 |
RoJo aggregator | 1 | 18.49 KB | 11 Jun 2011 - 19:35 |