| 95 different robots | Hits | Bandwidth | Last visit |
|---|
| Yandex bot | 699002+8 | 14.31 GB | 31 Oct 2013 - 23:57 |
| Unknown robot (identified by '*bot') | 131887+2 | 1.31 GB | 31 Oct 2013 - 23:40 |
| Unknown robot (identified by 'bot*') | 83173+1039 | 1.69 GB | 31 Oct 2013 - 23:59 |
| Googlebot | 33264+34 | 701.73 MB | 31 Oct 2013 - 23:57 |
| Unknown robot (identified by 'robot') | 32488+12 | 716.63 MB | 31 Oct 2013 - 23:50 |
| HTTrack off-line browser | 18389 | 367.75 MB | 31 Oct 2013 - 21:54 |
| Nagios | 14733 | 145.35 MB | 31 Oct 2013 - 23:57 |
| NG 2.x (Exalead) | 11160 | 9.82 MB | 31 Oct 2013 - 23:50 |
| Unknown robot (identified by empty user agent string) | 8022+2 | 107.57 MB | 31 Oct 2013 - 23:52 |
| BaiDuSpider | 7412+8 | 128.28 MB | 31 Oct 2013 - 23:57 |
| Java (Often spam bot) | 6947+2 | 93.64 MB | 31 Oct 2013 - 23:51 |
| Unknown robot (identified by 'crawl') | 4030+98 | 65.55 MB | 31 Oct 2013 - 21:07 |
| MJ12bot | 3104+2 | 39.93 MB | 31 Oct 2013 - 23:31 |
| MSNBot | 3066 | 60.73 MB | 31 Oct 2013 - 23:23 |
| Feedfetcher-Google | 2584 | 34.88 MB | 31 Oct 2013 - 23:43 |
| Unknown robot (identified by 'spider') | 2467+33 | 39.90 MB | 31 Oct 2013 - 23:07 |
| WebFilter | 2263+5 | 30.29 MB | 31 Oct 2013 - 23:17 |
| DoCoMo | 2026+1 | 29.86 MB | 31 Oct 2013 - 11:21 |
| WordPress | 1949 | 22.54 MB | 31 Oct 2013 - 21:33 |
| MSNBot-media | 1561+34 | 58.61 MB | 31 Oct 2013 - 23:30 |
| CFNetwork | 1360 | 16.20 MB | 31 Oct 2013 - 23:43 |
| Mail.ru bot | 1246+1 | 25.45 MB | 31 Oct 2013 - 23:34 |
| Exabot | 1032 | 15.54 MB | 31 Oct 2013 - 23:37 |
| Feedburner | 949 | 14.41 MB | 31 Oct 2013 - 23:43 |
| Nutch | 866+2 | 8.66 MB | 31 Oct 2013 - 23:53 |
| SeznamBot | 865 | 14.79 MB | 31 Oct 2013 - 17:58 |
| Yahoo Slurp | 670+2 | 11.03 MB | 31 Oct 2013 - 23:54 |
| LinkChecker | 486+2 | 4.80 MB | 31 Oct 2013 - 23:25 |
| Sogou Spider | 484 | 9.85 MB | 31 Oct 2013 - 23:39 |
| MagpieRSS | 460 | 6.64 MB | 31 Oct 2013 - 22:34 |
| WWWC Ver 0.2.5 | 453 | 4.50 MB | 31 Oct 2013 - 23:35 |
| Turn It In | 423+1 | 6.19 MB | 25 Oct 2013 - 16:16 |
| NG 1.x (Exalead) | 395 | 6.44 MB | 31 Oct 2013 - 19:51 |
| legs | 342 | 4.45 MB | 28 Oct 2013 - 07:09 |
| Python-urllib | 332 | 4.89 MB | 31 Oct 2013 - 20:01 |
| Motor | 288 | 5.91 MB | 31 Oct 2013 - 23:35 |
| Jakarta commons-httpclient | 204 | 2.04 MB | 31 Oct 2013 - 11:46 |
| Voila | 171 | 2.61 MB | 31 Oct 2013 - 12:37 |
| UniversalFeedParser | 162 | 3.33 MB | 31 Oct 2013 - 22:30 |
| ichiro | 140 | 2.88 MB | 26 Oct 2013 - 04:37 |
| Unknown robot (identified by hit on 'robots.txt') | 0+133 | 6.23 KB | 31 Oct 2013 - 19:02 |
| Powermarks | 129 | 1.30 MB | 31 Oct 2013 - 07:52 |
| yacy | 107 | 1.17 MB | 29 Oct 2013 - 17:11 |
| StackRambler | 97 | 1.93 MB | 31 Oct 2013 - 18:50 |
| archive.org bot | 75+1 | 1.17 MB | 30 Oct 2013 - 20:49 |
| W3C Validator | 71 | 969.88 KB | 30 Oct 2013 - 14:58 |
| Y!J Yahoo Japan | 46+22 | 766.46 KB | 31 Oct 2013 - 20:46 |
| ABCdatos BotLink | 62 | 1.40 MB | 31 Oct 2013 - 02:53 |
| OutfoxBot/YodaoBot | 62 | 626.36 KB | 31 Oct 2013 - 10:22 |
| Alexa (IA Archiver) | 56+1 | 1.01 MB | 31 Oct 2013 - 05:55 |
| Web Core / Roots | 56 | 1.03 MB | 31 Oct 2013 - 21:32 |
| MojeekBot | 49 | 868.70 KB | 30 Oct 2013 - 22:21 |
| GigaBot | 43 | 588.74 KB | 31 Oct 2013 - 22:30 |
| lwp-trivial | 39 | 412.32 KB | 29 Oct 2013 - 04:32 |
| W3C Link Checker | 37 | 397.11 KB | 30 Oct 2013 - 09:36 |
| Google AdSense | 34 | 426.47 KB | 31 Oct 2013 - 16:28 |
| LinkScan | 33 | 396.50 KB | 31 Oct 2013 - 06:25 |
| Phantom | 30 | 325.81 KB | 30 Oct 2013 - 01:21 |
| VSE | 25 | 297.19 KB | 28 Oct 2013 - 07:21 |
| Heritrix | 15 | 155.82 KB | 30 Oct 2013 - 18:31 |
| Raven Search | 15 | 191.97 KB | 27 Oct 2013 - 00:57 |
| TITAN | 13 | 2.99 MB | 24 Oct 2013 - 16:17 |
| psbot | 10 | 168.49 KB | 23 Oct 2013 - 12:38 |
| Fish search | 9 | 100.49 KB | 30 Oct 2013 - 16:42 |
| Vagabondo | 9 | 168.29 KB | 27 Oct 2013 - 01:16 |
| FeedValidator | 9 | 102.54 KB | 21 Oct 2013 - 06:26 |
| larbin | 9 | 102.82 KB | 14 Oct 2013 - 17:16 |
| BSpider | 8 | 81.74 KB | 16 Oct 2013 - 09:27 |
| NewsGator Online | 7 | 147.43 KB | 30 Oct 2013 - 01:54 |
| LinkBot | 7 | 81.75 KB | 26 Oct 2013 - 06:35 |
| LiveJournal.com | 7 | 147.43 KB | 31 Oct 2013 - 05:11 |
| Netcraft | 5 | 42.68 KB | 11 Oct 2013 - 17:26 |
| Aport | 5 | 55.62 KB | 17 Oct 2013 - 20:06 |
| lwp-request | 4 | 40.41 KB | 04 Oct 2013 - 09:42 |
| SurveyBot | 3 | 30.31 KB | 28 Oct 2013 - 03:37 |
| BBot | 3 | 30.31 KB | 30 Oct 2013 - 21:00 |
| T-H-U-N-D-E-R-S-T-O-N-E | 3 | 30.31 KB | 26 Oct 2013 - 21:20 |
| Sunrise | 3 | 34.38 KB | 13 Oct 2013 - 13:10 |
| GetURL | 2 | 21.01 KB | 27 Oct 2013 - 07:28 |
| SuperBot | 2 | 20.21 KB | 22 Oct 2013 - 13:47 |
| HTMLParser | 2 | 11.57 KB | 15 Oct 2013 - 22:20 |
| Monster | 2 | 40.46 KB | 24 Oct 2013 - 06:26 |
| Custo | 1 | 10.10 KB | 30 Oct 2013 - 23:06 |
| Ingrid | 1 | 10.87 KB | 10 Oct 2013 - 10:02 |
| FavOrg | 1 | 10.10 KB | 11 Oct 2013 - 00:01 |
| SpiderBot | 1 | 10.10 KB | 27 Oct 2013 - 01:01 |
| ComputingSite Robi/1.0 | 1 | 10.10 KB | 19 Oct 2013 - 01:53 |
| WebCollage | 1 | 2.27 KB | 11 Oct 2013 - 12:09 |
| Pioneer | 1 | 56.16 KB | 19 Oct 2013 - 12:28 |
| Ask | 1 | 10.91 KB | 01 Oct 2013 - 00:37 |
| ZhuaXia | 1 | 21.06 KB | 14 Oct 2013 - 11:24 |
| XYLEME Robot | 1 | 10.10 KB | 24 Oct 2013 - 05:00 |
| Sven | 1 | 846.12 KB | 03 Oct 2013 - 13:22 |
| WallPaper (alias crawlpaper) | 1 | 1.52 MB | 20 Oct 2013 - 21:12 |
| ExactSeek Crawler | 1 | 10.10 KB | 21 Oct 2013 - 08:14 |
| Others | 0 | 0 | |