30 different robots | Hits | Bandwidth | Last visit |
Python-urllib | 35148 | 55.12 GB | 30 Nov 2014 - 22:10 |
Unknown robot (identified by 'robot') | 3199 | 21.57 GB | 30 Nov 2014 - 22:02 |
Unknown robot (identified by 'crawl') | 226 | 38.57 MB | 30 Nov 2014 - 21:40 |
Googlebot | 2760 | 641.26 MB | 30 Nov 2014 - 21:21 |
Java (Often spam bot) | 216687 | 28.00 GB | 30 Nov 2014 - 21:01 |
Yandex bot | 526 | 98.79 MB | 30 Nov 2014 - 20:59 |
Yahoo Slurp | 800 | 7.20 GB | 30 Nov 2014 - 20:42 |
BaiDuSpider | 521 | 4.68 GB | 30 Nov 2014 - 20:36 |
Unknown robot (identified by 'bot*') | 561 | 199.45 MB | 30 Nov 2014 - 20:19 |
Unknown robot (identified by empty user agent string) | 706 | 3.68 GB | 30 Nov 2014 - 18:28 |
arks | 2 | 17.48 MB | 30 Nov 2014 - 15:09 |
Exabot | 140 | 1.71 MB | 30 Nov 2014 - 10:56 |
Alexa (IA Archiver) | 4 | 2.91 MB | 29 Nov 2014 - 19:19 |
Voila | 25 | 118.65 KB | 29 Nov 2014 - 17:48 |
archive.org bot | 3 | 26.22 MB | 29 Nov 2014 - 10:18 |
MJ12bot | 42 | 9.59 MB | 28 Nov 2014 - 15:50 |
Unknown robot (identified by 'spider') | 45 | 3.97 GB | 28 Nov 2014 - 00:50 |
Mail.ru bot | 12 | 62.21 KB | 23 Nov 2014 - 04:52 |
Turn It In | 1 | 6.48 KB | 21 Nov 2014 - 17:25 |
SeznamBot | 4 | 6.41 MB | 21 Nov 2014 - 09:52 |
HTTrack off-line browser | 1 | 8.74 MB | 20 Nov 2014 - 15:15 |
Web Core / Roots | 1 | 1.45 MB | 19 Nov 2014 - 16:17 |
MSIECrawler | 1 | 8.74 MB | 17 Nov 2014 - 12:15 |
CFNetwork | 5 | 32.19 MB | 15 Nov 2014 - 21:24 |
WebFilter | 1 | 3.38 KB | 12 Nov 2014 - 12:37 |
Sift | 1 | 16.08 KB | 10 Nov 2014 - 03:48 |
StackRambler | 1 | 8.74 MB | 08 Nov 2014 - 09:23 |
HTMLParser | 2 | 6.98 KB | 07 Nov 2014 - 17:03 |
MojeekBot | 1 | 16.08 KB | 07 Nov 2014 - 08:02 |
Feedfetcher-Google | 1 | 3.25 KB | 04 Nov 2014 - 13:39 |