67 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'spider') | 51,908+204 | 7.44 GB | 31 May 2023 - 18:15 |
Common *nix tool for automating web document retireval. Most likely a bot. | 810,576 | 4.16 GB | 31 May 2023 - 18:15 |
Python-urllib | 873,286+33 | 7.09 GB | 31 May 2023 - 18:15 |
Unknown robot (identified by empty user agent string) | 7,065+4 | 2.85 GB | 31 May 2023 - 18:15 |
MJ12bot | 64,243+1934 | 13.93 GB | 31 May 2023 - 18:15 |
Googlebot | 17,781+184 | 947.33 MB | 31 May 2023 - 18:15 |
Grabber (SDSC) | 48,236 | 60.17 MB | 31 May 2023 - 18:15 |
WGet tools | 80,277+41 | 287.78 GB | 31 May 2023 - 18:14 |
Bingbot | 49,361+254 | 3.81 GB | 31 May 2023 - 18:13 |
AhrefsBot | 181,860+383 | 8.72 GB | 31 May 2023 - 18:12 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 56,681+986 | 3.19 GB | 31 May 2023 - 18:12 |
Yandex Bot | 4,401+422 | 932.23 MB | 31 May 2023 - 18:10 |
SemrushBot | 33,472+1579 | 1.07 GB | 31 May 2023 - 18:06 |
DotBot, Open Site Explorer | 13,776+2024 | 2.39 GB | 31 May 2023 - 17:57 |
Mail.ru bot | 2,700+210 | 48.02 MB | 31 May 2023 - 17:37 |
LinkChecker | 222+8 | 115.86 KB | 31 May 2023 - 17:28 |
Common Crawl | 445+16 | 8.36 MB | 31 May 2023 - 17:21 |
MojeekBot | 553+449 | 6.79 MB | 31 May 2023 - 17:13 |
Perl tool | 641 | 27.06 MB | 31 May 2023 - 17:08 |
archive.org bot | 52+29 | 1.42 MB | 31 May 2023 - 17:06 |
BaiDuSpider | 2,147 | 154.78 MB | 31 May 2023 - 16:55 |
Suspected bot masqurading as Mozilla | 64 | 627.74 KB | 31 May 2023 - 16:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+1541 | 327.85 KB | 31 May 2023 - 15:55 |
FaceBook bot | 398 | 10.62 MB | 31 May 2023 - 15:38 |
SeznamBot | 304+44 | 6.47 MB | 31 May 2023 - 14:55 |
Web Core / Roots | 835+30 | 57.55 MB | 31 May 2023 - 14:20 |
Unknown robot (identified by 'crawl') | 2,600+35 | 463.98 MB | 31 May 2023 - 13:59 |
YaCy | 173+56 | 3.37 MB | 31 May 2023 - 13:25 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 37,994+114 | 1.51 GB | 31 May 2023 - 13:11 |
Y!J Yahoo Japan | 0+11 | 2.34 KB | 31 May 2023 - 10:09 |
Sogou Spider | 89+6 | 1.64 MB | 31 May 2023 - 09:34 |
twitterbot | 48+10 | 19.24 MB | 31 May 2023 - 09:03 |
LinkBot | 49+25 | 446.28 KB | 31 May 2023 - 06:06 |
MagpieRSS | 0+14 | 2.98 KB | 31 May 2023 - 04:18 |
Unknown robot (identified by 'robot') | 34+17 | 836.44 KB | 31 May 2023 - 03:37 |
Googlebot-Image | 18 | 1.29 MB | 30 May 2023 - 15:33 |
InfoBot | 0+31 | 6.60 KB | 30 May 2023 - 13:38 |
JBot Java Web Robot | 67+10 | 98.41 MB | 30 May 2023 - 08:35 |
360spider | 4 | 54.02 KB | 30 May 2023 - 04:10 |
Java (Often spam bot) | 17 | 44.18 KB | 29 May 2023 - 13:57 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 300+5 | 4.85 MB | 29 May 2023 - 10:32 |
Google Web Preview | 144 | 6.47 MB | 28 May 2023 - 09:31 |
Bing Preview bot | 145 | 11.47 MB | 27 May 2023 - 18:23 |
A PHP script | 1 | 21.04 KB | 27 May 2023 - 13:35 |
HTTrack off-line browser | 5+1 | 16.18 KB | 27 May 2023 - 10:56 |
yeti | 8+18 | 140.10 KB | 26 May 2023 - 20:09 |
WordPress | 69 | 11.56 MB | 25 May 2023 - 03:03 |
ning | 22 | 234.11 KB | 25 May 2023 - 00:03 |
FavIconizer | 7 | 102.68 KB | 24 May 2023 - 17:16 |
Suspected bot masqurading as Mozilla | 15 | 21.92 MB | 24 May 2023 - 10:53 |
CFNetwork | 13 | 573.80 KB | 24 May 2023 - 09:45 |
Unknown robot (identified by 'checker') | 0+1 | 218 Bytes | 23 May 2023 - 14:54 |
Daum | 0+4 | 872 Bytes | 22 May 2023 - 10:41 |
MSNBot | 1 | 0 | 22 May 2023 - 10:11 |
linkedinbot | 1 | 761 Bytes | 19 May 2023 - 17:58 |
InternetArchive | 2 | 0 | 18 May 2023 - 12:26 |
Linkdex | 8+2 | 571.58 KB | 17 May 2023 - 14:21 |
Hometown Spider Pro | 4 | 67.90 KB | 17 May 2023 - 10:09 |
Raven Search | 1 | 16.97 KB | 17 May 2023 - 10:09 |
WebCopy | 2 | 0 | 13 May 2023 - 10:56 |
Perman surfer | 1 | 16.84 KB | 13 May 2023 - 09:37 |
Nutch | 0+5 | 1.06 KB | 12 May 2023 - 04:17 |
Yahoo Slurp | 55 | 1.15 MB | 09 May 2023 - 15:04 |
Motor | 46 | 1.30 MB | 06 May 2023 - 20:14 |
Unknown robot (identified by 'discovery') | 1 | 16.97 KB | 05 May 2023 - 07:37 |
HKU WWW Octopus | 7 | 21.29 KB | 04 May 2023 - 02:49 |
Ruby script | 1 | 10.16 KB | 01 May 2023 - 10:57 |
|