56 different robots | Hits | Bandwidth | Last visit |
Python-urllib | 821,970+10 | 6.06 GB | 30 Apr 2023 - 22:10 |
Common *nix tool for automating web document retireval. Most likely a bot. | 815,971 | 3.98 GB | 30 Apr 2023 - 22:10 |
AhrefsBot | 216,662+421 | 9.42 GB | 30 Apr 2023 - 22:10 |
WGet tools | 66,029+34 | 302.50 GB | 30 Apr 2023 - 22:10 |
MJ12bot | 64,062+1806 | 12.81 GB | 30 Apr 2023 - 22:03 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 59,617+1184 | 3.95 GB | 30 Apr 2023 - 22:10 |
Grabber (SDSC) | 47,402 | 47.46 MB | 30 Apr 2023 - 22:10 |
Bingbot | 43,867+236 | 1.46 GB | 30 Apr 2023 - 22:10 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 40,532+104 | 1.47 GB | 29 Apr 2023 - 21:39 |
SemrushBot | 22,992+1460 | 364.37 MB | 30 Apr 2023 - 22:06 |
Googlebot | 21,096+184 | 1.01 GB | 30 Apr 2023 - 22:06 |
DotBot, Open Site Explorer | 16,873+1982 | 3.45 GB | 30 Apr 2023 - 21:46 |
Yandex Bot | 6,294+453 | 611.81 MB | 30 Apr 2023 - 22:02 |
Unknown robot (identified by 'crawl') | 4,915+31 | 190.78 MB | 30 Apr 2023 - 00:36 |
Unknown robot (identified by 'spider') | 4,045+104 | 1.54 GB | 30 Apr 2023 - 21:57 |
Unknown robot (identified by empty user agent string) | 4,100+7 | 1.54 GB | 30 Apr 2023 - 22:05 |
FaceBook bot | 1,648 | 32.82 MB | 30 Apr 2023 - 21:40 |
Unknown robot (identified by hit on 'robots.txt') | 0+1390 | 295.71 KB | 30 Apr 2023 - 21:47 |
BaiDuSpider | 942 | 158.05 MB | 30 Apr 2023 - 22:09 |
Web Core / Roots | 903+3 | 158.35 MB | 30 Apr 2023 - 19:04 |
Perl tool | 656 | 25.41 MB | 30 Apr 2023 - 17:03 |
Bing Preview bot | 540 | 17.87 MB | 30 Apr 2023 - 10:20 |
MojeekBot | 275+238 | 4.31 MB | 30 Apr 2023 - 20:29 |
SeznamBot | 345+63 | 7.05 MB | 30 Apr 2023 - 22:09 |
YaCy | 289+44 | 6.40 MB | 30 Apr 2023 - 07:37 |
Google Web Preview | 307 | 13.25 MB | 30 Apr 2023 - 21:37 |
LinkChecker | 223+10 | 144.82 KB | 30 Apr 2023 - 16:14 |
Common Crawl | 180+1 | 26.54 MB | 01 Apr 2023 - 02:25 |
Motor | 179 | 16.64 MB | 26 Apr 2023 - 03:04 |
Sogou Spider | 150+5 | 3.03 MB | 30 Apr 2023 - 18:23 |
twitterbot | 81+24 | 24.64 MB | 29 Apr 2023 - 20:47 |
WordPress | 93 | 51.97 MB | 26 Apr 2023 - 16:23 |
CFNetwork | 50 | 552.04 KB | 30 Apr 2023 - 04:30 |
Unknown robot (identified by 'robot') | 30+18 | 364.28 KB | 27 Apr 2023 - 16:04 |
Mail.ru bot | 15+15 | 283.21 KB | 25 Apr 2023 - 03:18 |
InfoBot | 0+26 | 5.54 KB | 26 Apr 2023 - 15:37 |
LinkBot | 17+9 | 143.40 KB | 26 Apr 2023 - 23:50 |
Googlebot-Image | 25 | 1.81 MB | 29 Apr 2023 - 14:09 |
A PHP script | 21 | 768.95 KB | 12 Apr 2023 - 03:51 |
yeti | 3+15 | 39.71 KB | 23 Apr 2023 - 05:45 |
WebCopy | 16 | 0 | 17 Apr 2023 - 09:31 |
MagpieRSS | 0+14 | 2.98 KB | 28 Apr 2023 - 09:32 |
Linkdex | 11+3 | 768.51 KB | 28 Apr 2023 - 17:12 |
Y!J Yahoo Japan | 3+8 | 49.72 KB | 27 Apr 2023 - 07:33 |
ning | 11 | 79.02 KB | 27 Apr 2023 - 00:03 |
HTTrack off-line browser | 6 | 12.89 MB | 29 Apr 2023 - 10:20 |
Nutch | 0+4 | 872 Bytes | 14 Apr 2023 - 12:04 |
Daum | 0+4 | 872 Bytes | 17 Apr 2023 - 11:19 |
FavIconizer | 3 | 39.79 KB | 29 Apr 2023 - 06:01 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 3 | 33.95 KB | 17 Apr 2023 - 03:26 |
InternetArchive | 3 | 0 | 13 Apr 2023 - 15:19 |
Suspected bot masqurading as Mozilla | 3 | 29.05 KB | 18 Apr 2023 - 10:13 |
Java (Often spam bot) | 2 | 18.43 KB | 29 Apr 2023 - 02:36 |
Yahoo Slurp | 1 | 8.69 KB | 26 Apr 2023 - 11:54 |
360spider | 1 | 16.91 KB | 27 Apr 2023 - 14:17 |
Suspected bot masqurading as Mozilla | 1 | 0 | 13 Apr 2023 - 01:33 |
|