49 different robots | Hits | Bandwidth | Last visit |
Perl tool | 280 | 11.86 MB | 31 Jan 2021 - 23:58 |
SemrushBot | 6,555 | 336.20 GB | 31 Jan 2021 - 23:58 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,360 | 23.10 GB | 31 Jan 2021 - 23:57 |
AhrefsBot | 23,372 | 774.77 GB | 31 Jan 2021 - 23:55 |
Bingbot | 12,426+1 | 27.30 GB | 31 Jan 2021 - 23:55 |
Googlebot | 189 | 787.96 MB | 31 Jan 2021 - 22:37 |
Common *nix tool for automating web document retireval. Most likely a bot. | 6,209 | 1467.13 GB | 31 Jan 2021 - 22:21 |
Unknown robot (identified by 'spider') | 62 | 215.14 MB | 31 Jan 2021 - 22:12 |
CFNetwork | 460 | 14.01 GB | 31 Jan 2021 - 22:03 |
Yahoo Slurp | 1 | 8.04 KB | 31 Jan 2021 - 21:45 |
Unknown robot (identified by empty user agent string) | 1,211 | 104.42 GB | 31 Jan 2021 - 21:44 |
DotBot, Open Site Explorer | 434 | 287.66 MB | 31 Jan 2021 - 21:28 |
Unknown robot (identified by 'robot') | 15 | 83.44 MB | 31 Jan 2021 - 20:43 |
Suspected bot masqurading as Mozilla | 935 | 26.71 GB | 31 Jan 2021 - 20:32 |
WGet tools | 15,601 | 871.70 GB | 31 Jan 2021 - 20:10 |
Python-urllib | 319 | 245.54 GB | 31 Jan 2021 - 19:52 |
Bing Preview bot | 12 | 157.52 MB | 31 Jan 2021 - 19:05 |
LinkChecker | 485 | 0 | 31 Jan 2021 - 18:04 |
Unknown robot (identified by 'crawl') | 2,563 | 4.06 GB | 31 Jan 2021 - 18:00 |
Xenu's Link Sleuth (TM), see Wikipedia | 5 | 0 | 31 Jan 2021 - 17:53 |
Jakarta commons-httpclient | 32 | 512 Bytes | 31 Jan 2021 - 15:01 |
Suspected bot masqurading as Mozilla | 12 | 16.85 KB | 31 Jan 2021 - 14:46 |
MJ12bot | 168 | 148.29 MB | 31 Jan 2021 - 14:04 |
Google AdSense | 11 | 298.63 MB | 31 Jan 2021 - 13:16 |
Java (Often spam bot) | 1,520 | 127.55 GB | 31 Jan 2021 - 13:07 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 256 | 31.89 MB | 31 Jan 2021 - 11:39 |
SeznamBot | 13 | 62.50 KB | 31 Jan 2021 - 01:56 |
MSNBot | 2 | 38.00 MB | 30 Jan 2021 - 11:32 |
archive.org bot | 6 | 180.77 MB | 30 Jan 2021 - 00:00 |
ltx71 | 49 | 110.76 MB | 29 Jan 2021 - 21:26 |
Web Core / Roots | 51 | 1.34 GB | 29 Jan 2021 - 17:38 |
Yandex Bot | 164 | 1.01 GB | 29 Jan 2021 - 08:32 |
Nutch | 1 | 30.84 MB | 28 Jan 2021 - 17:37 |
Common Crawl | 193 | 5.74 MB | 26 Jan 2021 - 19:16 |
FaceBook bot | 2 | 30.84 MB | 26 Jan 2021 - 01:33 |
BaiDuSpider | 3 | 277.77 KB | 24 Jan 2021 - 09:57 |
Motor | 1 | 29.26 MB | 21 Jan 2021 - 15:22 |
Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 21 Jan 2021 - 06:40 |
HTTrack off-line browser | 34 | 7.15 GB | 16 Jan 2021 - 02:04 |
GigaBot | 1 | 5.29 KB | 14 Jan 2021 - 03:42 |
VSE | 1 | 511.96 KB | 13 Jan 2021 - 21:31 |
twitterbot | 2 | 15.84 KB | 12 Jan 2021 - 11:12 |
WordPress | 12 | 133.80 MB | 07 Jan 2021 - 06:30 |
Suspected bot masquerading as M$ IE | 30 | 10.67 GB | 06 Jan 2021 - 19:24 |
360spider | 1 | 2.74 KB | 06 Jan 2021 - 08:45 |
YaCy | 2 | 904.00 KB | 04 Jan 2021 - 21:04 |
Simmany Robot Ver1.0 | 2 | 7.17 KB | 03 Jan 2021 - 12:12 |
WebCopy | 2 | 1.60 MB | 03 Jan 2021 - 02:22 |
Suspected bot masqurading as Mozilla | 1 | 29.25 MB | 02 Jan 2021 - 09:44 |