40 different robots | Hits | Bandwidth | Last visit |
WGet tools | 564,103 | 697.30 GB | 31 Mar 2021 - 23:10 |
Python-urllib | 301,732 | 77.44 GB | 31 Mar 2021 - 23:10 |
Common *nix tool for automating web document retireval. Most likely a bot. | 11,972 | 19.61 GB | 31 Mar 2021 - 23:09 |
Bingbot | 60,895 | 9.00 GB | 31 Mar 2021 - 23:09 |
Suspected bot masqurading as Mozilla | 106,206 | 179.08 MB | 31 Mar 2021 - 23:08 |
SemrushBot | 10,540 | 2.49 GB | 31 Mar 2021 - 23:06 |
Unknown robot (identified by 'spider') | 4,564 | 2.07 GB | 31 Mar 2021 - 23:05 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 713 | 1.26 GB | 31 Mar 2021 - 22:52 |
Unknown robot (identified by empty user agent string) | 5,146 | 650.34 MB | 31 Mar 2021 - 22:50 |
DotBot, Open Site Explorer | 6,631 | 1.92 GB | 31 Mar 2021 - 22:43 |
Yandex Bot | 1,762 | 813.34 MB | 31 Mar 2021 - 21:50 |
Java (Often spam bot) | 1,271 | 6.11 MB | 31 Mar 2021 - 21:36 |
BaiDuSpider | 85 | 8.52 MB | 31 Mar 2021 - 21:31 |
Googlebot | 413 | 16.77 MB | 31 Mar 2021 - 20:46 |
WordPress | 33 | 125.98 KB | 31 Mar 2021 - 18:24 |
Mail.ru bot | 15 | 90.57 KB | 31 Mar 2021 - 16:43 |
LinkChecker | 3 | 12.44 KB | 31 Mar 2021 - 16:15 |
Perl tool | 2,884 | 4.12 GB | 31 Mar 2021 - 15:59 |
Unknown robot (identified by 'robot') | 39 | 1.29 MB | 31 Mar 2021 - 14:20 |
Web Core / Roots | 376 | 59.19 MB | 31 Mar 2021 - 14:05 |
FaceBook bot | 127 | 532.43 KB | 31 Mar 2021 - 11:51 |
AhrefsBot | 154 | 192.28 MB | 31 Mar 2021 - 06:42 |
Bing Preview bot | 12 | 42.90 MB | 31 Mar 2021 - 03:58 |
SeznamBot | 5 | 21.15 KB | 30 Mar 2021 - 21:40 |
MJ12bot | 227 | 31.41 MB | 30 Mar 2021 - 19:43 |
Unknown robot (identified by 'crawl') | 121,385 | 2.31 GB | 30 Mar 2021 - 14:53 |
MSNBot | 76 | 23.08 MB | 30 Mar 2021 - 04:09 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 107 | 26.18 MB | 29 Mar 2021 - 10:10 |
ltx71 | 26 | 85.60 KB | 27 Mar 2021 - 20:36 |
Sift | 2 | 8.46 KB | 27 Mar 2021 - 11:15 |
Sogou Spider | 7 | 4.20 MB | 25 Mar 2021 - 12:52 |
FavIconizer | 17 | 2.15 MB | 25 Mar 2021 - 06:53 |
Anthill | 1 | 4.23 KB | 25 Mar 2021 - 03:10 |
yeti | 1 | 4.42 KB | 24 Mar 2021 - 11:26 |
twitterbot | 3 | 38.12 MB | 23 Mar 2021 - 22:27 |
microsoft-webdav-miniredir | 2 | 0 | 23 Mar 2021 - 06:53 |
MojeekBot | 1 | 2.92 KB | 21 Mar 2021 - 22:14 |
SEOkicks Webcrawler | 82 | 251.30 KB | 19 Mar 2021 - 11:03 |
YaCy | 1 | 4.42 KB | 12 Mar 2021 - 11:34 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 4.23 KB | 03 Mar 2021 - 13:10 |
|