47 different robots | Hits | Bandwidth | Last visit |
WGet tools | 988,136 | 1731.48 GB | 31 May 2021 - 21:59 |
Unknown robot (identified by 'crawl') | 124,558 | 12.79 GB | 31 May 2021 - 16:53 |
Python-urllib | 102,594 | 44.46 GB | 31 May 2021 - 22:10 |
Bingbot | 99,057 | 10.54 GB | 31 May 2021 - 22:10 |
Suspected bot masqurading as Mozilla | 59,001 | 97.45 MB | 31 May 2021 - 22:09 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 42,137 | 11.99 GB | 31 May 2021 - 22:07 |
DotBot, Open Site Explorer | 35,896 | 8.51 GB | 31 May 2021 - 21:59 |
Perl tool | 15,701 | 24.36 GB | 31 May 2021 - 15:57 |
HTTrack off-line browser | 13,512 | 6.65 GB | 11 May 2021 - 00:16 |
SemrushBot | 11,664 | 1.68 GB | 31 May 2021 - 22:07 |
Unknown robot (identified by empty user agent string) | 6,570 | 617.44 MB | 31 May 2021 - 21:10 |
Common *nix tool for automating web document retireval. Most likely a bot. | 5,159 | 578.66 MB | 31 May 2021 - 21:57 |
Web Core / Roots | 4,529 | 12.75 GB | 31 May 2021 - 12:13 |
Yandex Bot | 3,332 | 1.08 GB | 31 May 2021 - 20:42 |
Googlebot | 789 | 50.43 MB | 31 May 2021 - 20:23 |
Unknown robot (identified by 'spider') | 766 | 560.44 MB | 31 May 2021 - 21:54 |
Java (Often spam bot) | 574 | 13.66 MB | 31 May 2021 - 21:40 |
MJ12bot | 248 | 69.90 MB | 31 May 2021 - 21:35 |
AhrefsBot | 206 | 260.55 MB | 28 May 2021 - 03:22 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 167 | 12.97 MB | 31 May 2021 - 16:01 |
WordPress | 166 | 426.15 KB | 31 May 2021 - 14:15 |
MSNBot | 112 | 17.66 MB | 31 May 2021 - 12:24 |
SEOkicks Webcrawler | 82 | 257.81 KB | 31 May 2021 - 18:51 |
FaceBook bot | 79 | 334.96 KB | 31 May 2021 - 11:00 |
Unknown robot (identified by 'robot') | 59 | 273.70 KB | 31 May 2021 - 16:24 |
ltx71 | 52 | 379.32 KB | 28 May 2021 - 10:05 |
BaiDuSpider | 35 | 116.98 KB | 29 May 2021 - 06:11 |
Mail.ru bot | 25 | 218.98 KB | 25 May 2021 - 11:16 |
Common Crawl | 14 | 37.56 KB | 10 May 2021 - 21:08 |
Sift | 10 | 40.46 KB | 29 May 2021 - 20:23 |
Google AdSense | 8 | 20.68 KB | 21 May 2021 - 16:48 |
Bing Preview bot | 7 | 41.71 MB | 25 May 2021 - 15:58 |
FavIconizer | 7 | 29.36 KB | 31 May 2021 - 06:24 |
twitterbot | 6 | 4.76 MB | 31 May 2021 - 16:03 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 5 | 2.40 MB | 16 May 2021 - 00:49 |
Simmany Robot Ver1.0 | 5 | 13.38 KB | 06 May 2021 - 22:56 |
LinkChecker | 5 | 20.77 KB | 31 May 2021 - 13:28 |
yeti | 2 | 8.65 KB | 18 May 2021 - 09:57 |
Sogou Spider | 2 | 1.91 MB | 12 May 2021 - 12:34 |
NG 2.x (Exalead) | 2 | 8.33 KB | 21 May 2021 - 02:49 |
Grabber (SDSC) | 1 | 626 Bytes | 10 May 2021 - 06:17 |
Anthill | 1 | 4.42 KB | 29 May 2021 - 04:43 |
CFNetwork | 1 | 16.00 KB | 26 May 2021 - 03:13 |
SeznamBot | 1 | 4.23 KB | 12 May 2021 - 00:56 |
Phantom | 1 | 4.42 KB | 26 May 2021 - 01:34 |
360spider | 1 | 4.72 KB | 05 May 2021 - 08:59 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 16 May 2021 - 02:44 |
|