35 different robots | Hits | Bandwidth | Last visit |
WGet tools | 905,488 | 665.34 GB | 31 May 2022 - 22:09 |
Python-urllib | 113,551 | 54.46 GB | 31 May 2022 - 22:08 |
Bingbot | 62,011 | 6.69 GB | 31 May 2022 - 22:10 |
Unknown robot (identified by 'spider') | 52,368 | 18.06 GB | 31 May 2022 - 22:11 |
MJ12bot | 44,705 | 70.84 GB | 31 May 2022 - 16:45 |
Unknown robot (identified by 'crawl') | 37,669 | 2.76 GB | 30 May 2022 - 13:48 |
DotBot, Open Site Explorer | 36,978 | 22.09 GB | 31 May 2022 - 21:53 |
SemrushBot | 14,347 | 2.62 GB | 31 May 2022 - 22:11 |
Suspected bot masqurading as Mozilla | 12,570 | 138.34 MB | 31 May 2022 - 22:05 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 12,054 | 3.70 GB | 31 May 2022 - 22:09 |
Perl tool | 8,577 | 17.55 GB | 31 May 2022 - 21:56 |
Common Crawl | 6,599 | 758.07 MB | 29 May 2022 - 12:45 |
Unknown robot (identified by empty user agent string) | 3,303 | 155.04 MB | 31 May 2022 - 17:14 |
Common *nix tool for automating web document retireval. Most likely a bot. | 2,531 | 621.39 MB | 31 May 2022 - 14:33 |
Googlebot | 902 | 143.20 MB | 31 May 2022 - 20:10 |
Yandex Bot | 535 | 279.62 MB | 31 May 2022 - 15:32 |
Java (Often spam bot) | 512 | 1.59 MB | 31 May 2022 - 21:23 |
AhrefsBot | 340 | 9.00 MB | 31 May 2022 - 19:42 |
FaceBook bot | 317 | 102.94 MB | 31 May 2022 - 15:39 |
Web Core / Roots | 229 | 38.68 MB | 31 May 2022 - 08:27 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 132 | 21.26 MB | 31 May 2022 - 03:24 |
BaiDuSpider | 123 | 50.26 MB | 31 May 2022 - 21:48 |
Unknown robot (identified by 'robot') | 71 | 7.15 MB | 31 May 2022 - 20:32 |
WordPress | 70 | 144.95 KB | 29 May 2022 - 11:25 |
SEOkicks Webcrawler | 52 | 166.47 KB | 29 May 2022 - 10:14 |
Mail.ru bot | 44 | 383.32 KB | 31 May 2022 - 00:58 |
360spider | 8 | 33.72 KB | 30 May 2022 - 20:42 |
YaCy | 6 | 23.90 KB | 31 May 2022 - 06:05 |
LinkChecker | 5 | 20.77 KB | 30 May 2022 - 13:20 |
twitterbot | 4 | 65.55 KB | 18 May 2022 - 08:18 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 3 | 12.58 KB | 27 May 2022 - 19:47 |
SeznamBot | 2 | 8.46 KB | 19 May 2022 - 01:46 |
Suspected bot masqurading as Mozilla | 1 | 2.98 KB | 03 May 2022 - 10:53 |
Custo | 1 | 4.11 KB | 24 May 2022 - 07:06 |
MojeekBot | 1 | 2.92 KB | 01 May 2022 - 11:03 |
|