63 different robots | Hits | Bandwidth | Last visit |
WGet tools | 5,345,613 | 24793.86 GB | 31 Jan 2021 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 98,788 | 160.46 GB | 31 Jan 2021 - 23:56 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 80,324 | 514.68 GB | 31 Jan 2021 - 23:59 |
Unknown robot (identified by 'crawl') | 71,053 | 413.45 GB | 31 Jan 2021 - 12:05 |
Bingbot | 58,444 | 414.98 GB | 31 Jan 2021 - 23:58 |
AhrefsBot | 13,033 | 202.37 GB | 31 Jan 2021 - 23:59 |
Unknown robot (identified by empty user agent string) | 11,908 | 86.62 GB | 31 Jan 2021 - 23:56 |
Unknown robot (identified by 'spider') | 11,285 | 56.08 GB | 30 Jan 2021 - 23:13 |
check_http (nagios) | 8,843 | 28.56 MB | 31 Jan 2021 - 23:52 |
SemrushBot | 8,383 | 55.56 GB | 31 Jan 2021 - 23:54 |
Googlebot | 6,337 | 46.65 GB | 31 Jan 2021 - 23:38 |
Python-urllib | 5,184 | 22.51 GB | 31 Jan 2021 - 23:41 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 2,008 | 134.79 MB | 26 Jan 2021 - 21:26 |
DotBot, Open Site Explorer | 1,333 | 17.86 GB | 31 Jan 2021 - 23:34 |
Yandex Bot | 1,141 | 35.36 GB | 31 Jan 2021 - 19:14 |
MagpieRSS | 997 | 186.42 GB | 31 Jan 2021 - 22:43 |
Java (Often spam bot) | 822 | 4.10 GB | 29 Jan 2021 - 06:13 |
Unknown robot (identified by 'robot') | 753 | 3.72 GB | 31 Jan 2021 - 22:43 |
Common Crawl | 679 | 3.01 GB | 25 Jan 2021 - 19:41 |
Perl tool | 504 | 10.78 GB | 31 Jan 2021 - 17:51 |
MJ12bot | 451 | 12.32 GB | 31 Jan 2021 - 16:30 |
Suspected bot masqurading as Mozilla | 439 | 1.35 GB | 30 Jan 2021 - 13:48 |
SEOkicks Webcrawler | 376 | 8.39 GB | 09 Jan 2021 - 09:21 |
ltx71 | 279 | 36.64 GB | 31 Jan 2021 - 13:02 |
Bing Preview bot | 272 | 13.95 GB | 31 Jan 2021 - 20:27 |
Mail.ru bot | 244 | 964.63 MB | 29 Jan 2021 - 20:34 |
FavIconizer | 188 | 417.63 MB | 31 Jan 2021 - 22:21 |
BaiDuSpider | 161 | 9.34 GB | 31 Jan 2021 - 18:35 |
Suspected bot masqurading as Mozilla | 158 | 56.15 MB | 31 Jan 2021 - 10:53 |
LinkChecker | 122 | 130.79 MB | 31 Jan 2021 - 07:00 |
Googlebot-Image | 113 | 18.98 MB | 31 Jan 2021 - 01:45 |
SeznamBot | 110 | 1.32 GB | 31 Jan 2021 - 20:15 |
FaceBook bot | 101 | 9.58 GB | 31 Jan 2021 - 00:53 |
YaCy | 94 | 7.54 GB | 31 Jan 2021 - 14:32 |
MojeekBot | 43 | 6.02 MB | 31 Jan 2021 - 11:08 |
Sift | 40 | 386.13 MB | 31 Jan 2021 - 20:56 |
GigaBot | 30 | 30.98 MB | 25 Jan 2021 - 19:58 |
WordPress | 27 | 49.02 MB | 28 Jan 2021 - 01:15 |
Motor | 24 | 45.27 KB | 14 Jan 2021 - 22:12 |
360spider | 24 | 88.13 MB | 27 Jan 2021 - 20:40 |
Nutch | 23 | 77.40 KB | 24 Jan 2021 - 08:56 |
Netcraft | 18 | 59.54 KB | 31 Jan 2021 - 21:13 |
Web Core / Roots | 18 | 798.42 MB | 30 Jan 2021 - 14:03 |
Anthill | 17 | 247.72 MB | 31 Jan 2021 - 00:47 |
Sogou Spider | 15 | 49.74 KB | 29 Jan 2021 - 19:34 |
Unknown robot (identified by 'discovery') | 12 | 19.34 KB | 03 Jan 2021 - 13:09 |
twitterbot | 11 | 1.61 GB | 25 Jan 2021 - 12:34 |
Fish search | 10 | 19.98 KB | 17 Jan 2021 - 22:50 |
yeti | 9 | 14.55 KB | 31 Jan 2021 - 00:17 |
archive.org bot | 7 | 40.54 KB | 30 Jan 2021 - 22:19 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 20.52 KB | 25 Jan 2021 - 23:50 |
Phantom | 4 | 11.10 KB | 24 Jan 2021 - 19:29 |
TestBot | 2 | 6.57 KB | 15 Jan 2021 - 10:39 |
CMS Crawler | 2 | 6.45 KB | 20 Jan 2021 - 22:53 |
Exabot | 2 | 747.73 KB | 28 Jan 2021 - 09:10 |
Unknown robot (identified by 'scanner') | 2 | 6.45 KB | 16 Jan 2021 - 04:06 |
ning | 2 | 387.01 MB | 23 Jan 2021 - 21:18 |
HTTrack off-line browser | 2 | 382.78 MB | 26 Jan 2021 - 06:50 |
Google AdSense | 2 | 6.70 KB | 12 Jan 2021 - 02:41 |
VSE | 1 | 530.41 KB | 13 Jan 2021 - 21:09 |
CFNetwork | 1 | 0 | 27 Jan 2021 - 19:58 |
TITAN | 1 | 9.14 KB | 17 Jan 2021 - 23:40 |
The Tweeted Times | 1 | 415.00 MB | 03 Jan 2021 - 20:49 |
|