65 different robots | Hits | Bandwidth | Last visit |
WGet tools | 2,923,522 | 8067.99 GB | 31 Mar 2021 - 23:59 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 85,321 | 439.91 GB | 31 Mar 2021 - 23:59 |
Bingbot | 50,048 | 500.51 GB | 31 Mar 2021 - 23:59 |
AhrefsBot | 11,365 | 200.16 GB | 31 Mar 2021 - 23:58 |
check_http (nagios) | 8,859 | 28.62 MB | 31 Mar 2021 - 23:58 |
Unknown robot (identified by 'crawl') | 128,218 | 1027.80 GB | 31 Mar 2021 - 23:57 |
Common *nix tool for automating web document retireval. Most likely a bot. | 14,483 | 113.77 GB | 31 Mar 2021 - 23:57 |
Python-urllib | 2,512 | 26.30 GB | 31 Mar 2021 - 23:57 |
DotBot, Open Site Explorer | 2,877 | 40.01 GB | 31 Mar 2021 - 23:54 |
SemrushBot | 15,224 | 93.43 GB | 31 Mar 2021 - 23:52 |
Unknown robot (identified by empty user agent string) | 9,712 | 100.32 GB | 31 Mar 2021 - 23:36 |
Suspected bot masqurading as Mozilla | 98 | 81.03 MB | 31 Mar 2021 - 23:33 |
Unknown robot (identified by 'robot') | 1,163 | 2.79 GB | 31 Mar 2021 - 23:28 |
Mail.ru bot | 192 | 304.42 MB | 31 Mar 2021 - 23:11 |
Unknown robot (identified by 'spider') | 4,865 | 26.55 GB | 31 Mar 2021 - 23:02 |
Googlebot | 3,529 | 27.75 GB | 31 Mar 2021 - 22:59 |
Yandex Bot | 1,301 | 17.82 GB | 31 Mar 2021 - 22:48 |
360spider | 90 | 261.55 MB | 31 Mar 2021 - 22:39 |
LinkChecker | 110 | 83.68 MB | 31 Mar 2021 - 21:27 |
FavIconizer | 166 | 2.85 MB | 31 Mar 2021 - 20:46 |
Google Web Preview | 55 | 120.55 KB | 31 Mar 2021 - 20:12 |
Bing Preview bot | 119 | 12.05 GB | 31 Mar 2021 - 19:24 |
Perl tool | 434 | 4.42 GB | 31 Mar 2021 - 19:15 |
MojeekBot | 43 | 757.78 KB | 31 Mar 2021 - 17:46 |
SeznamBot | 157 | 575.77 MB | 31 Mar 2021 - 17:11 |
yeti | 8 | 21.95 KB | 31 Mar 2021 - 16:21 |
Java (Often spam bot) | 637 | 9.37 GB | 31 Mar 2021 - 13:18 |
Googlebot-Image | 82 | 11.75 MB | 31 Mar 2021 - 12:42 |
Web Core / Roots | 65 | 1.83 GB | 31 Mar 2021 - 11:37 |
Netcraft | 18 | 56.31 KB | 31 Mar 2021 - 10:55 |
MJ12bot | 1,113 | 27.62 GB | 31 Mar 2021 - 10:03 |
Custo | 51 | 168.69 KB | 31 Mar 2021 - 09:40 |
BaiDuSpider | 164 | 13.73 GB | 31 Mar 2021 - 09:34 |
ltx71 | 273 | 43.69 GB | 31 Mar 2021 - 07:32 |
Sift | 29 | 468.48 KB | 31 Mar 2021 - 07:29 |
Suspected bot masqurading as Mozilla | 82 | 114.37 MB | 31 Mar 2021 - 04:38 |
FaceBook bot | 34 | 1.87 GB | 30 Mar 2021 - 17:51 |
YaCy | 109 | 4.89 GB | 30 Mar 2021 - 13:50 |
twitterbot | 14 | 2.09 GB | 30 Mar 2021 - 09:47 |
Sogou Spider | 13 | 43.17 KB | 30 Mar 2021 - 07:32 |
Anthill | 13 | 660.55 KB | 30 Mar 2021 - 03:13 |
InfoBot | 2 | 8.71 KB | 29 Mar 2021 - 08:40 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 3 | 9.92 KB | 29 Mar 2021 - 04:06 |
Nutch | 21 | 4.88 GB | 28 Mar 2021 - 19:12 |
GetURL | 14 | 4.40 GB | 28 Mar 2021 - 15:49 |
Cfetch | 1 | 192.16 MB | 27 Mar 2021 - 12:33 |
Motor | 16 | 416.04 MB | 27 Mar 2021 - 01:22 |
Unknown robot (identified by 'discovery') | 26 | 74.52 KB | 26 Mar 2021 - 20:15 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 2,426 | 403.90 MB | 26 Mar 2021 - 12:15 |
WordPress | 1 | 19.60 KB | 26 Mar 2021 - 08:18 |
Simmany Robot Ver1.0 | 2 | 386.00 MB | 24 Mar 2021 - 15:26 |
ning | 30 | 197.05 MB | 22 Mar 2021 - 14:09 |
SEOkicks Webcrawler | 698 | 24.33 GB | 20 Mar 2021 - 16:27 |
HTTrack off-line browser | 2 | 30.79 MB | 16 Mar 2021 - 23:34 |
Exabot | 16 | 15.50 MB | 13 Mar 2021 - 04:41 |
Phantom | 4 | 10.85 KB | 12 Mar 2021 - 09:05 |
TestBot | 4 | 13.15 KB | 11 Mar 2021 - 07:56 |
Yahoo Slurp | 1 | 1.99 MB | 10 Mar 2021 - 01:00 |
BUbiNG | 2 | 8.52 KB | 08 Mar 2021 - 14:30 |
MSIECrawler | 1 | 6.11 MB | 08 Mar 2021 - 04:56 |
archive.org bot | 1 | 991 Bytes | 06 Mar 2021 - 12:34 |
CFNetwork | 1 | 754 Bytes | 05 Mar 2021 - 17:31 |
Common Crawl | 217 | 554.81 MB | 05 Mar 2021 - 07:46 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 4 | 15.38 MB | 05 Mar 2021 - 07:14 |
InternetArchive | 1 | 14.44 KB | 05 Mar 2021 - 04:53 |
|