| 63 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 5,345,613 | 24793.86 GB | 31 Jan 2021 - 23:59 |
| AhrefsBot | 13,033 | 202.37 GB | 31 Jan 2021 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 80,324 | 514.68 GB | 31 Jan 2021 - 23:59 |
| Bingbot | 58,444 | 414.98 GB | 31 Jan 2021 - 23:58 |
| Unknown robot (identified by empty user agent string) | 11,908 | 86.62 GB | 31 Jan 2021 - 23:56 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 98,788 | 160.46 GB | 31 Jan 2021 - 23:56 |
| SemrushBot | 8,383 | 55.56 GB | 31 Jan 2021 - 23:54 |
| check_http (nagios) | 8,843 | 28.56 MB | 31 Jan 2021 - 23:52 |
| Python-urllib | 5,184 | 22.51 GB | 31 Jan 2021 - 23:41 |
| Googlebot | 6,337 | 46.65 GB | 31 Jan 2021 - 23:38 |
| DotBot, Open Site Explorer | 1,333 | 17.86 GB | 31 Jan 2021 - 23:34 |
| Unknown robot (identified by 'robot') | 753 | 3.72 GB | 31 Jan 2021 - 22:43 |
| MagpieRSS | 997 | 186.42 GB | 31 Jan 2021 - 22:43 |
| FavIconizer | 188 | 417.63 MB | 31 Jan 2021 - 22:21 |
| Netcraft | 18 | 59.54 KB | 31 Jan 2021 - 21:13 |
| Sift | 40 | 386.13 MB | 31 Jan 2021 - 20:56 |
| Bing Preview bot | 272 | 13.95 GB | 31 Jan 2021 - 20:27 |
| SeznamBot | 110 | 1.32 GB | 31 Jan 2021 - 20:15 |
| Yandex Bot | 1,141 | 35.36 GB | 31 Jan 2021 - 19:14 |
| BaiDuSpider | 161 | 9.34 GB | 31 Jan 2021 - 18:35 |
| Perl tool | 504 | 10.78 GB | 31 Jan 2021 - 17:51 |
| MJ12bot | 451 | 12.32 GB | 31 Jan 2021 - 16:30 |
| YaCy | 94 | 7.54 GB | 31 Jan 2021 - 14:32 |
| ltx71 | 279 | 36.64 GB | 31 Jan 2021 - 13:02 |
| Unknown robot (identified by 'crawl') | 71,053 | 413.45 GB | 31 Jan 2021 - 12:05 |
| MojeekBot | 43 | 6.02 MB | 31 Jan 2021 - 11:08 |
| Suspected bot masqurading as Mozilla | 158 | 56.15 MB | 31 Jan 2021 - 10:53 |
| LinkChecker | 122 | 130.79 MB | 31 Jan 2021 - 07:00 |
| Googlebot-Image | 113 | 18.98 MB | 31 Jan 2021 - 01:45 |
| FaceBook bot | 101 | 9.58 GB | 31 Jan 2021 - 00:53 |
| Anthill | 17 | 247.72 MB | 31 Jan 2021 - 00:47 |
| yeti | 9 | 14.55 KB | 31 Jan 2021 - 00:17 |
| Unknown robot (identified by 'spider') | 11,285 | 56.08 GB | 30 Jan 2021 - 23:13 |
| archive.org bot | 7 | 40.54 KB | 30 Jan 2021 - 22:19 |
| Web Core / Roots | 18 | 798.42 MB | 30 Jan 2021 - 14:03 |
| Suspected bot masqurading as Mozilla | 439 | 1.35 GB | 30 Jan 2021 - 13:48 |
| Mail.ru bot | 244 | 964.63 MB | 29 Jan 2021 - 20:34 |
| Sogou Spider | 15 | 49.74 KB | 29 Jan 2021 - 19:34 |
| Java (Often spam bot) | 822 | 4.10 GB | 29 Jan 2021 - 06:13 |
| Exabot | 2 | 747.73 KB | 28 Jan 2021 - 09:10 |
| WordPress | 27 | 49.02 MB | 28 Jan 2021 - 01:15 |
| 360spider | 24 | 88.13 MB | 27 Jan 2021 - 20:40 |
| CFNetwork | 1 | 0 | 27 Jan 2021 - 19:58 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 2,008 | 134.79 MB | 26 Jan 2021 - 21:26 |
| HTTrack off-line browser | 2 | 382.78 MB | 26 Jan 2021 - 06:50 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 20.52 KB | 25 Jan 2021 - 23:50 |
| GigaBot | 30 | 30.98 MB | 25 Jan 2021 - 19:58 |
| Common Crawl | 679 | 3.01 GB | 25 Jan 2021 - 19:41 |
| twitterbot | 11 | 1.61 GB | 25 Jan 2021 - 12:34 |
| Phantom | 4 | 11.10 KB | 24 Jan 2021 - 19:29 |
| Nutch | 23 | 77.40 KB | 24 Jan 2021 - 08:56 |
| ning | 2 | 387.01 MB | 23 Jan 2021 - 21:18 |
| CMS Crawler | 2 | 6.45 KB | 20 Jan 2021 - 22:53 |
| TITAN | 1 | 9.14 KB | 17 Jan 2021 - 23:40 |
| Fish search | 10 | 19.98 KB | 17 Jan 2021 - 22:50 |
| Unknown robot (identified by 'scanner') | 2 | 6.45 KB | 16 Jan 2021 - 04:06 |
| TestBot | 2 | 6.57 KB | 15 Jan 2021 - 10:39 |
| Motor | 24 | 45.27 KB | 14 Jan 2021 - 22:12 |
| VSE | 1 | 530.41 KB | 13 Jan 2021 - 21:09 |
| Google AdSense | 2 | 6.70 KB | 12 Jan 2021 - 02:41 |
| SEOkicks Webcrawler | 376 | 8.39 GB | 09 Jan 2021 - 09:21 |
| The Tweeted Times | 1 | 415.00 MB | 03 Jan 2021 - 20:49 |
| Unknown robot (identified by 'discovery') | 12 | 19.34 KB | 03 Jan 2021 - 13:09 |
|