| 49 different robots | Hits | Bandwidth | Last visit |
|---|
| Perl tool | 280 | 11.86 MB | 31 Jan 2021 - 23:58 |
| SemrushBot | 6,555 | 336.20 GB | 31 Jan 2021 - 23:58 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,360 | 23.10 GB | 31 Jan 2021 - 23:57 |
| AhrefsBot | 23,372 | 774.77 GB | 31 Jan 2021 - 23:55 |
| Bingbot | 12,426+1 | 27.30 GB | 31 Jan 2021 - 23:55 |
| Googlebot | 189 | 787.96 MB | 31 Jan 2021 - 22:37 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 6,209 | 1467.13 GB | 31 Jan 2021 - 22:21 |
| Unknown robot (identified by 'spider') | 62 | 215.14 MB | 31 Jan 2021 - 22:12 |
| CFNetwork | 460 | 14.01 GB | 31 Jan 2021 - 22:03 |
| Yahoo Slurp | 1 | 8.04 KB | 31 Jan 2021 - 21:45 |
| Unknown robot (identified by empty user agent string) | 1,211 | 104.42 GB | 31 Jan 2021 - 21:44 |
| DotBot, Open Site Explorer | 434 | 287.66 MB | 31 Jan 2021 - 21:28 |
| Unknown robot (identified by 'robot') | 15 | 83.44 MB | 31 Jan 2021 - 20:43 |
| Suspected bot masqurading as Mozilla | 935 | 26.71 GB | 31 Jan 2021 - 20:32 |
| WGet tools | 15,601 | 871.70 GB | 31 Jan 2021 - 20:10 |
| Python-urllib | 319 | 245.54 GB | 31 Jan 2021 - 19:52 |
| Bing Preview bot | 12 | 157.52 MB | 31 Jan 2021 - 19:05 |
| LinkChecker | 485 | 0 | 31 Jan 2021 - 18:04 |
| Unknown robot (identified by 'crawl') | 2,563 | 4.06 GB | 31 Jan 2021 - 18:00 |
| Xenu's Link Sleuth (TM), see Wikipedia | 5 | 0 | 31 Jan 2021 - 17:53 |
| Jakarta commons-httpclient | 32 | 512 Bytes | 31 Jan 2021 - 15:01 |
| Suspected bot masqurading as Mozilla | 12 | 16.85 KB | 31 Jan 2021 - 14:46 |
| MJ12bot | 168 | 148.29 MB | 31 Jan 2021 - 14:04 |
| Google AdSense | 11 | 298.63 MB | 31 Jan 2021 - 13:16 |
| Java (Often spam bot) | 1,520 | 127.55 GB | 31 Jan 2021 - 13:07 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 256 | 31.89 MB | 31 Jan 2021 - 11:39 |
| SeznamBot | 13 | 62.50 KB | 31 Jan 2021 - 01:56 |
| MSNBot | 2 | 38.00 MB | 30 Jan 2021 - 11:32 |
| archive.org bot | 6 | 180.77 MB | 30 Jan 2021 - 00:00 |
| ltx71 | 49 | 110.76 MB | 29 Jan 2021 - 21:26 |
| Web Core / Roots | 51 | 1.34 GB | 29 Jan 2021 - 17:38 |
| Yandex Bot | 164 | 1.01 GB | 29 Jan 2021 - 08:32 |
| Nutch | 1 | 30.84 MB | 28 Jan 2021 - 17:37 |
| Common Crawl | 193 | 5.74 MB | 26 Jan 2021 - 19:16 |
| FaceBook bot | 2 | 30.84 MB | 26 Jan 2021 - 01:33 |
| BaiDuSpider | 3 | 277.77 KB | 24 Jan 2021 - 09:57 |
| Motor | 1 | 29.26 MB | 21 Jan 2021 - 15:22 |
| Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 21 Jan 2021 - 06:40 |
| HTTrack off-line browser | 34 | 7.15 GB | 16 Jan 2021 - 02:04 |
| GigaBot | 1 | 5.29 KB | 14 Jan 2021 - 03:42 |
| VSE | 1 | 511.96 KB | 13 Jan 2021 - 21:31 |
| twitterbot | 2 | 15.84 KB | 12 Jan 2021 - 11:12 |
| WordPress | 12 | 133.80 MB | 07 Jan 2021 - 06:30 |
| Suspected bot masquerading as M$ IE | 30 | 10.67 GB | 06 Jan 2021 - 19:24 |
| 360spider | 1 | 2.74 KB | 06 Jan 2021 - 08:45 |
| YaCy | 2 | 904.00 KB | 04 Jan 2021 - 21:04 |
| Simmany Robot Ver1.0 | 2 | 7.17 KB | 03 Jan 2021 - 12:12 |
| WebCopy | 2 | 1.60 MB | 03 Jan 2021 - 02:22 |
| Suspected bot masqurading as Mozilla | 1 | 29.25 MB | 02 Jan 2021 - 09:44 |