47 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 8,249 | 594.87 GB | 30 Apr 2023 - 22:07 |
AhrefsBot | 6,958 | 18.43 GB | 30 Apr 2023 - 22:06 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,822 | 118.36 GB | 30 Apr 2023 - 19:15 |
Python-urllib | 2,668 | 214.61 GB | 30 Apr 2023 - 22:08 |
Web Core / Roots | 2,310 | 24.77 GB | 30 Apr 2023 - 21:01 |
FaceBook bot | 2,278 | 5.14 GB | 30 Apr 2023 - 15:35 |
Common *nix tool for automating web document retireval. Most likely a bot. | 2,261 | 18.28 GB | 30 Apr 2023 - 21:25 |
Unknown robot (identified by 'crawl') | 1,950 | 146.53 GB | 29 Apr 2023 - 08:38 |
Googlebot | 1,793 | 56.48 GB | 30 Apr 2023 - 22:08 |
Bingbot | 1,272 | 24.97 GB | 30 Apr 2023 - 21:39 |
Yandex Bot | 789 | 15.13 GB | 30 Apr 2023 - 10:49 |
DotBot, Open Site Explorer | 647 | 39.46 GB | 30 Apr 2023 - 21:51 |
Unknown robot (identified by 'spider') | 604 | 40.76 GB | 30 Apr 2023 - 17:12 |
MJ12bot | 458 | 33.04 GB | 30 Apr 2023 - 19:40 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 189 | 140.49 MB | 30 Apr 2023 - 16:24 |
Unknown robot (identified by empty user agent string) | 110 | 7.78 GB | 30 Apr 2023 - 21:52 |
LinkChecker | 91 | 0 | 30 Apr 2023 - 08:51 |
WGet tools | 87 | 5.34 GB | 30 Apr 2023 - 20:46 |
Google Web Preview | 87 | 1.90 GB | 30 Apr 2023 - 19:25 |
rpt-httpclient | 60 | 228.32 MB | 30 Apr 2023 - 15:01 |
MojeekBot | 44 | 340.15 KB | 30 Apr 2023 - 22:06 |
Sogou Spider | 38 | 287.31 MB | 11 Apr 2023 - 19:14 |
SeznamBot | 16 | 65.03 KB | 29 Apr 2023 - 23:05 |
Motor | 13 | 505.05 MB | 25 Apr 2023 - 15:48 |
yeti | 10 | 126.99 MB | 30 Apr 2023 - 15:13 |
twitterbot | 9 | 427.48 MB | 28 Apr 2023 - 15:23 |
BaiDuSpider | 8 | 167.38 MB | 27 Apr 2023 - 17:37 |
CFNetwork | 5 | 129.86 MB | 27 Apr 2023 - 06:20 |
Java (Often spam bot) | 5 | 7.92 MB | 28 Apr 2023 - 13:40 |
Mail.ru bot | 3 | 200.98 MB | 12 Apr 2023 - 07:08 |
Phantom | 3 | 96.99 MB | 29 Apr 2023 - 11:52 |
Common Crawl | 3 | 6.43 KB | 02 Apr 2023 - 12:18 |
Suspected bot masqurading as Mozilla | 3 | 0 | 24 Apr 2023 - 06:40 |
Suspected bot masqurading as Mozilla | 3 | 38.87 KB | 14 Apr 2023 - 04:58 |
Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 2 | 0 | 14 Apr 2023 - 12:25 |
Feedburner | 2 | 0 | 22 Apr 2023 - 17:22 |
Unknown robot (identified by 'robot') | 2 | 14.75 KB | 20 Apr 2023 - 15:34 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2 | 6.43 KB | 23 Apr 2023 - 11:18 |
Yahoo Slurp | 2 | 28.84 KB | 20 Apr 2023 - 19:46 |
Nutch | 1 | 2.47 KB | 06 Apr 2023 - 18:09 |
SEOkicks Webcrawler | 1 | 2.47 KB | 18 Apr 2023 - 15:57 |
microsoft-webdav-miniredir | 1 | 0 | 19 Apr 2023 - 13:09 |
archive.org bot | 1 | 20.77 KB | 17 Apr 2023 - 07:40 |
Googlebot-Image | 1 | 4.14 KB | 22 Apr 2023 - 02:41 |
Y!J Yahoo Japan | 1 | 8.11 MB | 14 Apr 2023 - 07:31 |
YaCy | 1 | 54.58 MB | 19 Apr 2023 - 09:07 |
Bing Preview bot | 1 | 70.06 MB | 15 Apr 2023 - 21:10 |
|