AI crawler access:
seo and marketing tools
The vendors advising everyone else on AI visibility. 26 domains measured; 0 block at least one of the fifteen tracked AI crawlers.
0of 26 seo and marketing tools block at least one AI crawler · median access 100%
Every domain in this category
Sorted by the share of tracked AI crawlers permitted, lowest first. Each report shows all fifteen verdicts and the robots.txt rule behind them.
| Domain | Access | Allowed | Blocked | Not listed |
|---|---|---|---|---|
| ahrefs.com | 100% | 15 | 0 | 0 |
| backlinko.com | 100% | 15 | 0 | 0 |
| botify.com | 100% | 15 | 0 | 0 |
| brightedge.com | 100% | 15 | 0 | 0 |
| clearscope.io | 100% | 0 | 0 | 15 |
| conductor.com | 100% | 15 | 0 | 0 |
| contentkingapp.com | 100% | 0 | 0 | 15 |
| frase.io | 100% | 15 | 0 | 0 |
| lumar.io | 100% | 15 | 0 | 0 |
| majestic.com | 100% | 15 | 0 | 0 |
| marketmuse.com | 100% | 15 | 0 | 0 |
| moz.com | 100% | 15 | 0 | 0 |
| neilpatel.com | 100% | 15 | 0 | 0 |
| oncrawl.com | 100% | 15 | 0 | 0 |
| screamingfrog.co.uk | 100% | 15 | 0 | 0 |
| searchenginejournal.com | 100% | 15 | 0 | 0 |
| searchengineland.com | 100% | 15 | 0 | 0 |
| semrush.com | 100% | 15 | 0 | 0 |
| seranking.com | 100% | 15 | 0 | 0 |
| seroundtable.com | 100% | 15 | 0 | 0 |
| serpstat.com | 100% | 15 | 0 | 0 |
| similarweb.com | 100% | 15 | 0 | 0 |
| sistrix.com | 100% | 0 | 0 | 15 |
| spyfu.com | 100% | 15 | 0 | 0 |
| surferseo.com | 100% | 15 | 0 | 0 |
| yoast.com | 100% | 15 | 0 | 0 |
Method and caveats are described on the full study page: one robots.txt fetch per domain, resolved against fifteen published AI user-agents, reported as the voluntary policy it is. Check any site yourself with the free crawler access checker.