IndexHaloAI crawler access:
finance and business media
Financial publishers and fintechs. 29 domains measured; 11 block at least one of the 28 tracked AI crawlers.
11of 29 finance and business media block at least one AI crawler · median access 100%
Every domain in this category
Sorted by the share of tracked AI crawlers permitted, lowest first. Each report shows all 28 verdicts and the robots.txt rule behind them.
| Domain | Access | Allowed | Blocked | Not listed |
|---|---|---|---|---|
| barrons.com | 25% | 7 | 21 | 0 |
| investopedia.com | 25% | 7 | 21 | 0 |
| marketwatch.com | 25% | 7 | 21 | 0 |
| cnbc.com | 46% | 13 | 15 | 0 |
| fastcompany.com | 50% | 14 | 14 | 0 |
| inc.com | 50% | 14 | 14 | 0 |
| forbes.com | 57% | 16 | 12 | 0 |
| businessinsider.com | 82% | 23 | 5 | 0 |
| fortune.com | 89% | 25 | 3 | 0 |
| fool.com | 96% | 27 | 1 | 0 |
| nerdwallet.com | 96% | 27 | 1 | 0 |
| bankofamerica.com | 100% | 28 | 0 | 0 |
| bankrate.com | 100% | 28 | 0 | 0 |
| barclays.co.uk | 100% | 28 | 0 | 0 |
| binance.com | 100% | 28 | 0 | 0 |
| chase.com | 100% | 28 | 0 | 0 |
| coinbase.com | 100% | 28 | 0 | 0 |
| creditkarma.com | 100% | 28 | 0 | 0 |
| hsbc.com | 100% | 28 | 0 | 0 |
| kraken.com | 100% | 28 | 0 | 0 |
| monzo.com | 100% | 28 | 0 | 0 |
| morningstar.com | 100% | 28 | 0 | 0 |
| n26.com | 100% | 28 | 0 | 0 |
| paypal.com | 100% | 28 | 0 | 0 |
| revolut.com | 100% | 28 | 0 | 0 |
| santander.com | 100% | 28 | 0 | 0 |
| starlingbank.com | 100% | 28 | 0 | 0 |
| wellsfargo.com | 100% | 28 | 0 | 0 |
| wise.com | 100% | 28 | 0 | 0 |
Method and caveats are described on the full study page: one robots.txt fetch per domain, resolved against 28 published AI user-agents, reported as the voluntary policy it is. Check any site yourself with the free crawler access checker.