AI crawler access:
e-commerce and retail
Product and marketplace sites in the age of AI shopping answers. 17 domains measured; 5 block at least one of the fifteen tracked AI crawlers.
5of 17 e-commerce and retail block at least one AI crawler · median access 100%
Every domain in this category
Sorted by the share of tracked AI crawlers permitted, lowest first. Each report shows all fifteen verdicts and the robots.txt rule behind them.
| Domain | Access | Allowed | Blocked | Not listed |
|---|---|---|---|---|
| amazon.com | 20% | 3 | 12 | 0 |
| instacart.com | 20% | 3 | 12 | 0 |
| ebay.com | 47% | 7 | 8 | 0 |
| alibaba.com | 87% | 13 | 2 | 0 |
| chewy.com | 93% | 14 | 1 | 0 |
| aliexpress.com | 100% | 15 | 0 | 0 |
| bestbuy.com | 100% | 15 | 0 | 0 |
| deliveroo.co.uk | 100% | 15 | 0 | 0 |
| etsy.com | 100% | 15 | 0 | 0 |
| ikea.com | 100% | 15 | 0 | 0 |
| justeattakeaway.com | 100% | 15 | 0 | 0 |
| nike.com | 100% | 15 | 0 | 0 |
| target.com | 100% | 15 | 0 | 0 |
| ulta.com | 100% | 15 | 0 | 0 |
| walmart.com | 100% | 15 | 0 | 0 |
| wayfair.com | 100% | 15 | 0 | 0 |
| zalando.com | 100% | 15 | 0 | 0 |
Method and caveats are described on the full study page: one robots.txt fetch per domain, resolved against fifteen published AI user-agents, reported as the voluntary policy it is. Check any site yourself with the free crawler access checker.