IndexHaloAI crawler access:
travel
Booking platforms and travel publishers. 19 domains measured; 7 block at least one of the 28 tracked AI crawlers.
7of 19 travel block at least one AI crawler · median access 100%
Every domain in this category
Sorted by the share of tracked AI crawlers permitted, lowest first. Each report shows all 28 verdicts and the robots.txt rule behind them.
| Domain | Access | Allowed | Blocked | Not listed |
|---|---|---|---|---|
| cntraveler.com | 25% | 7 | 21 | 0 |
| travelandleisure.com | 25% | 7 | 21 | 0 |
| tripadvisor.com | 57% | 16 | 12 | 0 |
| airbnb.com | 96% | 27 | 1 | 0 |
| lonelyplanet.com | 96% | 27 | 1 | 0 |
| omio.com | 96% | 27 | 1 | 0 |
| skyscanner.net | 96% | 27 | 1 | 0 |
| afar.com | 100% | 28 | 0 | 0 |
| booking.com | 100% | 28 | 0 | 0 |
| britishairways.com | 100% | 28 | 0 | 0 |
| delta.com | 100% | 28 | 0 | 0 |
| expedia.com | 100% | 28 | 0 | 0 |
| hostelworld.com | 100% | 28 | 0 | 0 |
| kayak.com | 100% | 28 | 0 | 0 |
| lufthansa.com | 100% | 28 | 0 | 0 |
| roughguides.com | 100% | 28 | 0 | 0 |
| ryanair.com | 100% | 0 | 0 | 28 |
| trainline.com | 100% | 28 | 0 | 0 |
| vrbo.com | 100% | 28 | 0 | 0 |
Method and caveats are described on the full study page: one robots.txt fetch per domain, resolved against 28 published AI user-agents, reported as the voluntary policy it is. Check any site yourself with the free crawler access checker.