AI crawler access:
social and media platforms
Communities, streaming and creative platforms. 27 domains measured; 13 block at least one of the fifteen tracked AI crawlers.
13of 27 social and media platforms block at least one AI crawler · median access 100%
Every domain in this category
Sorted by the share of tracked AI crawlers permitted, lowest first. Each report shows all fifteen verdicts and the robots.txt rule behind them.
| Domain | Access | Allowed | Blocked | Not listed |
|---|---|---|---|---|
| reddit.com | 0% | 0 | 15 | 0 |
| pinterest.com | 7% | 1 | 14 | 0 |
| imdb.com | 13% | 2 | 13 | 0 |
| quora.com | 13% | 2 | 13 | 0 |
| flickr.com | 40% | 6 | 9 | 0 |
| behance.net | 53% | 8 | 7 | 0 |
| pexels.com | 53% | 8 | 7 | 0 |
| medium.com | 60% | 9 | 6 | 0 |
| netflix.com | 60% | 9 | 6 | 0 |
| vimeo.com | 67% | 10 | 5 | 0 |
| goodreads.com | 87% | 13 | 2 | 0 |
| metacritic.com | 87% | 13 | 2 | 0 |
| disneyplus.com | 93% | 14 | 1 | 0 |
| 500px.com | 100% | 0 | 0 | 15 |
| deviantart.com | 100% | 15 | 0 | 0 |
| dribbble.com | 100% | 15 | 0 | 0 |
| giphy.com | 100% | 15 | 0 | 0 |
| hbomax.com | 100% | 15 | 0 | 0 |
| hulu.com | 100% | 0 | 0 | 15 |
| linkedin.com | 100% | 0 | 0 | 15 |
| rottentomatoes.com | 100% | 15 | 0 | 0 |
| soundcloud.com | 100% | 15 | 0 | 0 |
| spotify.com | 100% | 15 | 0 | 0 |
| substack.com | 100% | 15 | 0 | 0 |
| twitch.tv | 100% | 15 | 0 | 0 |
| unsplash.com | 100% | 15 | 0 | 0 |
| youtube.com | 100% | 15 | 0 | 0 |
Method and caveats are described on the full study page: one robots.txt fetch per domain, resolved against fifteen published AI user-agents, reported as the voluntary policy it is. Check any site yourself with the free crawler access checker.