Does colliderporn.com block AI crawlers?
Partly: colliderporn.com does block AI crawlers, including some of the AI search crawlers we test.
colliderporn.com let Claude-SearchBot in; turned OAI-SearchBot and PerplexityBot away at the firewall even though robots.txt allowed them. Its robots.txt blocked 2 of 7 AI training crawlers. We tested it on 13 October 2026 as part of our study of the top 5,000 websites, where colliderporn.com ranked #1,656.
Can AI search engines cite it?
ChatGPT search · OAI-SearchBot
Blocked by the firewall
colliderporn.com's robots.txt allows OAI-SearchBot, but colliderporn.com answered our OAI-SearchBot request with a bot challenge page while a browser got the page.
Claude · Claude-SearchBot
Reachable
colliderporn.com's robots.txt allows Claude-SearchBot, and colliderporn.com answered our Claude-SearchBot request with the page.
Perplexity · PerplexityBot
Blocked by the firewall
colliderporn.com's robots.txt allows PerplexityBot, but colliderporn.com answered our PerplexityBot request with a bot challenge page while a browser got the page.
Firewall results for colliderporn.com come from requests that identified as each crawler from our own connection, not from the crawlers' IP addresses, so the real crawler may be treated differently.
This is a snapshot of colliderporn.com from 13 October 2026.
Run a live audit to see what AI crawlers get from colliderporn.com today, plus 50 more checks.
At a glance
- AI training crawlers blocked
- 2 of 7, blocked by colliderporn.com: GPTBot, ClaudeBot
- robots.txt
- Published, with rules
- CDN
- none detected
- Content-Signal
- None
- Home page to a browser
- HTTP 200
All 31 crawlers in colliderporn.com's robots.txt
| Crawler | Job | colliderporn.com | Sites blocking it |
|---|---|---|---|
| OAI-SearchBot | AI search index | Allowed (rule for all crawlers) | 7.5% |
| Claude-SearchBot | AI search index | Allowed (rule for all crawlers) | 7.1% |
| PerplexityBot | AI search index | Allowed (rule for all crawlers) | 10% |
| MistralAI-Index | AI search index | Allowed (rule for all crawlers) | 4.1% |
| YouBot | AI search index | Allowed (rule for all crawlers) | 10% |
| ChatGPT-User | Fetches when a user asks | Allowed (rule for all crawlers) | 9.5% |
| Claude-User | Fetches when a user asks | Allowed (rule for all crawlers) | 7.5% |
| Perplexity-User | Fetches when a user asks | Allowed (rule for all crawlers) | 7.6% |
| Google-GeminiNotebook | Fetches when a user asks | Allowed (rule for all crawlers) | 3.9% |
| Meta-ExternalFetcher | Fetches when a user asks | Allowed (rule for all crawlers) | 7.9% |
| Amzn-User | Fetches when a user asks | Allowed (rule for all crawlers) | 4.8% |
| DuckAssistBot | Fetches when a user asks | Allowed (rule for all crawlers) | 7.9% |
| MistralAI-User | Fetches when a user asks | Allowed (rule for all crawlers) | 7.1% |
| Googlebot | Search engine | Allowed (rule for all crawlers) | 2.1% |
| Bingbot | Search engine | Allowed (rule for all crawlers) | 2.3% |
| Meta-WebIndexer | Search engine | Allowed (rule for all crawlers) | 6.3% |
| Amzn-SearchBot | Search engine | Allowed (rule for all crawlers) | 5.1% |
| Applebot | Search and training under one name | Allowed (rule for all crawlers) | 3.5% |
| Meta-ExternalAgent | Search and training under one name | Allowed (rule for all crawlers) | 12% |
| Amazonbot | Search and training under one name | Allowed (rule for all crawlers) | 9.8% |
| GPTBot | Model training | Blocked (named rule) | 14% |
| ClaudeBot | Model training | Blocked (named rule) | 13% |
| Google-Extended | Model training | Allowed (rule for all crawlers) | 12% |
| Applebot-Extended | Model training | Allowed (rule for all crawlers) | 11% |
| MistralAI-Training | Model training | Allowed (rule for all crawlers) | 4.2% |
| Bytespider | Model training | Allowed (rule for all crawlers) | 15% |
| CCBot | Model training | Allowed (rule for all crawlers) | 15% |
| Google-Agent | Browses and acts for a user | Allowed (rule for all crawlers) | 4.2% |
| OAI-AdsBot | Ads checks and site-owner services | Allowed (rule for all crawlers) | 4.0% |
| Google-CloudVertexBot | Ads checks and site-owner services | Allowed (rule for all crawlers) | 6.9% |
| Meta-ExternalAds | Ads checks and site-owner services | Allowed (rule for all crawlers) | 3.9% |
“Sites blocking it” is the share of the 2,332 live sites with readable robots.txt rules in the study that tested colliderporn.com. Matching follows RFC 9309: a crawler obeys the group that names it, otherwise the rule for all crawlers.
Run colliderporn.com?
Blocking training crawlers doesn't remove colliderporn.com from AI answers; blocking the search crawlers does. To keep AI search and opt out of training, use the AI robots.txt generator, then check your CDN with a live audit. Every crawler's user agent is in the AI crawler list, and the full method and data are in the study.
colliderporn.com is an adult website
This report covers how colliderporn.com's robots.txt and firewall treat AI crawlers. It's hidden until you choose to see it.
Free to run. Pay only for the fixes you want.
Free
Free account
Your score without signing in; with a free account, every check's result and the full fix for the top 3 issues.
★ Starter
$9 / ₹499 once
Every issue with its exact fix for one site, PDF/Markdown/JSON exports, re-audit for 30 days. Nothing renews.
Pro
$29 / ₹1,499 / month
Full reports on every site, weekly alerts when AI access breaks, competitor compare.
Agencies: white-label widget, branded reports and lead capture on Agency.