← All reports

Websites can be discoverable by search engines while disallowing their content from being used for AI training.

AIWeb CrawlingPrivacySep 17, 2026score 0.272 posts · 0 replies across 2 instances
The posts discuss a technical approach by Cloudflare to allow websites to remain discoverable by search engines while simultaneously blocking AI crawlers from using their content for training. This matters because it addresses the tension between web visibility and data privacy in the age of generative AI.

Claims

Websites can be discoverable by search engines while disallowing their content from being used for AI training.
Parent: AIEntity: CloudflareSub-entity: Mixed-use AI crawlersImpact: positiveDate: Sep 17, 2026Target: Cloudflare's mixed-use AI crawler policy

Source posts

@[email protected]
Have it both ways: stay discoverable in search while disallowing AI training https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/
0 boosts · 1 favs · 0 replies · Sep 17, 2026
@[email protected]
Have it both ways: stay discoverable in search while disallowing AI training | Cloudflare Blog https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/
0 boosts · 0 favs · 0 replies · Sep 17, 2026