Cloudflare Adds AI Crawler Block via New Website Setting
September 19, 2026
Cloudflare introduced a setting to block AI training crawlers while maintaining search engine visibility. The feature is supported by Apple, Google, and Microsoft.
HOW THIS AFFECTS YOU
●
builderYou may face increased difficulty scraping data for training sets as more sites adopt this signal.
●
founderYour data moat becomes harder to penetrate via automated crawling.