Cloudflare

Cloudflare has reversed its AI crawler policy from an optional block to a default block, fundamentally changing how AI bots can access content on the websites it protects. Previously, website owners had to opt in to block AI crawlers, but now, all new Cloudflare sites automatically block AI bots unless explicit permission is granted by the site owner. This makes Cloudflare the first major internet infrastructure provider to enforce a permission-based, opt-in model for AI content access.