27 lines
2.4 KiB
Markdown
27 lines
2.4 KiB
Markdown
---
|
|
source_url: "https://developers.cloudflare.com/changelog/post/2026-07-01-ai-traffic-options/"
|
|
ingested: 2026-07-01
|
|
sha256: 5c008d027c72e91b732431b16189eae6fe14b36b445719c3ccd00f31d4cb4a4a
|
|
discovered_from:
|
|
platform: discord
|
|
channel_id: '1477793137064935675'
|
|
channel_name: 'tw'
|
|
message_id: '1521868415080464546'
|
|
author_id: '1477793167486226708'
|
|
posted_at: '2026-07-01T13:21:45.103000000Z'
|
|
message_excerpt: '#tw digest highlighted Cloudflare AI traffic controls as important for site owners deciding how AI crawlers, agents, and training bots may access content.'
|
|
---
|
|
|
|
[� Back to all posts](https://developers.cloudflare.com/changelog/)
|
|
|
|
Jul 01, 2026
|
|
|
|
[Bots](https://developers.cloudflare.com/bots/)
|
|
|
|
Not all AI traffic is the same. Now, all customers — including those on the Free plan — can manage AI crawlers based on what they actually do on your site. Cloudflare groups AI traffic into three behaviors you can control independently: [Search, Agent, and Training](https://developers.cloudflare.com/bots/concepts/bot/#ai-bots). This lets you keep the automated traffic that sends readers and revenue back to you, while blocking the traffic that only takes from your content.
|
|
|
|
Each behavior maps to a real use case. **Search** covers crawlers that index your content so they can answer questions about it later, where you should expect referral traffic or other equitable compensation in return. **Agent** covers automated activity acting in real time on a person's behalf, such as chat fetch bots and browser-use agents. **Training** covers crawlers that take your content to train or fine-tune a model. For each preset you can choose to block on all pages, block only on pages that display ads, or choose not to block.
|
|
|
|
|
|
|
|
Starting **September 15, 2026**, new domains onboarding to Cloudflare receive updated defaults: Bots classified as Training or as Agent are blocked on pages that display ads, while **Search** remains allowed. On that date, multi-purpose crawlers that combine Search and Training will be affected by the new defaults to block Training. All customers can [opt out of the new defaults ↗](https://dash.cloudflare.com/?to=/:account/:zone/security/settings) at any time before September 15. |