--- title: Bots Changelog image: https://developers.cloudflare.com/og-changelog.png --- [Skip to content](#main-content) All products Product groups AI Analytics Application performance Application security Cloudflare One Consumer services Core platform Developer platform Docs collections Media Network security Privacy Storage Products Access Agents AI Crawl Control AI Gateway AI Search Analytics API Shield Artifacts Audit Logs Billing Bots Browser Isolation Browser Run Cache / CDN CASB Challenges Cloudflare for SaaS Cloudflare Fundamentals Cloudflare Images Cloudflare Mesh Cloudflare Network Firewall Cloudflare One Cloudflare One Appliance Cloudflare One Client Cloudflare Tunnel Cloudflare Tunnel for SASE Cloudflare WAN Cloudflare Web Analytics Containers D1 Data Localization Suite Data Loss Prevention Digital Experience Monitoring DNS Durable Objects Email security Email Service Flagship Gateway Go SDK Hyperdrive KV Load Balancing Log Explorer Logpush Logs Magic Transit Multi-Cloud Networking Network Flow Network Interconnect Organizations Pages Pipelines Privacy Proxy Queues R2 R2 Data Catalog R2 SQL Radar Realtime Registrar Resource Tagging Risk Score Rules Sandbox SDK SDK Secrets Store Security Center Security Overview Speed SSL/TLS Stream Support Terraform Vectorize WAF Workers Workers AI Workers Analytics Engine Workers for Platforms Workers VPC Workflows Zaraz No products found. [View RSS feeds](https://developers.cloudflare.com/fundamentals/new-features/available-rss-feeds/)[Subscribe to RSS](https://developers.cloudflare.com/changelog/rss/index.xml) Jul 1, 2026 [New options to manage AI traffic](https://developers.cloudflare.com/changelog/post/2026-07-01-ai-traffic-options/) [Bots](https://developers.cloudflare.com/bots/) Not all AI traffic is the same. Now, all customers — including those on the Free plan — can manage AI crawlers based on what they actually do on your site. Cloudflare groups AI traffic into three behaviors you can control independently: [Search, Agent, and Training](https://developers.cloudflare.com/bots/concepts/bot/#ai-bots). This lets you keep the automated traffic that sends readers and revenue back to you, while blocking the traffic that only takes from your content. Each behavior maps to a real use case. **Search** covers crawlers that index your content so they can answer questions about it later, where you should expect referral traffic or other equitable compensation in return. **Agent** covers automated activity acting in real time on a person's behalf, such as chat fetch bots and browser-use agents. **Training** covers crawlers that take your content to train or fine-tune a model. For each preset you can choose to block on all pages, block only on pages that display ads, or choose not to block. ![The Configure AI bot traffic policies screen, where Search, Agent, and Training can each be set to allow, block, or block only on pages with ads](https://developers.cloudflare.com/_astro/ai-bot-traffic-policies.BqXU7Gmv_Z24E74g.webp) Starting **September 15, 2026**, new domains onboarding to Cloudflare receive updated defaults: Bots classified as Training or as Agent are blocked on pages that display ads, while **Search** remains allowed. On that date, multi-purpose crawlers that combine Search and Training will be affected by the new defaults to block Training. All customers can [opt out of the new defaults ↗](https://dash.cloudflare.com/?to=/:account/:zone/security/settings) at any time before September 15. Jul 1, 2026 [More visibility into bot traffic with BotBase and Attribution Business Insights](https://developers.cloudflare.com/changelog/post/2026-07-01-botbase-attribution-business-insights/) [Bots](https://developers.cloudflare.com/bots/) With Content Independence Day 2026, [Enterprise Bot Management](https://developers.cloudflare.com/bots/get-started/bot-management/) customers get two new tools that make bot traffic far easier to see and reason about: [BotBase](https://developers.cloudflare.com/bots/botbase/), a searchable directory of every bot Cloudflare tracks, and [Attribution Business Insights](https://developers.cloudflare.com/bots/attribution-business-insights/), a dashboard that shows how much value each crawler sends back to your business. BotBase is Cloudflare's directory of all known bots and agents, available directly in the dashboard. It shows how Cloudflare classifies each bot by behavior — Search, Agent, Training, and other categories such as Transact, Data Collection, SEO, and Ads Verification — so you can understand why a given crawler is visiting you. You can search and filter the full catalogue, filter your own traffic down to a single bot to investigate its activity on your zone, and copy any bot's detection ID to target it precisely in [Security rules](https://developers.cloudflare.com/security/rules/). Every tracked bot in BotBase is also published in [Cloudflare Radar's bots and agents directory ↗](https://radar.cloudflare.com/bots/directory). Attribution Business Insights is built for content owners and business decision-makers who want to know which bots help or harm their business, without reading rule syntax. The dashboard reports crawl-to-referral ratios both site-wide and per bot operator — comparing how often a company crawls your content against how many visitors it actually refers back — over the last 24 hours, 7 days, or 30 days. Each operator is labeled with Cloudflare's [updated classification](https://developers.cloudflare.com/bots/concepts/bot/verified-bots/) and an action status of Allowed, Blocked, or Partially blocked, giving stakeholders a shared, at-a-glance view of the AI traffic reaching your site. ![The Attribution Business Insights dashboard, showing bot traffic, content page requests, crawl-to-referral ratio, and a per-operator bot activity table](https://developers.cloudflare.com/_astro/attribution-business-insights.Cu-ZtxkX_1SkuMS.webp) ```json {"@context":"https://schema.org","@type":"BlogPosting","@id":"https://developers.cloudflare.com/changelog/product/bots/#page","headline":"Bots Changelog | Cloudflare Docs","url":"https://developers.cloudflare.com/changelog/product/bots/","inLanguage":"en","image":"https://developers.cloudflare.com/og-changelog.png","publisher":{"@type":"Organization","name":"Cloudflare","url":"https://www.cloudflare.com/"},"isPartOf":{"@type":"WebSite","@id":"https://developers.cloudflare.com/#website","name":"Cloudflare Docs","url":"https://developers.cloudflare.com/"}} ```