# AI Crawl Control

Analyze and control third-party AI crawlers in your website

> Links below point directly to Markdown versions of each page. Any page can also be retrieved as Markdown by sending an `Accept: text/markdown` header to the page's URL without the `index.md` suffix (for example, `curl -H "Accept: text/markdown" https://developers.cloudflare.com/ai-crawl-control/`).
>
> For other Cloudflare products, see the [Cloudflare documentation directory](https://developers.cloudflare.com/llms.txt).
>
> Use [AI Crawl Control llms-full.txt](https://developers.cloudflare.com/ai-crawl-control/llms-full.txt) for the complete AI Crawl Control documentation in a single file, intended for offline indexing, bulk vectorization, or large-context models.

## Overview

- [AI Crawl Control](https://developers.cloudflare.com/ai-crawl-control/index.md): Monitor and control how AI services access your website content.

## Get started

- [Get started](https://developers.cloudflare.com/ai-crawl-control/get-started/index.md): Learn how to set up AI Crawl Control.

## Changelog

- [Changelog](https://developers.cloudflare.com/ai-crawl-control/changelog/index.md)

## configuration

- [AI Crawl Control with Cloudflare Bots](https://developers.cloudflare.com/ai-crawl-control/configuration/ai-crawl-control-with-bots/index.md)
- [AI Crawl Control with Transform Rules](https://developers.cloudflare.com/ai-crawl-control/configuration/ai-crawl-control-with-transform-rules/index.md): Add licensing headers to crawler responses using Transform Rules.
- [AI Crawl Control with Cloudflare WAF](https://developers.cloudflare.com/ai-crawl-control/configuration/ai-crawl-control-with-waf/index.md)

## features

- [Analyze AI traffic](https://developers.cloudflare.com/ai-crawl-control/features/analyze-ai-traffic/index.md)
- [Manage AI crawlers](https://developers.cloudflare.com/ai-crawl-control/features/manage-ai-crawlers/index.md)
- [Pay Per Crawl FAQ](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/faq/index.md)
- [Connect Stripe](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/connect-to-stripe/index.md)
- [Crawl pages](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/crawl-pages/index.md)
- [Discover payable content](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/discover-payable-content/index.md)
- [Error codes](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/error-codes/index.md)
- [Set up your account](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/set-up-cloudflare-account/index.md)
- [Verify your AI crawler](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/verify-ai-crawler/index.md)
- [Advanced configuration](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/advanced-configuration/index.md)
- [Enable in account settings](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/enable-in-account-settings/index.md)
- [Manage payouts](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/manage-payouts/index.md)
- [Monitor activity](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/monitor-activity/index.md)
- [Select crawlers to charge](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/select-crawlers-to-charge/index.md)
- [Set a pay per crawl price](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/set-a-pay-per-crawl-price/index.md)
- [What is Pay Per Crawl?](https://developers.cloudflare.com/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/index.md)
- [Track robots.txt](https://developers.cloudflare.com/ai-crawl-control/features/track-robots-txt/index.md)

## reference

- [Bot reference](https://developers.cloudflare.com/ai-crawl-control/reference/bots/index.md): Detection IDs and user agents for major AI crawlers.
- [Glossary](https://developers.cloudflare.com/ai-crawl-control/reference/glossary/index.md)
- [GraphQL API](https://developers.cloudflare.com/ai-crawl-control/reference/graphql-api/index.md): Query AI Crawl Control analytics data using the GraphQL Analytics API.
- [Worker templates](https://developers.cloudflare.com/ai-crawl-control/reference/worker-templates/index.md): Cloudflare Worker templates for AI Crawl Control integrations.