Get paid when AI crawlers read your site

Updated August 2026

If your site runs behind Cloudflare, a real deadline is coming. From September 15, 2026, Cloudflare defaults new and mixed-use sites to blocking AI crawlers rather than letting them through free. That forces a decision every small site owner now has to make: block, allow free, or get paid.

What actually changed

AI companies have scraped the open web for training and live retrieval for years, mostly without paying or even asking. Cloudflare, which sits in front of a huge share of the internet, decided to flip the default: instead of AI crawlers being allowed unless you block them, they're blocked unless you explicitly allow or charge them. The formal mechanism behind the "charge" option is called x402, a payment standard built on the old, mostly unused HTTP 402 status code (Payment Required), which went from a Coinbase side project to a standard backed by a Linux Foundation body with Visa, Mastercard, Amex, Stripe and Google all participating as of July 2026.

Your three options

Block everything. Simplest, and the new default if you do nothing. You lose whatever traffic or citation value AI answers were sending you, but nothing scrapes your content for free either.

Allow it free. Some publishers want the visibility of being cited in AI answers badly enough to allow crawling without charging. Reasonable if your business model depends on brand reach rather than pageviews.

Charge per crawl. The new option. Cloudflare's dashboard lets you set a price per request for participating AI crawlers, settled through the x402 payment rail. For a small site this is mostly symbolic money, but it's the only option that turns scraping from a cost into even a token benefit.

What you actually need to do it

For most site owners, charging is a toggle inside the Cloudflare dashboard, not something requiring a crypto wallet or technical setup: Cloudflare handles the payout in fiat currency by default. Where this site's tip jar generator becomes useful is the adjacent case: if you want to receive payments directly to a wallet you control, for content licensing deals outside Cloudflare's system, or for a platform that pays contributors in stablecoins the way Meta now does.

Is this worth doing for a small site?

Honestly, the per-crawl income for a small blog will be small. The more important decision is simply whether you want AI crawlers reading your content at all after September 15, since the default is about to flip against them. If you currently get meaningful traffic from AI-answer citations, allowing free access protects that. If you don't, blocking costs you nothing you were using anyway.

This describes Cloudflare's own infrastructure decision and the x402 standard as reported through mid-2026. Settings and defaults inside any platform's dashboard can change; check your own Cloudflare account before the deadline rather than relying solely on this description.